[CUDA] Separate main loop into a function in qmm#3443

zcbenz wants to merge 1 commit intoml-explore:mainml-explore/mlx:mainfrom

zcbenz:qmm-refactorzcbenz/mlx:qmm-refactorCopy head branch name to clipboard