Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.

Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.

CUDA编程练习项目-Hands-on CUDA kernels and performance optimization, covering GEMM, FlashAttention, Tensor Cores, CUTLASS, quantization, KV cache, NCCL, and profiling.

Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.

Multiple GEMM operators are constructed with cutlass to support LLM inference.

FastCuda is a handwritten CUDA operator library featuring progressive GEMM and Reduce kernels, cuBLAS benchmarking, and C/C++/Python interfaces for learning, profiling, and performance optimization.

Use tensor core to calculate back-to-back HGEMM (half-precision general matrix multiplication) with MMA PTX instruction.

Codes for DTC-SpMM (ASPLOS'24)

DeepGEMMPerTensor: clean and efficient FP8 GEMM per tensor kernels without scales

The lab assignments from CS4302 Parallel and Distributed Programming (2022 Fall) with my solutions

A reproducible GPU benchmarking lab that compares FP16 vs FP32 training on MNIST using PyTorch, CuPy, and Nsight profiling tools. This project blends performance engineering with cinematic storytelling—featuring NVTX-tagged training loops, fused CuPy kernels, and a profiler-driven README that narrates the GPU’s inner workings frame by frame.

🎬 Explore GPU training efficiency with FP32 vs FP16 in this modular lab, utilizing Tensor Core acceleration for deep learning insights.