🤖FFPA: Extend FlashAttention-2 w/ Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA.
-
Updated
Apr 18, 2026 - Cuda
#
tensor-cores
Here are 23 public repositories matching this topic...
⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
-
Updated
May 10, 2025 - Cuda
General Matrix Multiplication using NVIDIA Tensor Cores
matrix-multiplication cuda-kernels gpu-computing nvidia-cuda nvidia-gpu gpu-programming sgemm cuda-programming tensor-cores nvidia-tensor-cores
-
Updated
Jan 25, 2025 - Cuda
CUDA matrix multiplication benchmarking on Jetson Orin Nano. Four implementations, three power modes, five matrix sizes. 99.5% mathematical validation. C++/CUDA and Python.
machine-learning robotics cuda cublas scientific-computing matrix-multiplication high-performance-computing gpu-computing performance-optimization autonomous-systems edge-computing nvidia-jetson edge-ai embeded-systems tensor-cores ml-deployment jetson-orin-nano gpu-benchmarking power-efficiency-benchmark cuda-optimization
-
Updated
Apr 2, 2026 - Python
Vulkan & GLSL implementation of FlashAttention-2
vulkan glsl artificial-intelligence gpu-acceleration attention gpu-computing deel-learning tensor-cores large-language-models llm flash-attention flash-attention-2
-
Updated
Jan 19, 2025 - C++
CUDA 12-first backend inference for Unsloth on Kaggle — Optimized for small GGUF models (1B-5B) on dual Tesla T4 GPUs (15GB each, SM 7.5)
python machine-learning ai deep-learning jupyter gpu cuda inference pytorch nvidia cuda-kernels google-colab tensor-cores tesla-t4 llm gguf unsloth flashattention
-
Updated
Feb 1, 2026 - Jupyter Notebook
A benchmarking framework for correlators of FX telescope arrays
-
Updated
Oct 20, 2023 - Cuda
Neural Network C is an advanced neural network implementation in pure C, optimized for high performance on CPUs and NVIDIA GPUs.
machine-learning encryption deep-learning neural-network openmp mpi parallel-computing cuda transformers artificial-intelligence high-performance-computing convolutional-neural-networks gpu-computing quantization bayesian-optimization multi-gpu c-programming real-time-monitoring secure-computing tensor-cores
-
Updated
Mar 29, 2025 - C
INT8 Sparse Tensor Core GEMM for PyTorch — built for Windows
windows gpu cuda inference pytorch nvidia sparse quantization gemm int8 ptx structured-sparsity tensor-cores vram-optimization
-
Updated
Feb 16, 2026 - Cuda
High-performance CUDA kernels with step-by-step optimization, profiling, and analysis. A growing collection of GPU solutions demonstrating warp-level tuning, memory optimization, and Tensor Core acceleration.
-
Updated
Nov 12, 2025 - Cuda
The MNIST classification problem is a fundamental machine learning task that involves recognizing handwritten digits (0- 9) from a dataset of 70,000 grayscale images (28x28 pixels each). It serves as a benchmark for evaluating machine learning models, particularly neural networks.
benchmarking deep-learning parallel-computing cuda mnist neural-networks high-performance-computing gpu-acceleration profiling shared-memory openacc performance-optimization c-cpp nsight tensor-cores cuda-streams pinned-memory
-
Updated
Sep 12, 2025 - Cuda
🔍 Analyze CUDA matrix multiplication performance and power consumption on NVIDIA Jetson Orin Nano across multiple implementations and settings.
machine-learning robotics cuda cublas matrix-multiplication high-performance-computing gpu-computing performance-optimization autonomous-systems edge-computing nvidia-jetson embeded-systems tensor-cores ml-deployment jetson-orin-nano gpu-benchmarking power-efficiency-benchmark cuda-optimization
-
Updated
Apr 18, 2026 - Python
GNN inference acceleration with TVM compiler
-
Updated
Dec 17, 2025 - Python
CUDA matrix library for GEMM, GEMV, TRSM with naive, tiled, register-blocked, and tensor-core kernels. Includes FP16/BF16 mixed precision, sparse ops, cuSOLVER wrappers, and Python bindings.
-
Updated
Apr 15, 2026 - C++
TsuruTune is a comprehensive deep learning model optimization tool designed specifically for NVIDIA Jetson platforms and edge devices.. It leverages Tensor Core acceleration and memory bandwidth alignment to achieve optimal performance for deep learning inference on edge devices.
-
Updated
Jan 8, 2026 - Python
10,000-image LeNet-5 forward pass in ~28 ms on a single A40 via fused convolution and Tensor Cores (TF32).
parallel-computing cuda inference cnn matrix-multiplication lenet convolution gpu-computing ampere gpu-programming lenet-5 im2col cuda-programming tensor-cores kernel-optimization tf32 wmma
-
Updated
Apr 16, 2026 - Cuda
-
Updated
Apr 20, 2025 - Cuda
Accelerate INT8 sparse inference in PyTorch on Windows with minimal setup. Achieve high performance using Sparse Tensor Cores without Linux dependencies.
windows gpu cuda inference pytorch nvidia sparse quantization gemm int8 ptx structured-sparsity tensor-cores vram-optimization
-
Updated
Feb 28, 2026
CUDA Kernel Optimization Academy: SGEMM Tutorial, TensorCraft Ops, HPC Advanced & Inference Engine | CUDA Kernel 优化学院：SGEMM 教程、TensorCraft 算子库、HPC 进阶、推理引擎，从入门到 Tensor Core
-
Updated
Apr 15, 2026 - C++
Mini Deep Learning Inference Engine (CUDA + C++17): 7-Level GEMM Optimization, FP16/INT8 & Auto-Tuner | 迷你深度学习推理引擎（CUDA + C++17）：7 级 GEMM 优化、FP16/INT8 量化、自动调优器
-
Updated
Apr 17, 2026 - C++
Improve this page
Add a description, image, and links to the tensor-cores topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the tensor-cores topic, visit your repo's landing page and select "manage topics."