Pinned Loading

1. InferenceX InferenceX Public

   Forked from SemiAnalysisAI/InferenceX

   Open Source Continuous Inference Benchmarking Qwen3.5, DeepSeek, GPTOSS - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 vs H100 & soon™ TPUv6e/v7/Trainium2/3

   Python

2. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++

3. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

5. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

6. ggml-org/llama.cpp ggml-org/llama.cpp Public

   LLM inference in C/C++

   C++ 101k 16.3k