Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 75.4k 15.2k

2. vllm-project/production-stack vllm-project/production-stack Public

   vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

   Python 2.3k 382

3. LMCache/LMCache LMCache/LMCache Public

   Supercharge Your LLM with the Fastest KV Cache Layer

   Python 7.9k 1.1k