Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 85.2k 18.9k

2. vllm-project/vllm-omni vllm-project/vllm-omni Public

   A framework for efficient model inference with omni-modality models

   Python 5.4k 1.2k

3. kvcache-ai/Mooncake kvcache-ai/Mooncake Public

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++ 5.7k 921

4. dragonflydb/dragonfly dragonflydb/dragonfly Public

   A modern replacement for Redis and Memcached

   C++ 30.8k 1.2k

5. Kedis Kedis Public

   🚀 A persistent RESP-compatible KV store in C, architected with io_uring, eBPF, and RDMA to integrate pluggable multi-engine storage with kernel-bypass data plane optimizations.

   C 1

6. RL-Align/RL-Kernel RL-Align/RL-Kernel Public

   High-performance RL post-training infrastructure. Designed to achieve bitwise operator-level train-inference consistency across heterogeneous engines and extreme memory efficiency for GRPO, PPO, etc.

   Python 177 42