Search results

When an inference pod is deleted, the kv cache info should be deleted.

Status: Open.

#537 In llm-d/llm-d-kv-cache;

· andyxning opened on Apr 24, 2026

make e2e-test failed on macos

Status: Open.

#534 In llm-d/llm-d-kv-cache;

· gyliu513 opened on Apr 23, 2026

fs-connector: remove OffloadPromMetrics monkey-patch once we move to vLLM v0.20

Status: Open.

#529 In llm-d/llm-d-kv-cache;

· kfirtoledo opened on Apr 19, 2026

feat: support for CPU RAM -> shared storage KV Cache offloading

Status: Open.

#526 In llm-d/llm-d-kv-cache;

· LedWork opened on Apr 16, 2026

Telemetry to capture additional details for KV cache calls

Status: Open.

#521 In llm-d/llm-d-kv-cache;

· Sneha-at opened on Apr 15, 2026

Add storage KV-cache indexing support

Status: Open.

#520 In llm-d/llm-d-kv-cache;

· albertoperdomo2 opened on Apr 14, 2026

llm-d v0.7.0

roadmap

Status: Open.

#519 In llm-d/llm-d-kv-cache;

· vMaroon opened on Apr 14, 2026

Deprecate tokenization on the lookup path

Status: Open.

#517 In llm-d/llm-d-kv-cache;

· vMaroon opened on Apr 14, 2026

fix: handle load failures gracefully in fs_connector's offloading_connector instead of crashing

Status: Open.

#514 In llm-d/llm-d-kv-cache;

· kfirtoledo opened on Apr 13, 2026

feat: support O_DIRECT for writes in fs_connector

Status: Open.

#513 In llm-d/llm-d-kv-cache;

· kfirtoledo opened on Apr 13, 2026

llmd_fs_connector: background write threads access freed GPU tensors under high concurrency

Status: Open.

#504 In llm-d/llm-d-kv-cache;

· natoscott opened on Apr 9, 2026

ci: Add benchstat-based performance regression detection

Status: Open.

#489 In llm-d/llm-d-kv-cache;

· gyliu513 opened on Mar 31, 2026