Adaptive hedged requests for Go. Cut your p99 latency with zero configuration. Based on Google's "The Tail at Scale" paper.
-
Updated
Apr 16, 2026 - Go
#
tail-latency
Here are 18 public repositories matching this topic...
[ACM SIGCOMM 2024] "m3: Accurate Flow-Level Performance Estimation using Machine Learning" by Chenning Li, Arash Nasr-Esfahany, Kevin Zhao, Kimia Noorbakhsh, Prateesh Goyal, Mohammad Alizadeh, Thomas Anderson.
-
Updated
Oct 2, 2024 - Python
[TBD] "m4: A Learned Flow-level Network Simulator" by Chenning Li, Anton A. Zabreyko, Om Chabra, Arash Nasr-Esfahany, Kevin Zhao, Prateesh Goyal, Mohammad Alizadeh, Thomas Anderson.
-
Updated
Nov 18, 2025 - C++
Proof of concept lib for creating finagle-like composable Services/Filters in node.
-
Updated
Jan 6, 2020 - JavaScript
Simulation of adversarial queueing (high packet loss) events in computer networks.
-
Updated
Feb 15, 2017 - C++
Reverse proxy which eliminates the tail latency caused by non-deterministic garbage collection
-
Updated
Mar 22, 2022 - HTML
Chasing the long tail of Clojure HTTP servers.
-
Updated
Oct 27, 2021 - Clojure
Linux kernel with CTS scheduler enabled.
-
Updated
Apr 20, 2018 - C
TailBench (Updated version)
-
Updated
Feb 6, 2026 - C++
A deployment-oriented study of latency bias in real-time face recognition systems, showing that fairness violations emerge in tail inference latency rather than mean performance, with label-free auditing and mitigation analysis.
computer-vision face-recognition tail-latency real-time-systems latency-analysis algorithmic-fairness responsible-ai
-
Updated
Feb 2, 2026 - Jupyter Notebook
WASL: Multi-Module Coordination in Adaptive Multi-Tenant Clouds (ACM/SPEC ICPE'26)
clouds tail-latency adaptation interference-mitigation multi-tenant-applications controller-coordination multi-module-adaptation cross-layer-adaptation
-
Updated
Mar 10, 2026 - Rust
Production-grade AI latency budgeting and reactive scaling framework for LLM inference systems. Covers p50/p95/p99 modeling, SLO design, Kubernetes (K8s) HPA patterns, and distributed AI infrastructure. By Vipin Kumar
kubernetes distributed-systems microservices ai sre autoscaling observability tail-latency performance-optimization system-design p99 distributed-architecture llm llm-inference p95 ai-latency latency-budget
-
Updated
Apr 19, 2026
Rust toolkit for Tokio tail-latency triage with evidence-ranked suspects and next checks.
-
Updated
Apr 20, 2026 - Rust
Offline, fail-closed verifier for JSONL telemetry event logs. Emits deterministic audit certificates + human summaries with explicit claims/non-claims for bottleneck and integrity review.
ai telemetry audit performance-monitoring bottleneck tail-latency distributed-training jsonl event-logs mlops checkpointing silent-data-corruption offline-verification
-
Updated
Dec 26, 2025 - Python
A zero-overhead, transparent sidecar for UDP Request Hedging built with eBPF/BCC. Bypasses Python GC and Scheduler jitter by handling retries directly in the SoftIRQ context.
-
Updated
Feb 16, 2026 - TeX
Request hedging for tail latency reduction in distributed systems
distributed-systems machine-learning elixir otp research ai beam reliability tail-latency hedging performance-optimization ensemble-methods statistical-testing llm latency-reduction latency-optimization request-hedging nshkr-crucible
-
Updated
Apr 4, 2026 - Elixir
Simulation study of cache architecture tradeoffs under concurrency — partitioned vs LRU vs client affinity, with trace-driven evaluation on Twitter cache workloads
redis distributed-systems lru tail-latency zipf performance-modeling cache-simulation phd-research systems-research
-
Updated
Apr 18, 2026 - HTML
Improve this page
Add a description, image, and links to the tail-latency topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the tail-latency topic, visit your repo's landing page and select "manage topics."