Small reliability layer for HTTP APIs and LLM calls. Idempotent HTTP/LLM proxy with retries, cache, circuit breaker and predictable AI costs.
python redis caching api-gateway reliability http-proxy prometheus self-hosted retry circuit-breaker idempotency fastapi budget-control llm-proxy llm-gateway api-reliability
-
Updated
Dec 4, 2025 - Python