Skip to content
@truefoundry

TrueFoundry

Build fast, secure and cost-efficient ML/LLM Apps

TrueFoundryTrueFoundry

TrueFoundry - Reduce time to value on Gen AI & ML initiatives

Twitter Follow Artifact Hub YouTube Slack Signup

What is TrueFoundry?

  • A low-latency enterprise AI Gateway with MCP server integrations, guardrails, observability, latency-based routing, model fallback, caching, quota and access control (on-premise, VPC or cloud).
  • A cloud-agnostic PaaS running on Kubernetes that standardizes AI applications development, deployment and observability using developer-friendly APIs. Plugs and play with your existing stack without vendor lock-in bringing state of the art industry standards.

Govern, Deploy, Scale & Trace Agentic AI in One Unified Platform

  • NEW 🔥 Free Sign Up - Sign Up for Free and Deploy on your cloud in under 10 minutes
  • AI Gateway - Enterprise-Ready AI Gateway for secure, high-performance proxy to 1000+ models with observability, governance, rate limits, budgets, guardrails, fallbacks, and load balancing.
  • NEW 🔥 MCP Gateway - Secure Access to MCP Servers and Agent Orchestration
  • NEW 🔥 Tracing - End-to-End Observability for AI Agents and Applications
  • AI Engineering - One platform to deploy services, jobs, notebooks, track experiments, train/serve models, and ship DAG workflows.
  • TrueFoundry SDK & CLI - Python/TypeScript SDKs & CLI for programmatic control
    • Track Experiments, register and versions models, artifacts and prompts
    • Deploy Services, Jobs, Notebooks, SSH Servers, Helm applications
    • Build and Deploy DAG workflows
    • Enable CI/CD for your deployments
    • Programmatically access TrueFoundry APIs
  • TrueFoundry Docs - Guides and API Reference for the platform

OpenSource

  • KubeElasti - Kubernetes-native scale-to-zero with zero traffic loss, no code changes, and direct integration with kubernetes resources
  • LLM Locust - LLM Locust combines the simplicity of Locust with deep support for LLM-specific benchmarking
  • Cognita - RAG Framework for Building Grounded Applications

Get in touch 💬

👉 Join our Slack community!

🐦 Follow the latest from TrueFoundry team on Twitter @truefoundry

Pinned Loading

  1. llm-locust llm-locust Public

    LLM Locust combines the simplicity of Locust with deep support for LLM-specific benchmarking

    TypeScript 30 11

  2. cognita cognita Public archive

    RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

    Python 4.4k 390

  3. infra-charts infra-charts Public

    Helm Repo for TrueFoundry Platform Charts

    Go Template 6 6

  4. truefoundry-python-sdk truefoundry-python-sdk Public

    TrueFoundry Python SDK for convenient interaction with TrueFoundry API.

    Python 1

  5. truefoundry-typescript-sdk truefoundry-typescript-sdk Public

    TrueFoundry Typescript SDK for convenient interaction with TrueFoundry API.

    TypeScript

  6. CruiseKube CruiseKube Public

    CruiseKube is an intelligent Kubernetes resource optimization controller that automatically monitors, analyzes, and applies resource recommendations to improve cluster efficiency and reduce costs.

    Go 80 6

Repositories

Showing 10 of 118 repositories

Top languages

Loading…

Most used topics

Loading…