Skip to content
@evalops

EvalOps

EvalOps is an AI testing and monitoring platform that helps engineering teams ship reliable AI features with confidence.
README.md

EvalOps

The organizational operating system for AI agent workforces — evaluation, governance, and observability for shipping accountable AI.

Platform Services

Discover repos by topic:

Key Repos

Repo Description
proto Canonical protobuf contracts across all services
service-runtime Shared Go runtime for platform services
deploy GitOps delivery: K8s manifests, Terraform, ArgoCD
console Fleet dashboard — mission control UI

Popular repositories Loading

  1. cognitive-dissonance-dspy cognitive-dissonance-dspy Public

    A multi-agent LLM system for detecting and resolving cognitive dissonance.

    Python 276 22

  2. dspy-0to1-guide dspy-0to1-guide Public

    A comprehensive 0-to-1 guide for building self-improving LLM applications with DSPy framework

    Python 211 15

  3. deep-code-reasoning-mcp deep-code-reasoning-mcp Public

    A Model Context Protocol (MCP) server that provides advanced code analysis and reasoning capabilities powered by Google's Gemini AI

    TypeScript 105 13

  4. dspy-micro-agent dspy-micro-agent Public

    Minimal agent runtime built with DSPy modules and a thin Python loop. Includes CLI, FastAPI server, and eval harness with OpenAI/Ollama support.

    Python 71 6

  5. dspy-advanced-prompting dspy-advanced-prompting Public

    State-of-the-art prompting techniques implementation with DSpy - Manager-style prompts, role personas, meta-prompting, and more

    Python 53 3

  6. orbit-agent orbit-agent Public

    A brutally honest "high‑orbit" startup advisor you can text or run from the CLI. Built with DSPy, it provides opinionated, YC-style advice and financial tools for founders.

    Python 20

Repositories

Showing 10 of 31 repositories
  • template-go-service Public template

    Template for new EvalOps Go microservices — service-runtime, proto, CI, GHCR publishing, CODEOWNERS

    evalops/template-go-service’s past year of commit activity
    Shell 0 0 0 0 Updated Apr 17, 2026
  • mcp-firewall Public

    A small MCP (Model Context Protocol) firewall that proxies JSON-RPC and enforces allow/deny policies for tools, resources, prompts, and methods

    evalops/mcp-firewall’s past year of commit activity
    Go 0 MIT 0 3 0 Updated Apr 17, 2026
  • service-runtime Public

    Shared Go runtime helpers for EvalOps services

    evalops/service-runtime’s past year of commit activity
    Go 0 0 16 0 Updated Apr 17, 2026
  • .github Public

    Org-level defaults: issue/PR templates, reusable workflows, community health files

    evalops/.github’s past year of commit activity
    0 0 3 0 Updated Apr 17, 2026
  • diffscope Public

    A composable code review engine for automated diff analysis

    evalops/diffscope’s past year of commit activity
    Rust 12 Apache-2.0 2 45 0 Updated Apr 16, 2026
  • maestro Public

    Maestro — multi-model coding agent with TUI, web, IDE, Slack, and GitHub interfaces

    evalops/maestro’s past year of commit activity
    TypeScript 0 0 1 0 Updated Apr 16, 2026
  • asb Public archive

    Agents-first secret broker control plane in Go

    evalops/asb’s past year of commit activity
    Go 0 Apache-2.0 0 14 0 Updated Apr 16, 2026
  • siphon Public archive

    Ingest SaaS webhooks and polls into NATS JetStream + ClickHouse. Signature verification, CloudEvents normalization, dead-letter replay.

    evalops/siphon’s past year of commit activity
    Go 0 Apache-2.0 0 3 0 Updated Apr 16, 2026
  • mcp-openapi Public

    OpenAPI 3.x to MCP server bridge in TypeScript with stdio, StreamableHTTP, and SSE transports

    evalops/mcp-openapi’s past year of commit activity
    TypeScript 2 MIT 0 0 1 Updated Apr 16, 2026
  • shared-memory-mcp Public

    Shared Memory MCP server for agentic teams - solving coordination tax with 6x token efficiency

    evalops/shared-memory-mcp’s past year of commit activity
    TypeScript 7 MIT 1 0 1 Updated Apr 16, 2026
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…