pass-at-k

Here are 3 public repositories matching this topic...

sean-lamont / odd

Codebase for Orthogonal Diverse Diffusion. We present a lightweight, training free method for improving sampling diversity and Pass@k in Diffusion Language Models.

code-generation sampling problem-solving mathematical-reasoning reasoning-language-models diffusion-language-models pass-at-k

Updated Apr 23, 2026
Python

plaited / agent-eval-harness

Star

Evaluate AI agents with Unix-style pipeline commands. Schema-driven adapters for any CLI agent, trajectory capture, pass@k metrics, and multi-run comparison.

cli typescript grader ai-agents bun jsonl llm-evaluation agent-evaluation unix-pipeline agent-comparison trajectory-capture eval-harness pass-at-k headless-adapter

Updated Mar 11, 2026
TypeScript

eric-rolph / llm-benchmark

Star

Local-first reproducible LLM benchmark suite: 87 tasks, 16 scoring modes, multi-backend discovery, result diffs, and arena ELO artifacts.

model-evaluation llama-cpp vllm local-ai evals ollama lm-studio llm-judge llm-benchmark pass-at-k

Updated Apr 26, 2026
Python

Improve this page

Add a description, image, and links to the pass-at-k topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the pass-at-k topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly