Skip to content

Pull requests: vercel-labs/agent-eval

New pull request New
14 Open 142 Closed
14 Open 142 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: codex transciprt fallback in runner
#169 opened Jul 1, 2026 by huang-julien Loading…
fix(agent-eval): provide type augmentation for agent-eval/eval
#166 opened Jun 30, 2026 by huang-julien Loading…
fix(agent-eval): delegate demultiplexing to docker-modem's docker demuxStream()
#158 opened Jun 26, 2026 by huang-julien Loading…
[Agents] Add Mistral Vibe CLI agent with direct API and streaming-json transcript support
#137 opened May 21, 2026 by joeyspagnoli Loading…
1
2
feat: add max turns run budget
#135 opened May 15, 2026 by EfeDurmaz16 Loading…
1
fix(results): discover nested eval result dirs
#133 opened May 15, 2026 by EfeDurmaz16 Loading…
1
feat: add experiment trend analyzer
#132 opened May 14, 2026 by EfeDurmaz16 Loading…
1
fix: discover nested eval result directories
#131 opened May 14, 2026 by EfeDurmaz16 Loading…
1
feat: improve names of Docker sandbox containers
#128 opened May 8, 2026 by jonahsnider Loading…
fix: clean up Docker sandbox containers on exit
#127 opened May 8, 2026 by jonahsnider Loading…
Skip npm install when package.json is absent
#125 opened May 6, 2026 by allenzhou101 Contributor Loading…
[wip] add bub agent support
#91 opened Mar 7, 2026 by CorrectRoadH • Draft
Add timings for phases
#88 opened Feb 25, 2026 by jeffsee55 Loading…
Add ability to choose which eval --smoke runs
#84 opened Feb 20, 2026 by jeffsee55 Loading…
ProTip! Mix and match filters to narrow down what you’re looking for.