Skip to content

Pull requests: eval-protocol/python-sdk

New pull request New
38 Open 399 Closed
38 Open 399 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Harden /evaluate error handling and remove mutable kwargs default
#438 opened Mar 20, 2026 by bezzchen Loading…
4
fix: resolve argparse conflict for --credentials-secret in nested configs
#437 opened Mar 16, 2026 by heathriel Loading…
Fix argparse conflict for duplicate TypedDict field short aliases
#433 opened Mar 9, 2026 by wirjo Loading…
4 tasks done
temp hot fix
#423 opened Jan 26, 2026 by xzrderek Loading…
2
Fix bug in preprocess_fn codepath
#420 opened Jan 24, 2026 by RNHTTR • Draft
Add IFEval
#414 opened Jan 16, 2026 by SandyYuan Loading…
13
perf: Add server-side filtering for ep logs to improve performance
#408 opened Jan 11, 2026 by benjibc Loading…
4
Verify Fireworks API key once for CLI flows codex
#407 opened Jan 10, 2026 by benjibc Loading…
Record rollout start time and show rollout latency in UI codex
#398 opened Jan 7, 2026 by benjibc Loading…
2
enforce single evaluator upload per command
#387 opened Dec 24, 2025 by benjibc Loading…
3
updated tests
#382 opened Dec 18, 2025 by shreymodi1 Loading…
1
support extra headers
#373 opened Dec 15, 2025 by benjibc Loading…
4
warn if large datasets + force 1 run
#365 opened Dec 12, 2025 by xzrderek Loading…
Shrey/modelquality
#353 opened Dec 2, 2025 by shreymodi1 Loading…
18 tasks
1
support for tokenids logprobs
#350 opened Nov 26, 2025 by shreymodi1 Loading…
18 tasks
calibration evaluator
#345 opened Nov 24, 2025 by benjibc • Draft
18 tasks
adding response quality validation for retry
#344 opened Nov 24, 2025 by morgendave Loading…
10 tasks
6
tests fix
#341 opened Nov 21, 2025 by shreymodi1 Loading…
18 tasks
5
Shrey/trl
#335 opened Nov 17, 2025 by shreymodi1 Loading…
18 tasks
1
Update Klavis MCP use case
#330 opened Nov 14, 2025 by LLiuZheng Loading…
1
Text to SQL RFT example
#324 opened Nov 10, 2025 by benjibc Loading…
6
swe-bench
#280 opened Oct 15, 2025 by shreymodi1 Loading…
42
reasoning effort string change
#267 opened Oct 10, 2025 by shreymodi1 Loading…
18 tasks
1
reuse pydantic example for local model picking
#251 opened Oct 5, 2025 by benjibc Loading…
pyyaml removal step 1
#247 opened Oct 3, 2025 by benjibc Loading…
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.