Skip to content

chore(evals): align model judge scripts#11

Merged
aryeko merged 1 commit into
mainfrom
standard-model-judge-configs
Jul 3, 2026
Merged

chore(evals): align model judge scripts#11
aryeko merged 1 commit into
mainfrom
standard-model-judge-configs

Conversation

@aryeko

@aryeko aryeko commented Jul 3, 2026

Copy link
Copy Markdown
Contributor

Summary

  • pin eval-kit to v0.1.3
  • add standard eval:judge:doctor, eval:judge:list, and eval:judge:validate-fixtures helper scripts
  • update model-judge docs to reference the two-config standard and a non-policy account-supported model example

Verification

  • pnpm install
  • pnpm format
  • pnpm eval:doctor
  • pnpm eval:list
  • pnpm eval:validate-fixtures
  • pnpm eval:judge:doctor
  • pnpm eval:judge:list
  • pnpm eval:judge:validate-fixtures
  • pnpm check
  • git diff --check

Did not run eval:judge:coverage or provider/model calls.

@aryeko

aryeko commented Jul 3, 2026

Copy link
Copy Markdown
Contributor Author

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Hooray!

Reviewed commit: 8ec9189cbe

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@aryeko aryeko merged commit d11025e into main Jul 3, 2026
1 check passed
@aryeko aryeko deleted the standard-model-judge-configs branch July 3, 2026 23:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant