Skip to content

docs(evals): add model-judge calibration notes#30

Merged
aryeko merged 1 commit into
mainfrom
docs/model-judge-calibration-notes
Jul 4, 2026
Merged

docs(evals): add model-judge calibration notes#30
aryeko merged 1 commit into
mainfrom
docs/model-judge-calibration-notes

Conversation

@aryeko

@aryeko aryeko commented Jul 4, 2026

Copy link
Copy Markdown
Contributor

Summary

  • add curated technical-design pointwise model-judge calibration notes
  • state deterministic verdicts remain authoritative and model-judge evidence is manual/advisory
  • document that expected-bad false-pass calibration is deferred to Phase C4

Verification

  • pnpm install --frozen-lockfile
  • pnpm eval:doctor
  • pnpm eval:list
  • pnpm eval:validate-fixtures
  • pnpm eval:judge:doctor
  • pnpm eval:judge:list
  • pnpm eval:judge:validate-fixtures
  • pnpm check
  • git diff --check

No provider-backed evals were run. Raw evals/results bundles remain local/ignored.

@aryeko aryeko merged commit e3e8eb5 into main Jul 4, 2026
1 check passed
@aryeko aryeko deleted the docs/model-judge-calibration-notes branch July 4, 2026 03:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant