Skip to content

docs(evals): add model-judge calibration notes#17

Merged
aryeko merged 1 commit into
mainfrom
docs/model-judge-calibration-notes
Jul 4, 2026
Merged

docs(evals): add model-judge calibration notes#17
aryeko merged 1 commit into
mainfrom
docs/model-judge-calibration-notes

Conversation

@aryeko

@aryeko aryeko commented Jul 4, 2026

Copy link
Copy Markdown
Contributor

Summary

  • add curated define-product pointwise model-judge calibration notes
  • state deterministic verdicts remain authoritative and model-judge evidence is manual/advisory
  • record P0 good/bad calibration behavior without committing raw result bundles

Verification

  • pnpm install --frozen-lockfile
  • pnpm eval:doctor
  • pnpm eval:list
  • pnpm eval:validate-fixtures
  • pnpm eval:judge:doctor
  • pnpm eval:judge:list
  • pnpm eval:judge:validate-fixtures
  • pnpm check
  • git diff --check

No provider-backed evals were run. Raw evals/results bundles remain local/ignored.

@aryeko aryeko merged commit 292b409 into main Jul 4, 2026
1 check passed
@aryeko aryeko deleted the docs/model-judge-calibration-notes branch July 4, 2026 03:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant