Skip to content

Update medarc_verifiers to the latest version of verifiers (0.14.0)#131

Merged
warner-benjamin merged 53 commits into
mainfrom
major_refactor
May 12, 2026
Merged

Update medarc_verifiers to the latest version of verifiers (0.14.0)#131
warner-benjamin merged 53 commits into
mainfrom
major_refactor

Conversation

@warner-benjamin
Copy link
Copy Markdown
Collaborator

Summary

  • Replace the legacy YAML batch runner with a TOML-based medarc-eval bench workflow using deterministic eval output paths
  • Add bench subprocess/env lifecycle support, upstream Verifiers config adaptation, endpoint aliases, and sampling-arg handling
  • Update processing, docs, configs, and tests for the new runs/evals workflow, including legacy raw-run conversion

@warner-benjamin warner-benjamin merged commit 154710b into main May 12, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant