LLM benchmarks: run weekly LLM benchmarks from website-managed models#5324

Open

bradleyshep wants to merge 25 commits into

bradley/fix-validate-goldens-ci

Commits on Jun 19, 2026

updates

bradleyshep
authored and
JulienLavocat
committed
Update provider.rs

bradleyshep
authored and
JulienLavocat
committed
updates

bradleyshep
authored and
JulienLavocat
committed
preflight credit checks; workflow update to use web

bradleyshep
authored and
JulienLavocat
committed
weekly goldens; workflow refinements

bradleyshep
authored and
JulienLavocat
committed
Update publishers.rs

bradleyshep
authored and
JulienLavocat
committed
golden fixes

bradleyshep
authored and
JulienLavocat
committed
fixes

bradleyshep
authored and
JulienLavocat
committed
Update publishers.rs

bradleyshep
authored and
JulienLavocat
committed
updates

bradleyshep
authored and
JulienLavocat
committed
Update publishers.rs

bradleyshep
authored and
JulienLavocat
committed
fixes

bradleyshep
authored and
JulienLavocat
committed
Update publishers.rs

bradleyshep
authored and
JulienLavocat
committed
fixes

bradleyshep
authored and
JulienLavocat
committed
match smoketest (fingers crossed?)

bradleyshep
authored and
JulienLavocat
committed
fix

bradleyshep
authored and
JulienLavocat
committed
shrug

bradleyshep
authored and
JulienLavocat
committed
fix?

bradleyshep
authored and
JulienLavocat
committed
testing

bradleyshep
authored and
JulienLavocat
committed
test

bradleyshep
authored and
JulienLavocat
committed
Update llm-benchmark-periodic.yml

bradleyshep
authored and
JulienLavocat
committed
revert tests

bradleyshep
authored and
JulienLavocat
committed
preflight no error; vendor to openrouter in periodic

bradleyshep
authored and
JulienLavocat
committed
lints

bradleyshep
authored and
JulienLavocat
committed
Avoid .NET globalization crash in LLM benchmarks (#5335)

clockwork-labs-bot
authored and
JulienLavocat
committed