Skip to content

Update leaderboard — 1 model, 1 verified bug (2026-07-06)#29

Closed
github-actions[bot] wants to merge 1 commit into
mainfrom
bot/leaderboard-28768356427
Closed

Update leaderboard — 1 model, 1 verified bug (2026-07-06)#29
github-actions[bot] wants to merge 1 commit into
mainfrom
bot/leaderboard-28768356427

Conversation

@github-actions

@github-actions github-actions Bot commented Jul 6, 2026

Copy link
Copy Markdown
Contributor

Automated refresh of site/results.json from newly scored R2 submissions. Certificates stay private in R2; only aggregate counts (no rules/certs) change here. Merging deploys the site via publish-on-merge.

@isPANN isPANN changed the title leaderboard: refresh aggregate Update leaderboard — 1 model, 1 verified bug (2026-07-06) Jul 6, 2026
@isPANN

isPANN commented Jul 6, 2026

Copy link
Copy Markdown
Collaborator

Closing unmerged: this entry came from an end-to-end TEST submission (fixture genuine_bug_weighted_mis with fabricated cost/token numbers), not a real run. Test data must not be published to the production leaderboard. Follow-up: add a test marker so test submissions are excluded from the public aggregate.

@isPANN isPANN closed this Jul 6, 2026
@isPANN isPANN deleted the bot/leaderboard-28768356427 branch July 6, 2026 04:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant