chore: retire testBench, switch to SpreadsheetBench#8
Merged
Conversation
…heetBench Removes the 53-file in-tree testBench corpus and switches all active docs, scripts, CI, and Makefile targets to point at SpreadsheetBench (downloaded on demand to data/corpora/, gitignored). Removed: testBench/, scripts/build_testbench.py, scripts/generate_enterprise_fixtures.py, tests/test_testbench_roundtrip.py, tests/test_enterprise_scoring.py, tests/test_real_world_datasets.py, tests/test_cross_validation.py, static_xlsx fixture, testbench CI job, testbench-* Makefile targets, testBench-vX.Y.Z.zip release asset. Updated: README, wiki, CONTRIBUTING, MAINTAINERS, RELEASE_PROCESS, corpora.md, issue + PR templates, site landing page, benchmark harness docs, examples (redirect output to examples/fixtures/), CHANGELOG. All 1041 tests pass.
arnav2
force-pushed
the
chore/retire-testBench
branch
from
4b65ee9 to
9573625
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Retires the in-tree
testBench/corpus (53 files) and switches all activedocs, scripts, CI, and Makefile targets to point at the public
SpreadsheetBench v0.1 corpus (5,458 real-world xlsx, downloaded on demand
to
data/corpora/, gitignored).What this PR removes
testBench/directory and all 53 bundled workbooksscripts/build_testbench.py,scripts/generate_enterprise_fixtures.pytests/test_testbench_roundtrip.py,tests/test_enterprise_scoring.py,tests/test_real_world_datasets.py,tests/test_cross_validation.pystatic_xlsxpytest fixturetestbenchCI job +testbench-*Makefile targetstestBench-vX.Y.Z.ziprelease asset inrelease.ymlWhat this PR updates
make bench-robust/bench-retrievaldocs/corpora.md: rewritten around SpreadsheetBenchCONTRIBUTING.md,docs/MAINTAINERS.md,docs/RELEASE_PROCESS.mdsite/index.htmllanding page (testBench section → SpreadsheetBench)examples/demo.py+examples/generate_examples.pynow useexamples/fixtures/instead of the removedtestBench/real_world/CHANGELOG.md: new Unreleased section flagging the breaking changeTest plan
make test→ 1041 passed, 11 deselected (~16s)testBench/links