Review all existing tests
We like tests but we like tests too much. We have 2,454 tests (see #348 for reference).
Your job: Review the entire test suite and tell us what's redundant, duplicate, unnecessarily time-consuming, or just plain wasteful.
What we want:
A response with:
Summary of findings (what's bloated, what's redundant, what's slow)
Specific examples of problematic tests with reasoning
A plan for reducing test count while maintaining coverage
Estimated time/cost savings
No code changes. Just analysis and recommendations.
Tools:
Check .github/workflows/ to understand the CI testing structure (60 test matrix jobs across 5 directories, 4 rank configs, 3 install methods)
Use gh CLI to check CI run times and patterns from recent PRs (start with Fix DMA-BUF Export/Import with PyTorch Caching Allocator Offsets #348
Look at test execution logs for timing data
Dig through the test code in tests/
Give us specific recommendations with reasoning. No handwaving - we need actionable insights.
Review all existing tests
We like tests but we like tests too much. We have 2,454 tests (see #348 for reference).
Your job: Review the entire test suite and tell us what's redundant, duplicate, unnecessarily time-consuming, or just plain wasteful.
What we want:
A response with:
No code changes. Just analysis and recommendations.
Tools:
.github/workflows/to understand the CI testing structure (60 test matrix jobs across 5 directories, 4 rank configs, 3 install methods)ghCLI to check CI run times and patterns from recent PRs (start with Fix DMA-BUF Export/Import with PyTorch Caching Allocator Offsets #348)tests/Give us specific recommendations with reasoning. No handwaving - we need actionable insights.