Description
Add the bench top-level subcommand to the main zeph CLI using clap, gated on the bench feature.
Part of epic #2827. See spec: .local/specs/zeph-bench/spec.md section 9.
Scope
zeph bench list — print table of supported datasets with cache status
zeph bench download --dataset <name> — download and cache a dataset
zeph bench run --dataset <name> --output <path> [--scenario <id>] [--provider <name>] [--baseline] [--resume] [--no-deterministic] — run a benchmark
zeph bench show --results <path> — pretty-print a results.json file
DatasetRegistry struct listing the 5 supported datasets with metadata
- Progress reporting to stderr (scenario N/M, current score)
- Exit code 1 on unknown dataset name or missing dataset cache
Acceptance Criteria
Description
Add the
benchtop-level subcommand to the mainzephCLI using clap, gated on thebenchfeature.Part of epic #2827. See spec:
.local/specs/zeph-bench/spec.mdsection 9.Scope
zeph bench list— print table of supported datasets with cache statuszeph bench download --dataset <name>— download and cache a datasetzeph bench run --dataset <name> --output <path> [--scenario <id>] [--provider <name>] [--baseline] [--resume] [--no-deterministic]— run a benchmarkzeph bench show --results <path>— pretty-print a results.json fileDatasetRegistrystruct listing the 5 supported datasets with metadataAcceptance Criteria
zeph bench listprints all 5 dataset nameszeph bench run --dataset unknownexits 1 with helpful messagezeph bench runwithout--downloadwhen dataset not cached exits 1 with instructionbenchfeature gates the subcommand at compile time