feat: add GEditBench benchmark with task type subsets#518

Open

davidberenstein1957 wants to merge 12 commits intomainfrom

feat/add-geditbench-benchmark

Commits on Jan 22, 2026

feat: add benchmark support to PrunaDataModule and implement PartiPrompts benchmark
davidberenstein1957
committed

Commits on Jan 31, 2026

refactor: simplify benchmark system, extend PartiPrompts with subset filtering

davidberenstein1957
and
cursoragent
committed
fix: add Numpydoc parameter docs for BenchmarkInfo

davidberenstein1957
and
cursoragent
committed
feat: add benchmark discovery functions and expand benchmark registry

davidberenstein1957
and
cursoragent
committed
fix: use correct metric names from MetricRegistry

davidberenstein1957
and
cursoragent
committed
feat: add ImgEdit benchmark with edit type subsets

davidberenstein1957
and
cursoragent
committed
feat: add GEditBench benchmark with task type subsets

davidberenstein1957
and
cursoragent
committed
fix: rename subset to category for GEditBench + add empty guard + fix linting

davidberenstein1957
and
cursoragent
committed

Commits on Feb 2, 2026

Commits on Feb 20, 2026