fix: improve memory accounting in shuffle write [WIP]#3824

Closed

andygrove wants to merge 13 commits intoapache:mainfrom

andygrove:double-count-memory

Commits on Mar 21, 2026

feat: add standalone shuffle benchmark binary for profiling
andygrove
committed
feat: add --limit option to shuffle benchmark (default 1M rows)
andygrove
committed
perf: apply limit during parquet read to avoid scanning all files
andygrove
committed

Commits on Mar 23, 2026

Commits on Mar 26, 2026

Merge remote-tracking branch 'apache/main' into shuffle-bench-binary
andygrove
committed
perf: add max_buffered_batches config and stream shuffle bench from parquet
andygrove
committed

Commits on Mar 30, 2026

fix: reduce memory multiplier to 1.5x and free reservation after shuffle write
andygrove
committed