feat: add immediate-mode shuffle partitioner [experimental]#3838

Closed

andygrove wants to merge 21 commits intoapache:mainfrom

andygrove:immediate-shuffle

Commits on Mar 21, 2026

feat: add standalone shuffle benchmark binary for profiling
andygrove
committed
feat: add --limit option to shuffle benchmark (default 1M rows)
andygrove
committed
perf: apply limit during parquet read to avoid scanning all files
andygrove
committed

Commits on Mar 23, 2026

Commits on Mar 26, 2026

Merge remote-tracking branch 'apache/main' into shuffle-bench-binary
andygrove
committed
perf: add max_buffered_batches config and stream shuffle bench from parquet
andygrove
committed

Commits on Mar 27, 2026

Commits on Mar 28, 2026

Commits on Mar 29, 2026

perf: single take() + zero-copy slice() instead of per-partition take()
andygrove
committed