feat: Add support for IPC stream format shuffle files (native shuffle) [experimental]#3837

Closed

andygrove wants to merge 24 commits intoapache:mainfrom

andygrove:ipc-stream-shuffle-writer

Commits on Mar 21, 2026

feat: add standalone shuffle benchmark binary for profiling
andygrove
committed
feat: add --limit option to shuffle benchmark (default 1M rows)
andygrove
committed
perf: apply limit during parquet read to avoid scanning all files
andygrove
committed

Commits on Mar 23, 2026

Commits on Mar 26, 2026

Commits on Mar 27, 2026

Commits on Mar 28, 2026

feat: add --concurrent-tasks flag to shuffle benchmark
andygrove
committed

Commits on Mar 29, 2026