It would be useful to have a writer API that allowed us to write out one table slice at a time, so we could stream batches of rows to the writer instead of all at once (similar to row group writer in the Rust Parquet API). For now everything is held in-memory which will work fine until we work with much larger sbdf files.
It would be useful to have a writer API that allowed us to write out one table slice at a time, so we could stream batches of rows to the writer instead of all at once (similar to row group writer in the Rust Parquet API). For now everything is held in-memory which will work fine until we work with much larger sbdf files.