Update parquet to v58.2.0

[renovate]

ℹ️ Note

This PR body was truncated due to platform limits.

This PR contains the following updates:

Package	Type	Update	Change	Pending
parquet	dependencies	minor	58.0.0 → 58.2.0	58.3.0
parquet_derive	dependencies	minor	58.0.0 → 58.2.0	58.3.0

---

Release Notes

apache/arrow-rs (parquet)

v58.2.0: arrow 58.2.0

Compare Source

Changelog

58.2.0 (2026-04-28)

Full Changelog

Implemented enhancements:

• Expose ColumnCloseResult on ArrowColumnChunk #​9774 [parquet]
• Expose FFI data structures fields #​9771 [arrow]
• short-circuit last predicate in RowFilter when with_limit(N) is set #​9765 [parquet]
• vectorise dict-index bounds check #​9747 [parquet]
• Refactor RleEncoder::flush_bit_packed_run #​9734 [parquet]
• Add benchmark for cast from/to decimals #​9728 [arrow]
• Add a security policy for arrow-rs #​9727 [parquet] [arrow] [arrow-flight]
• Support FixedSizeList in arrow-json reader #​9714 [arrow]
• [Variant] Add VariantArrayBuilder::append_nulls API #​9684
• [Json] RunEndEncoded decoder optimization #​9645 [arrow]
• [Variant] variant_get(..., List<_>) non-Struct types support #​9615
• [Variant] Add unshredded Struct fast-path for variant_get(..., Struct) #​9596
• Allow setting custom line terminator for CSV writer #​9571 [arrow]
• [Variant] Align cast logic for variant_get to cast kernel for numeric/bool types #​9564 [arrow]
• ci: use ubuntu-slim where applicable #​9536
• Publicly export arrow_string::Predicate and its methods? #​9480
• Don't create CompressionContext when no compression is selected [IPC] #​9463 [arrow]
• Parquet: Raw level buffering causes unbounded memory growth for sparse columns #​9446 [parquet]
• Parallel Parquet Reading #​9381 [parquet]

Fixed bugs:

• [Variant] unshred_variant panics on malformed bytes despite returning Result #​9740
• RecordBatch::normalize() does not propagate top level null bitmap into the results #​9732 [arrow]
• Incorrect accounting in DictEncoder::estimated_memory_size #​9719 [parquet]
• arrow-ipc writer does not comply with spec for empty variable-size arrays #​9716 [arrow]
• Panic when reading corrupt parquet file with truncated data instead of ParquetError #​9705 [parquet]
• NOTICE.txt is inaccurate #​9703 [arrow]
• Unnecessary dependency on regex crate #​9672
• [arrow-avro] Avro reader produces incorrect results when reader schema and writer schema differ #​9655 [arrow]
• parquet docs are broken on docs.rs #​9649
• [Parquet] ArrowWriter with CDC panics on nested ListArrays #​9637 [parquet] [arrow] [arrow-flight]
• Use release KEYS file for verification instead of dev KEYS #​9603
• IPC reader: handling of dictionaries with only null values #​9595 [arrow]
• Parquet RleDecoder::get_batch_with_dict panics on oob dictionary indices #​9434 [parquet]

Documentation updates:

• docs(variant): link VariantArray doc to official Parquet Variant extension type #​9779 (mcharrel)
• Document Security Policy #​9730 [parquet] [arrow] [arrow-flight] (alamb)
• Docs: add example of how to read parquet row groups in parallel #​9396 [parquet] (alamb)

Performance improvements:

• parquet: avoid decode and heap allocation on terminal skip in DeltaBitPackDecoder #​9784 [parquet]
• parquet: O(1) skip for bw=0 miniblocks in DeltaBitPackDecoder #​9783 [parquet]
• Remove per-message flush overhead in Arrow IPC writer #​9762 [arrow]
• Support GenericListViewArray::new_unchecked and refactor ListView json decoder #​9646 [arrow]
• Support nested REE in arrow-ord partition function #​9640 [arrow]
• [Parquet] Remove the BIT_PACKED encoder #​9635 [parquet]
• Pre-reserve output capacity in ByteView/ByteArray dictionary decoding #​9587 [parquet]
• Fuse RLE decoding and view gathering for StringView dictionary decoding #​9582 [parquet]
• Use branchless index clamping and add get_batch_direct to RleDecoder #​9581 [parquet]
• Reduce per-byte overhead in VLQ integer decoding #​9580 [parquet]
• feat(parquet): batch RLE runs in level encoder via scan-ahead #​9830 [parquet] (HippoBaro)
• fix: lazy-init zstd compression contexts to avoid unnecessary FFI calls #​9808 [arrow] (mbutrovich)
• parquet: O(1) skip for bw=0 miniblocks in DeltaBitPackDecoder #​9786 [parquet] (sahuagin)
• chore: add benchmark for row filters with LIMIT short-circuit #​9767 [parquet] (haohuaijin)
• Push LIMIT / OFFSET into the last RowFilter predicate and skip unused row groups #​9766 [parquet] (haohuaijin)
• feat(ipc): Remove per-message flush in IPC writer hot path #​9763 [arrow] (pchintar)
• perf(parquet): Defer fixed length byte array buffer alloc and skip zero-batch init #​9756 [parquet] (lyang24)
• feat(parquet): batch consecutive null/empty rows in write_list #​9752 [parquet] (HippoBaro)
• Remove len field from buffer builder #​9750 [arrow] (cetra3)
• perf(parquet): Vectorize dict-index bounds check in RleDecoder::get_batch_with_dict (up to -7.9%) #​9746 [parquet] (Dandandan)
• feat(parquet): precompute offset_index_disabled at build-time #​9724 [parquet] (HippoBaro)
• [Parquet] Improve dictionary decoder by unrolling loops #​9662 [parquet] (Dandandan)
• [Json] Use partition and take in RunEndEncoded decoder #​9658 [arrow] (liamzwbao)
• Improve take performance on List arrays #​9643 [arrow] (AdamGS)
• [Json] Replace ArrayData with typed Array construction in json-reader #​9497 [arrow] (liamzwbao)
• feat(parquet): stream-encode definition/repetition levels incrementally #​9447 [parquet] (HippoBaro)

Closed issues:

• Incorrect buffer skipping for V4 Union types in IPC skip_field #​9828 [arrow]
• Replace wildcard match in skip_field with explicit DataType handling #​9821 [arrow]
• Column projection misalignment for ListView / LargeListView in IPC reader #​9805 [arrow]
• Avoid panic on malformed compressed buffer prefix in IPC #​9801 [arrow]
• DeltaByteArrayDecoder panics on invalid prefix lengths #​9796 [parquet]
• Use NullBufferBuilder when reading json #​9781 [arrow]
• Perfectly shredded arrays with top-level null values loss nullability when typed_value is extracted #​9701
• [Parquet Metadata] API to determine page-index presence separately from page-index load #​9693
• Union cast is incorrect for duplicate field names #​9664 [arrow]
• List and ListView are missing take benchmarks #​9627 [arrow]
• Support RunEndEncoded arrays in comparison kernels (eq, lt, etc.) #​9620 [arrow]
• variant_get should follow JSONpath semantics #​9606
• GenericByteViewArray: support finding total length of all strings #​9435 [arrow]

Merged pull requests:

• support length() on Run-end encoding arrays #​9838 [arrow] (Rich-T-kid)
• fix(ipc): correct skip_field handling for V4 Union #​9829 [arrow] (pchintar)
• fix(ipc): replace wildcard in skip_field with explicit DataType handling #​9822 [arrow] (pchintar)
• Prevent buffer builder length overflow in MutableBuffer::extend_zeros #​9820 [arrow] (alamb)
• Prevent repeat slice length overflow #​9819 [arrow] (alamb)
• Prevent BitChunks length overflow #​9818 [arrow] (alamb)
• Prevent Rows row index overflow #​9817 [arrow] (alamb)
• Prevent ArrayData validation length overflow #​9816 [arrow] (alamb)
• [Json] Remove arrow-data dependency from arrow-json #​9812 [arrow] (liamzwbao)
• Replace BooleanBufferBuilder with NullBufferBuilder in arrow-json if applicable #​9811 [arrow] (liamzwbao)
• refactor(ipc): derive Default for CompressionContext #​9809 [arrow] (mbutrovich)
• fix(ipc): reader misalignment when skipping ListView / LargeListView columns #​9806 [arrow] (pchintar)
• fix(ipc): Avoid panic on malformed compressed buffer prefix #​9802 [arrow] (pchintar)
• parquet: fix panic in DeltaByteArrayDecoder on invalid prefix lengths #​9797 [parquet] (pchintar)
• feat(parquet): fuse level encoding with counting and histogram updates #​9795 [parquet] (HippoBaro)
• Expose ColumnCloseResult on ArrowColumnChunk #​9773 [parquet] (leoyvens)
• feat: make FFI structs fields pub #​9772 [arrow] (ashdnazg)
• chore: Refine the error message for List to non List cast #​9757 [arrow] (comphead)
• refactor(parquet): replace magic 8 literals with named constants #​9751 [parquet] (HippoBaro)
• feat(ipc): add with_skip_validation to StreamDecoder #​9749 [arrow] (pantShrey)
• remove panics in unshred variant #​9741 (friendlymatthew)
• Add benchmark for ListView interleave #​9738 [arrow] (vegarsti)
• arrow-arith: fix 'occured' -> 'occurred' in arity.rs comments #​9736 [arrow] (SAY-5)
• Refactor RleEncoder::flush_bit_packed_run to make flow clearer #​9735 [parquet] (etseidl)
• Fix RecordBatch::normalize() null bitmap bug and add StructArray::flatten() #​9733 [arrow] (sqd)
• Add benchmark for cast from/to decimals #​9729 [arrow] (klion26)
• refactor(arrow-avro): use Decoder::flush_block in async reader #​9726 [arrow] (mzabaluev)
• fix: ParquetError when reading corrupt parquet file with truncated data instead of Panic #​9725 [parquet] (xuzifu666)
• feat(parquet): add wide-schema writer overhead benchmark #​9723 [parquet] (HippoBaro)
• fix: correct accounting in DictEncoder::estimated_memory_size, Interner::estimated_memory_size #​9720 [parquet] (mzabaluev)
• arrow-ipc: Write 0 offset buffer for length-0 variable-size arrays #​9717 [arrow] (atwam)
• [Json] Support FixedSizeList in json decoder #​9715 [arrow] (liamzwbao)
• chore(deps): bump actions/upload-pages-artifact from 4 to 5 #​9713 (dependabot[bot])
• Fix clippy warning in fixed_size_binary_array.rs #​9712 [arrow] (AdamGS)
• feat: add has_non_empty_nulls helper function in OffsetBuffer #​9711 [arrow] (rluvaton)
• chore(deps): bump pytest from 7.2.0 to 9.0.3 in /parquet/pytest #​9706 [parquet] (dependabot[bot])
• Fedora license audit #​9704 [arrow] (michel-slm)
• [Variant] Take top-level nulls into consideration when extracting perfectly shredded children #​9702 (AdamGS)
• feat(parquet): add push_decoder benchmark for PushBuffers overhead #​9696 [parquet] (HippoBaro)
• Add mutable bitwise operations to BooleanArray and NullBuffer::union_many #​9692 [arrow] (mbutrovich)
• chore(deps): update hashbrown requirement from 0.16.0 to 0.17.0 #​9691 [parquet] [arrow] (dependabot[bot])
• chore(deps): bump actions/github-script from 8 to 9 #​9690 (dependabot[bot])
• minor: Re-enable CDC bench #​9686 [parquet] (etseidl)
• [Variant] Add VariantArrayBuilder::append_nulls API #​9685 (sdf-jkl)
• feat(parquet): add struct-column writer benchmarks #​9679 [parquet] (HippoBaro)
• [Arrow] Add API to check if Field has a valid ExtensionType #​9677 [parquet] [arrow] (sdf-jkl)
• [Variant] variant_get should follow JSONPath semantics for Field path element #​9676 (sdf-jkl)
• ParquetMetaDataPushDecoder API to clear all buffered ranges #​9673 [parquet] (nathanb9)
• Fix union cast incorrectness for duplicate field names #​9666 [arrow] (friendlymatthew)
• chore: re-export MAX_INLINE_VIEW_LEN from arrow_data #​9665 [arrow] (rluvaton)
• No longer allow BIT_PACKED level encoding in Parquet writer #​9656 [parquet] (etseidl)
• feat(parquet): add sparse-column writer benchmarks #​9654 [parquet] (HippoBaro)
• Support GenericListViewArray::new_unchecked and refactor ListView json decoder #​9648 [arrow] (liamzwbao)
• [Json] Add json reader benchmarks for ListView #​9647 [arrow] (liamzwbao)
• fix(parquet): fix CDC panic on nested ListArrays with null entries #​9644 [parquet] (kszucs)
• Add a test for reading nested REE data in json #​9634 [arrow] (alamb)
• [Variant] Fix variant_get to return List<T> instead of List<Struct> #​9631 (liamzwbao)
• ci: use ubuntu-slim runner for lightweight CI jobs #​9630 (CuteChuanChuan)
• Add bloom filter folding to automatically size SBBF filters #​9628 [parquet] (adriangb)
• Add List and ListView take benchmarks #​9626 [arrow] (AdamGS)
• ParquetPushDecoder API to clear all buffered ranges #​9624 [parquet] (nathanb9)
• fix: handle missing dictionary batch for null-only columns in IPC reader #​9623 [arrow] (joaquinhuigomez)
• Fix MutableBuffer::clear #​9622 [parquet] [arrow] (Rafferty97)
• feat[arrow-ord]: suppport REE comparisons #​9621 [arrow] (asubiotto)
• chore(deps): update sha2 requirement from 0.10 to 0.11 #​9618 [arrow] (dependabot[bot])
• Expose option to set line terminator for CSV writer #​9617 [arrow] (svranesevic)
• [Json] Add json reader benchmarks for Map and REE #​9616 [arrow] (liamzwbao)
• deps: fix object_store breakage for 0.13.2 #​9612 (mzabaluev-flarion)
• [Variant] Support Binary/LargeBinary children #​9610 (AdamGS)
• fix: use writer types in Skipper for resolved named record types #​9605 [arrow] (ariel-miculas)
• feat(parquet): derive PartialEq and Eq for CdcOptions #​9602 [parquet] (kszucs)
• Add finish_preserve_values to ArrayBuilder trait #​9601 [arrow] (adamreichold)
• [Variant] extend shredded null handling for arrays #​9599 (sdf-jkl)
• [Variant] Add unshredded Struct fast-path for variant_get(..., Struct) #​9597 (sdf-jkl)
• Pre-reserve output capacity in ByteView/ByteArray dictionary decoding #​9590 [parquet] (Dandandan)
• [Variant] Align cast logic for variant_get to cast kernel for numeric/bool types #​9563 [arrow] (klion26)
• Add support to cast from UnionArray #​9544 [arrow] (friendlymatthew)
• Support ListView codec in arrow-json #​9503 [arrow] (liamzwbao)

* This Changelog was automatically generated by github_changelog_generator

v58.1.0: arrow 58.1.0

Compare Source

Changelog

58.1.0 (2026-03-20)

Full Changelog

Implemented enhancements:

• Reuse compression dict lz4_block #​9566
• [Variant] Add variant_to_arrow Struct type support #​9529
• [Variant] Add unshred_variant support for Binary and LargeBinary types #​9526
• [Variant] Add shred_variant support for LargeUtf8 and LargeBinary types #​9525
• [Variant] variant_get tests clean up #​9517
• parquet_variant: Support LargeUtf8 typed value in unshred_variant #​9513
• parquet-variant: Support string view typed value in unshred_variant #​9512
• Deprecate ArrowTimestampType::make_value in favor of from_naive_datetime #​9490 [arrow]
• Followup for support ['fieldName'] in VariantPath #​9478
• Speedup DELTA_BINARY_PACKED decoding when bitwidth is 0 #​9476 [parquet]
• Support CSV files encoded with charsets other than UTF-8 #​9465 [arrow]
• Expose Avro writer schema when building the reader #​9460 [arrow]
• Python: avoid importing pyarrow classes ever time #​9438
• Add append_nulls to MapBuilder #​9431 [arrow]
• Add append_non_nulls to StructBuilder #​9429 [arrow]
• Add append_value_n to GenericByteBuilder #​9425 [arrow]
• Optimize from_bitwise_binary_op #​9378 [arrow]
• Configurable Arrow representation of UTC timestamps for Avro reader #​9279 [arrow]

Fixed bugs:

• MutableArrayData::extend does not copy child values for ListView arrays #​9561 [arrow]
• ListView interleave bug #​9559 [arrow]
• Flight encoding panics with "no dict id for field" with nested dict arrays #​9555 [arrow] [arrow-flight]
• "DeltaBitPackDecoder only supports Int32Type and Int64Type" but unsigned types are supported too #​9551 [parquet]
• Potential overflow when calling util::bit_mask::set_bits (soundness issue) #​9543 [arrow]
• handle Null type in try_merge for Struct, List, LargeList, and Union #​9523 [arrow]
• Invalid offset in sparse column chunk data for multiple predicates #​9516 [parquet]
• debug_assert_eq! in BatchCoalescer panics in debug mode when batch_size < 4 #​9506 [arrow]
• Parquet Statistics::null_count_opt wrongly returns Some(0) when stats are missing #​9451 [parquet]
• Error "Not all children array length are the same!" when decoding rows spanning across page boundaries in parquet file when using RowSelection #​9370 [parquet]
• Avro schema resolution not properly supported for complex types #​9336 [arrow]

Documentation updates:

• Update planned release schedule in README.md #​9466 (alamb)

Performance improvements:

• Introduce NullBuffer::try_from_unsliced to simplify array construction #​9385 [parquet] [arrow]
• perf: Coalesce page fetches when RowSelection selects all rows #​9578 [parquet] (Dandandan)
• Use chunks_exact for has_true/has_false to enable compiler unrolling #​9570 [arrow] (adriangb)
• pyarrow: Cache the imported classes to avoid importing them each time #​9439 (Tpt)

Closed issues:

• Duplicate macro definition: partially_shredded_variant_array_gen #​9492
• Enable LargeList / ListView / LargeListView for VariantArray::try_new #​9455
• Support variables/expressions in record_batch! macro #​9245 [arrow]

Merged pull requests:

• [Variant] Add unshred_variant support for Binary and LargeBinary types #​9576 (kunalsinghdadhwal)
• [Variant] Add variant_to_arrow Struct type support #​9572 (sdf-jkl)
• Make Sbbf Constructers Public #​9569 [parquet] (cetra3)
• fix: Used checked_add for bounds checks to avoid UB #​9568 [arrow] (etseidl)
• Add mutable operations to BooleanBuffer (Bit*Assign) #​9567 [arrow] (Dandandan)
• chore(deps): update lz4_flex requirement from 0.12 to 0.13 #​9565 [parquet] [arrow] (dependabot[bot])
• arrow-select: fix MutableArrayData interleave for ListView #​9560 [arrow] (asubiotto)
• Move ValueIter into own module, and add public record_count function #​9557 [arrow] (Rafferty97)
• arrow-flight: generate dict_ids for dicts nested inside complex types #​9556 [arrow] [arrow-flight] (asubiotto)
• add shred_variant support for LargeUtf8 and LargeBinary #​9554 (sdf-jkl)
• [minor] Download clickbench file when missing #​9553 [parquet] (Dandandan)
• DeltaBitPackEncoderConversion: Fix panic message on invalid type #​9552 [parquet] (progval)
• Replace interleave overflow panic with error #​9549 [arrow] (xudong963)
• feat(arrow-avro): HeaderInfo to expose OCF header #​9548 [arrow] (mzabaluev)
• chore: Protect main branch with required reviews #​9547 (comphead)
• Add benchmark for infer_json_schema #​9546 [arrow] (Rafferty97)
• chore(deps): bump black from 24.3.0 to 26.3.1 in /parquet/pytest #​9545 [parquet] (dependabot[bot])
• Unroll interleave -25-30% #​9542 [arrow] (Dandandan)
• Optimize take_fixed_size_binary For Predefined Value Lengths #​9535 [arrow] (tobixdev)
• feat: expose arrow schema on async avro reader #​9534 [arrow] (mzabaluev)
• Make with_file_decryption_properties pub instead of pub(crate) #​9532 [parquet] (Dandandan)
• fix: handle Null type in try_merge for Struct, List, LargeList, and Union #​9524 [arrow] (zhuqi-lucas)
• chore: extend record_batch macro to support variables and expressions #​9522 [arrow] (buraksenn)
• [Variant] clean up variant_get tests #​9518 (sdf-jkl)
• support large string for unshred variant #​9515 (friendlymatthew)
• support string view unshred variant #​9514 (friendlymatthew)
• Add has_true() and has_false() to BooleanArray #​9511 [arrow] (adriangb)
• Fix Invalid offset in sparse column chunk data error for multiple predicates #​9509 [parquet] (cetra3)
• fix: remove incorrect debug assertion in BatchCoalescer #​9508 [arrow] (Tim-53)
• [Json] Add benchmarks for list json reader #​9507 [arrow] (liamzwbao)
• fix: first next_back() on new RowsIter panics #​9505 [arrow] (rluvaton)
• Add some benchmarks for decoding delta encoded Parquet #​9500 [parquet] (etseidl)
• chore: remove duplicate macro partially_shredded_variant_array_gen #​9498 (codephage2020)
• Deprecate ArrowTimestampType::make_value in favor of from_naive_datetime #​9491 [arrow] (codephage2020)
• fix: Do not assume missing nullcount stat means zero nullcount #​9481 [parquet] (scovich)
• [Variant] Enahcne bracket access for VariantPath #​9479 (klion26)
• Optimize delta binary decoder in the case where bitwidth=0 #​9477 [parquet] (etseidl)
• Add PrimitiveRunBuilder::with_data_type() to customize the values' DataType #​9473 [arrow] (brunal)
• Convert prettyprint tests in arrow-cast to insta inline snapshots #​9472 [parquet] [arrow] (grtlr)
• Update strum_macros requirement from 0.27 to 0.28 #​9471 [arrow] (dependabot[bot])
• docs(parquet): Fix broken links in README #​9467 [parquet] (SYaoJun)
• Add list-like types support to VariantArray::try_new #​9457 (sdf-jkl)
• Simplify downcast_...!() macro definitions #​9454 [arrow] (brunal)
• feat(parquet): add content defined chunking for arrow writer #​9450 [parquet] (kszucs)
• refactor: simplify iterator using cloned().map(Some) #​9449 [parquet] (SYaoJun)
• feat: Optimize from_bitwise_binary_op with 64-bit alignment #​9441 [arrow] (kunalsinghdadhwal)
• docs: fix markdown link syntax in README #​9440 (SYaoJun)
• Move ListLikeArray to arrow-array to be shared with json writer and parquet unshredding #​9437 [arrow] (liamzwbao)
• Add claim method to recordbatch for memory accounting #​9433 [arrow] (cetra3)
• Add append_nulls to MapBuilder [#​9432](https://redirect.github.com/apa

✂ Note

PR body was truncated to here.

---

Configuration

📅 Schedule: (in timezone America/Detroit)

• Branch creation
  • Only on Monday (* * * * 1)
• Automerge
  • At any time (no schedule defined)

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about these updates again.

---

• If you want to rebase/retry this PR, check this box

---

This PR was generated by Mend Renovate. View the repository job log.