Skip to content

fix(deps): update arrow-rs to v57 (major)#5482

Open
renovate[bot] wants to merge 1 commit intodevelopfrom
renovate/major-57-arrow-rs
Open

fix(deps): update arrow-rs to v57 (major)#5482
renovate[bot] wants to merge 1 commit intodevelopfrom
renovate/major-57-arrow-rs

Conversation

@renovate
Copy link
Contributor

@renovate renovate bot commented Nov 24, 2025

ℹ️ Note

This PR body was truncated due to platform limits.

This PR contains the following updates:

Package Type Update Change
arrow-cast dependencies major 5657
parquet dependencies major 5657

Release Notes

apache/arrow-rs (arrow-cast)

v57.2.0

Compare Source

Full Changelog

Breaking changes:

Implemented enhancements:

  • [parquet] further relax LevelInfoBuilder::types_compatible for ArrowWriter #​9098
  • Update arrow-row documentation with Union encoding #​9084
  • Add code examples for min and max compute functions #​9055
  • Add append_n to bytes view builder API #​9034 [arrow]
  • Move RunArray::get_physical_indices to RunEndBuffer #​9025 [arrow]
  • Allow quote style in csv writer #​9003 [arrow]
  • IPC support for ListView #​9002 [arrow]
  • Implement BinaryArrayType for &FixedSizeBinaryArrays #​8992 [arrow]
  • arrow-buffer: implement num-traits for i256 #​8976 [arrow]
  • Support for Arc<str> in ParquetRecordWriter derive macro #​8972
  • [arrow-avro] suggest switching from xz to liblzma #​8970 [arrow]
  • arrow-buffer: add i256::trailing_zeros #​8968 [arrow]
  • arrow-buffer: make i256::leading_zeros public #​8965 [arrow]
  • Add spark like ignoreLeadingWhiteSpace and ignoreTrailingWhiteSpace options to the csv writer #​8961 [arrow]
  • Add round trip benchmark for Parquet writer/reader #​8955 [parquet]
  • Support performant interleave for List/LargeList #​8952 [arrow]
  • [Variant] Support array access when parsing VariantPath #​8946
  • Some panic!s could be represented as unimplemented!s #​8932 [arrow]
  • [Variant] easier way to construct a shredded schema #​8922
  • Support DataType::ListView and DataType::LargeListView in ArrayData::new_null #​8908 [arrow]
  • Add GenericListViewArray::from_iter_primitive #​8906 [arrow]
  • [Variant] Unify the cast option usage in ParquentVariant #​8873
  • Blog post about efficient filter representation in Parquet filter pushdown #​8843 [parquet]
  • Add comparison support for Union arrays in the cmp kernel #​8837 [arrow]
  • [Variant] Support array shredding into List/LargeList/ListView/LargeListView #​8830
  • Support Union data types for row format #​8828 [arrow]
  • FFI support for ListView #​8819 [arrow]
  • [Variant] Support more Arrow Datatypes from Variant primitive types #​8805
  • FixedSizeBinaryBuilder supports append_array #​8750 [arrow]
  • Implement special case zip with scalar for Utf8View #​8724 [arrow]
  • [geometry] Wire up arrow reader/writer for GEOMETRY and GEOGRAPHY #​8717 [parquet]

Fixed bugs:

  • Soundness Bug in try_binary when Array is implemented incorrectly in external crate #​9106
  • casting Dict(_, LargeUtf8) to Utf8View (StringViewArray) panics #​9101
  • wrong results for null count of nullif kernel #​9085 [parquet] [arrow]
  • Empty first line in some code examples #​9063
  • GenericByteViewArray::slice is not zero-copy but ought to be #​9014
  • Regression in struct casting in 57.2.0 (not yet released) #​9005 [arrow]
  • Fix panic when decoding multiple Union columns in RowConverter #​8999 [arrow]
  • take_fixed_size_binary Does Not Consider NULL Indices #​8947 [arrow]
  • [arrow-avro] RecordEncoder Bugs #​8934 [arrow]
  • FixedSizeBinaryArray::try_new(...) Panics with Item Length of Zero #​8926 [arrow]
  • cargo test -p arrow-cast fails on main #​8910 [arrow]
  • GenericListViewArray::new_null ignores len and returns an empty array #​8904 [arrow]
  • FixedSizeBinaryArray::new_null Does Not Properly Set the Length of the Values Buffer #​8900 [arrow]
  • Struct casting requires same order of fields #​8870 [arrow]
  • Cannot cast string dictionary to binary view #​8841 [arrow]

Documentation updates:

Performance improvements:

Closed issues:

Merged pull requests:

* This Changelog was automatically generated by github_changelog_generator

v57.1.0: arrow 57.1.0

Compare Source

Changelog
57.1.0 (2025-11-20)

Full Changelog

Implemented enhancements:

  • Eliminate bound checks in filter kernels #​8865 [arrow]
  • Respect page index policy option for ParquetObjectReader when it's not skip #​8856 [parquet]
  • Speed up collect_bool and remove unsafe #​8848 [arrow]
  • Error reading parquet FileMetaData with empty lists encoded as element-type=0 #​8826 [parquet]
  • ValueStatistics methods can't be used from generic context in external crate #​8823 [parquet]
  • Custom Pretty-Printing Implementation for Column when Formatting Record Batches #​8821 [arrow]
  • Parquet-concat: supports bloom filter and page index #​8804 [parquet]
  • [Parquet] virtual row group number support #​8800
  • [Variant] Enforce shredded-type validation in shred_variant #​8795 [arrow]
  • Simplify decision logic to call FilterBuilder::optimize or not #​8781 [arrow]
  • [Variant] Add variant to arrow for DataType::{Binary, LargeBinary, BinaryView} #​8767 [arrow]
  • Provide algorithm that allows zipping arrays whose values are not prealigned #​8752 [arrow]
  • [Parquet] ParquetMetadataReader decodes too much metadata under point-get scenerio #​8751 [parquet]
  • arrow-json supports encoding binary arrays, but not decoding #​8736 [arrow]
  • Allow FilterPredicate instances to be reused for RecordBatches #​8692 [arrow]
  • ArrowJsonBatch::from_batch is incomplete #​8684 [arrow]
  • parquet-layout: More info about layout including footer size, page index, bloom filter? #​8682 [parquet]
  • Rewrite ParquetRecordBatchStream (async API) in terms of the PushDecoder #​8677 [parquet]
  • [JSON] Add encoding for binary view #​8674 [arrow]
  • Refactor arrow-cast decimal casting to unify the rescale logic used in Parquet variant casts #​8670 [arrow]
  • [Variant] Support Uuid/FixedSizeBinary(16) shredding #​8665
  • [Parquet]There should be an encoding counter to know how many encodings the repo supports in total #​8662 [parquet]
  • Improve parse_data_type for List, ListView, LargeList, LargeListView, FixedSizeList, Union, Map, RunEndCoded. #​8648 [arrow]
  • [Variant] Support variant to arrow primitive support null/time/decimal_* #​8637
  • Return error from RleDecoder::reset rather than panic #​8632 [parquet]
  • Add bitwise ops on BooleanBufferBuilder and MutableBuffer that mutate directly the buffer #​8618 [arrow]
  • [Variant] Add variant_to_arrow Utf-8, LargeUtf8, Utf8View types support #​8567 [arrow]

Fixed bugs:

  • Regression: Parsing List(Int64) results in nullable list in 57.0.0 and a non-nullable list in 57.1.0 #​8883
  • Regression: FixedSlizeList data type parsing fails on 57.1.0 #​8880
  • (dyn ArrayFormatterFactory + 'static) can't be safely shared between threads #​8875
  • RowNumber reader has wrong row group ordering #​8864 [parquet]
  • ThriftMetadataWriter::write_column_indexes cannot handle a ColumnIndexMetaData::NONE #​8815 [parquet]
  • "Archery test With other arrows" Integration test failing on main: #​8813 [arrow]
  • [Parquet] Writing in 57.0.0 seems 10% slower than 56.0.0 #​8783 [parquet]
  • Parquet reader cannot handle files with unknown logical types #​8776 [parquet]
  • zip now treats nulls as false in provided mask regardless of the underlying bit value #​8721 [arrow]
  • [avro] Incorrect version in crate.io landing page #​8691 [arrow]
  • Array: ViewType gc() has bug when array sum length exceed i32::MAX #​8681 [arrow]
  • Parquet 56: encounter error: item_reader def levels are None when reading nested field with row filter #​8657 [parquet]
  • Degnerate and non-nullable FixedSizeListArrays are not handled #​8623 [arrow]
  • [Parquet]Performance Degradation with RowFilter on Unsorted Columns due to Fragmented ReadPlan #​8565 [parquet]

Documentation updates:

Performance improvements:

Closed issues:

  • Variant to NullType conversion ignores strict casting #​8810
  • Unify display representation for Field #​8784
  • Misleading configuration name: skip_arrow_metadata #​8780
  • Inconsistent display for types with Metadata #​8761 [arrow]
  • Internal arrow-integration-test crate is linked from arrow docs #​8739 [arrow]
  • Add benchmark for RunEndEncoded casting #​8709 [arrow]
  • [Varaint] Support VariantArray::value to return a Result<Variant> #​8672

Merged pull requests:


Configuration

📅 Schedule: Branch creation - Between 12:00 AM and 03:59 AM, only on Monday ( * 0-3 * * 1 ) (UTC), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about these updates again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate
Copy link
Contributor Author

renovate bot commented Nov 24, 2025

⚠️ Artifact update problem

Renovate failed to update an artifact related to this branch. You probably do not want to merge this PR as-is.

♻ Renovate will retry this branch, including artifacts, only when one of the following happens:

  • any of the package files in this branch needs updating, or
  • the branch becomes conflicted, or
  • you click the rebase/retry checkbox if found above, or
  • you rename this PR's title to start with "rebase!" to trigger it manually

The artifact failure details are included below:

File name: Cargo.lock
Command failed: cargo update --config net.git-fetch-with-cli=true --manifest-path benchmarks/lance-bench/Cargo.toml --package arrow-cast@56.2.0 --precise 57.3.0
    Updating crates.io index
error: failed to select a version for the requirement `arrow-cast = "^56.1"`
candidate versions found which didn't match: 57.3.0
location searched: crates.io index
required by package `lance-encoding v0.39.0`
    ... which satisfies dependency `lance-encoding = "^0.39.0"` (locked to 0.39.0) of package `lance-bench v0.1.0 (/tmp/renovate/repos/github/vortex-data/vortex/benchmarks/lance-bench)`

@renovate renovate bot added the changelog/chore A trivial change label Nov 24, 2025
@codspeed-hq
Copy link

codspeed-hq bot commented Nov 24, 2025

CodSpeed Performance Report

Merging this PR will degrade performance by 24.76%

Comparing renovate/major-57-arrow-rs (cd2b7c1) with develop (e061c55)1

Summary

❌ 1 regressed benchmark
✅ 1137 untouched benchmarks
⏩ 1265 skipped benchmarks2

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_bool_into_canonical[(1000, 10)] 65.8 µs 87.5 µs -24.76%

Footnotes

  1. No successful run was found on develop (6b8fb88) during the generation of this report, so e061c55 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

  2. 1265 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@renovate renovate bot changed the title chore(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Nov 24, 2025
@renovate renovate bot force-pushed the renovate/major-57-arrow-rs branch 2 times, most recently from f3fe6c4 to ab3e18f Compare November 24, 2025 23:09
@renovate renovate bot changed the title Update arrow-rs to v57 (major) chore(deps): update arrow-rs to v57 (major) Nov 26, 2025
@renovate renovate bot changed the title chore(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Nov 27, 2025
@renovate renovate bot changed the title Update arrow-rs to v57 (major) chore(deps): update arrow-rs to v57 (major) Nov 27, 2025
@renovate renovate bot changed the title chore(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Dec 9, 2025
@renovate renovate bot force-pushed the renovate/major-57-arrow-rs branch from ab3e18f to 22aaa8b Compare December 10, 2025 11:08
@renovate renovate bot changed the title Update arrow-rs to v57 (major) chore(deps): update arrow-rs to v57 (major) Dec 16, 2025
@renovate renovate bot changed the title chore(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Dec 16, 2025
@renovate renovate bot changed the title Update arrow-rs to v57 (major) chore(deps): update arrow-rs to v57 (major) Dec 16, 2025
@renovate renovate bot changed the title chore(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Dec 16, 2025
@renovate renovate bot changed the title Update arrow-rs to v57 (major) chore(deps): update arrow-rs to v57 (major) Dec 17, 2025
@renovate renovate bot changed the title chore(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Dec 18, 2025
@renovate renovate bot changed the title Update arrow-rs to v57 (major) chore(deps): update arrow-rs to v57 (major) Dec 18, 2025
@renovate renovate bot changed the title chore(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Dec 19, 2025
@renovate renovate bot force-pushed the renovate/major-57-arrow-rs branch 2 times, most recently from 3cbbe37 to 99e53da Compare January 5, 2026 11:27
@renovate renovate bot changed the title Update arrow-rs to v57 (major) fix(deps): update arrow-rs to v57 (major) Jan 6, 2026
@renovate renovate bot force-pushed the renovate/major-57-arrow-rs branch 2 times, most recently from 7cdbcef to 5bd1767 Compare January 14, 2026 11:27
@renovate renovate bot changed the title fix(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Jan 27, 2026
@renovate renovate bot changed the title Update arrow-rs to v57 (major) fix(deps): update arrow-rs to v57 (major) Jan 28, 2026
@renovate renovate bot changed the title fix(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Jan 28, 2026
@renovate renovate bot changed the title Update arrow-rs to v57 (major) fix(deps): update arrow-rs to v57 (major) Jan 28, 2026
@renovate renovate bot changed the title fix(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Jan 28, 2026
@renovate renovate bot changed the title Update arrow-rs to v57 (major) fix(deps): update arrow-rs to v57 (major) Jan 28, 2026
@renovate renovate bot changed the title fix(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Jan 28, 2026
@renovate renovate bot changed the title Update arrow-rs to v57 (major) fix(deps): update arrow-rs to v57 (major) Jan 29, 2026
@renovate renovate bot changed the title fix(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Jan 29, 2026
@renovate renovate bot changed the title Update arrow-rs to v57 (major) fix(deps): update arrow-rs to v57 (major) Jan 30, 2026
@renovate renovate bot changed the title fix(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Jan 30, 2026
@renovate renovate bot changed the title Update arrow-rs to v57 (major) fix(deps): update arrow-rs to v57 (major) Feb 2, 2026
@renovate renovate bot force-pushed the renovate/major-57-arrow-rs branch 2 times, most recently from f8e094a to 58973ec Compare February 6, 2026 18:54
@renovate renovate bot force-pushed the renovate/major-57-arrow-rs branch from 58973ec to cd2b7c1 Compare February 6, 2026 19:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants