Backend
VL (Velox)
Bug description
When Spark's array_sort is called without an explicit comparator (the default ascending sort), Spark internally
generates a LambdaFunction that wraps the simple ascending comparison in null-handling If/IsNull logic. Velox's
rewriteArraySortCall uses a SimpleComparisonMatcher that cannot parse this null-handling wrapper, causing the
expression to fall back to Vanilla Spark.
Gluten version
main branch
Spark version
spark-4.0.x
Spark configurations
No response
System information
No response
Relevant logs
Backend
VL (Velox)
Bug description
When Spark's array_sort is called without an explicit comparator (the default ascending sort), Spark internally
generates a LambdaFunction that wraps the simple ascending comparison in null-handling If/IsNull logic. Velox's
rewriteArraySortCall uses a SimpleComparisonMatcher that cannot parse this null-handling wrapper, causing the
expression to fall back to Vanilla Spark.
Gluten version
main branch
Spark version
spark-4.0.x
Spark configurations
No response
System information
No response
Relevant logs