Data fusion changes#1

Merged

sandeshkr419 merged 143 commits into3.3-dffrom

feature/substrait-plan

Dec 3, 2025

Commits on Oct 1, 2025

Add 3.3 release notes (#4422) (#4423)

opensearch-trigger-bot[bot]
and
github-actions[bot]
authored

Commits on Oct 2, 2025

Support `multisearch` command in calcite (#4332)
ahkcs
authored

Commits on Oct 3, 2025

reverting to _doc + _id (#4435)
ahkcs
authored

Commits on Oct 6, 2025

Commits on Oct 7, 2025

Update eventstats.rst (#4447)
alexey-temnikov
authored
Update delete_backport_branch workflow to include release-chores branches (#4025)
RileyJergerAmazon
authored

Commits on Oct 8, 2025

Commits on Oct 14, 2025

Commits on Oct 16, 2025

Commits on Oct 17, 2025

Commits on Oct 18, 2025

Commits on Oct 20, 2025

Commits on Oct 21, 2025

Commits on Oct 22, 2025

Commits on Oct 23, 2025

Commits on Oct 24, 2025

Added logs for substrait and time
vinaykpud
committed

Commits on Nov 4, 2025

Pushdown case function in aggregations as range queries (#4400)

yuancu
authored and
expani
committed
Refactor JsonExtractAllFunctionIT and MapConcatFunctionIT (#4623)

ykmr1224
authored and
expani
committed
Return comparable LinkedHashMap in `valueForCalcite()` of ExprTupleValue (#4629)

LantaoJin
authored and
expani
committed
Replace all dots in fields of table scan's PhysType (#4633)

LantaoJin
authored and
expani
committed
Support Automatic Type Conversion for REX/SPATH/PARSE Command Extractions (#4599)

penghuo
authored and
expani
committed
Revert "Update grammar files and developer guide (#4301)" (#4643)

ahkcs
authored and
expani
committed
Publish internal modules separately for downstream reuse (#4484)

authored and
expani
committed
Allow renaming group-by fields to existing field names (#4586)

yuancu
authored and
expani
committed
Mitigate the CI failure caused by 500 Internal Server Error (#4646)

LantaoJin
authored and
expani
committed
Followup: Change ComparableLinkedHashMap to compare Key than Value (#4648)

LantaoJin
authored and
expani
committed
Pushdown sort aggregate metrics (#4603)

LantaoJin
authored and
expani
committed
Add `per_minute`, `per_hour`, `per_day` function support (#4531)

dai-chen
authored and
expani
committed
Fix bin nested fields issue (#4606)

ahkcs
authored and
expani
committed
Fix: Support Alias Fields in MIN, MAX, FIRST, LAST, and TAKE Aggregations (#4621)

ahkcs
authored and
expani
committed
Use table scan rowType in filter pushdown could fix rename issue (#4670)

LantaoJin
authored and
expani
committed
Support push down sort after limit (#4657)

qianheng-aws
authored and
expani
committed
Update big5 ppl queries and check plans (#4668)

LantaoJin
authored and
expani
committed
Make nested alias type support referring to outer context (#4673)

qianheng-aws
authored and
expani
committed
Enhance dynamic source clause to support only metadata filters (#4554)

vamsimanohar
authored and
expani
committed
Fixes for `Multisearch` and `Append` command (#4512)

ahkcs
authored and
expani
committed
Fix asc/desc keyword behavior for sort command (#4651)

ritvibhatt
authored and
expani
committed
[BugFix] Fix unexpected shift of extraction for `rex` with nested capture groups in named groups (#4641)

RyanL1997
authored and
expani
committed
Update search.rst documentation (#4686)

vamsimanohar
authored and
expani
committed
Fix CVE-2025-48924 (#4665)

RyanL1997
authored and
expani
committed
Support millisecond span (#4672)

yuancu
authored and
expani
committed
Support 'usenull' option in PPL `top` and `rare` commands (#4696)

LantaoJin
authored and
expani
committed
bin command error message enhancement (#4690)

ahkcs
authored and
expani
committed
BucketAggretationParser should handle more non-composite bucket types (#4706)

LantaoJin
authored and
expani
committed
Merge group fields for aggregate if having dependent group fields (#4703)

qianheng-aws
authored and
expani
committed
Do not remove nested fields in resolving AllFieldsExcludeMeta (#4708)

LantaoJin
authored and
expani
committed
Pushdown the `top` `rare` commands to nested aggregation (#4707)

LantaoJin
authored and
expani
committed
Support serializing external OpenSearch UDFs at pushdown time (#4618)

yuancu
authored and
expani
committed
Split bwc-tests to bwc-rolling-upgrade and bwc-full-restart (#4716)

LantaoJin
authored and
expani
committed
Fix sub-fields accessing of generated structs (#4683)

yuancu
authored and
expani
committed
Bump Calcite to 1.41.0 (#4714)

LantaoJin
authored and
expani
committed
Support `Streamstats` command with calcite (#4297)

authored and
expani
committed
Support access to nested field of struct after fields command (#4719)

qianheng-aws
authored and
expani
committed
Enhance tests and doc for eval isnull/isnotnull functions (#4724)

ahkcs
authored and
expani
committed
Update clickbench queries with parameter bucket_nullable=false (#4732)

qianheng-aws
authored and
expani
committed
Add allowed_warnings in yaml restful tests (#4731)

LantaoJin
authored and
expani
committed
Support wildcard for replace command (#4698)

ahkcs
authored and
expani
committed
poc to convert PPL to substrait plan and add to OpenSearchQueryRequest

vinaykpud
authored and
expani
committed
Making terms agg work for string and date work for substrait schema
expani
committed
Removed lingering merge conflict
expani
committed
Pushing down as terms agg where applicable
expani
committed

Commits on Nov 5, 2025

Commits on Nov 6, 2025

Pushing down MultiTerms Aggregation
expani
committed

Commits on Nov 7, 2025

Commits on Nov 18, 2025

Commits on Nov 19, 2025

Removed response ignoring
expani
committed

Commits on Nov 20, 2025

count changes
sandeshkr419
committed

Commits on Nov 22, 2025

Commits on Dec 1, 2025

Commits on Dec 2, 2025

Commits on Dec 3, 2025