Pick cloud2#2

Open

oppenheimer01 wants to merge 152 commits intomainfrom

pick_cloud2

Commits on Apr 23, 2025

Support separation of catalog and compute.

husen
authored and
oppenheimer01
committed
1. add global variable enable_serverless, default to false, set to true in plugin.

husen
authored and
oppenheimer01
committed
disable WAL-log information required only for Hot Standby in serverless

husen
authored and
oppenheimer01
committed
Add support for creating cluster with single master, and only query on catalog is permitted on single master without warehouse.

HuSen8891
authored and
oppenheimer01
committed
Add: Support to create hashdata table with randomly distribution.

HuSen8891
authored and
oppenheimer01
committed
1. set distributedXid to LocalTransactionId 2. do not send FTS Probe Request

HuSen8891
authored and
oppenheimer01
committed
Feature: support subtransaction and savepoint

HuSen8891
authored and
oppenheimer01
committed
Fix: Only master can set transaction status

HuSen8891
authored and
oppenheimer01
committed
Add extensible smgr slot for other storage format.

zhangwenchao-123
authored and
oppenheimer01
committed
Feature: add dml hook

gongxun0928
authored and
oppenheimer01
committed
Add main_manifest catalog table

roseduan
authored and
oppenheimer01
committed
Add hooks for plugins to get control in transientrel_init/intorel_initplan.

HuSen8891
authored and
oppenheimer01
committed
Implement extensible libpq protocol.

zhangwenchao-123
authored and
oppenheimer01
committed
Add vacuum full in serverless (#209)

authored and
oppenheimer01
committed
change storage_am related catalog table main_manifest field type from… (#210)

authored and
oppenheimer01
committed
Add regress pipeline for branch union_store_catalog and fix compile error. (#211)

zhangwenchao-123
authored and
oppenheimer01
committed
bugfix: support hashdata tableam in Orca (#222)

gongxun0928
authored and
oppenheimer01
committed
support analyze for unionstore table in cloudberry (#207)

gongxun0928
authored and
oppenheimer01
committed
New altertable rewrite dispatch policy (#223)

authored and
oppenheimer01
committed
Fix: do not commit subtransaction through DTX protocol. (#226)

authored and
oppenheimer01
committed
Add: new hooks for plugins to get control in syscache.

HuSen8891
authored and
oppenheimer01
committed
Change myTempNamespace from static variable to extern variable.

zhangwenchao-123
authored and
oppenheimer01
committed
Implement drop warehouse

zhangwenchao-123
authored and
oppenheimer01
committed
Add: new hook for plugins to validate the relation

HuSen8891
authored and
oppenheimer01
committed
fix triggers

gongxun0928
authored and
oppenheimer01
committed
Add: some interfaces to get transaction state and xids

leo
authored and
oppenheimer01
committed
Fix copy from freeze will check subtransaction id in QEs.

zhangwenchao-123
authored and
oppenheimer01
committed
Add: new hook to get control in getgpsegmentCount. (#277)

HuSen8891
authored and
oppenheimer01
committed
make main_manifest table not shared (#311)

roseduan
authored and
oppenheimer01
committed
Fix: enable trigger throught FDW in the serverless architecture.

lss602726449
authored and
oppenheimer01
committed
Add interface and export struct to public. (#304)

HuSen8891
authored and
oppenheimer01
committed
Judge whether commands need to be dispatched to QEs in QD (#314)

zhangwenchao-123
authored and
oppenheimer01
committed
Support cloud manager (#296)

authored and
oppenheimer01
committed
Add cache invaladation synchronization amoung QD and QEs.

zhangwenchao-123
authored and
oppenheimer01
committed
Fix some errors in cherry pick
oppenheimer01
committed
Fix copy from where clause of randomly distribution table.

zhangwenchao-123
authored and
oppenheimer01
committed
Fix: dispatch Alter Domain statement to QE.

leo
authored and
oppenheimer01
committed
Fix before delete/update row trgger assert in serverless architecture

lss602726449
authored and
oppenheimer01
committed
Enhancement: support dispatch metadata to QE from QD.

leo
authored and
oppenheimer01
committed
Add configure option --enable-gophermeta, --enable-datalake

lss602726449
authored and
oppenheimer01
committed
Support vbf and compress.

zhangwenchao
authored and
oppenheimer01
committed
Fix dispatch set command will error out when there is no warehouse.

zhangwenchao-123
authored and
oppenheimer01
committed
Feature: Support Fault Tolerant Service (FTS)

roseduan
authored and
oppenheimer01
committed
Feature: support scale warehouse horizontally

leo
authored and
oppenheimer01
committed
Supports database level encryption, with each database using a key.

kongfanshen
authored and
oppenheimer01
committed
When read tuple, need to get all the data. When write tuple, only write data only by one segment.

kongfanshen
authored and
oppenheimer01
committed
Enhancement: optimize the filepath and keep snapshot of table.

leo
authored and
oppenheimer01
committed
Fix: refresh shared buffers and disable hint bits.

leo
authored and
oppenheimer01
committed
Add new hashdata am oid to RelationIsNonblockRelation
oppenheimer01
committed
Fix: collect stat from QE to QD

lss602726449
authored and
oppenheimer01
committed
Fix: storage the keys in the dfs tablespace

kongfanshen
authored and
oppenheimer01
committed
Enable delete after trigger
oppenheimer01
committed
Fix: parallel regression test failures

leo
authored and
oppenheimer01
committed
storage_am: fix hashdata table size

yangjianghua
authored and
oppenheimer01
committed
Add ci for remote storage

kongfanshen
authored and
oppenheimer01
committed
Fix error for cherry pick
oppenheimer01
committed
Fix: change the dispatch manifest hook point

lss602726449
authored and
oppenheimer01
committed
pg_ctl: check dtm process to judge is_coordinator.

yangjianghua
authored and
oppenheimer01
committed
Fix: zlib and gangsize test cases, clean up dispatcherState in time

leo
authored and
oppenheimer01
committed
gpconfig: add --warehouse option, default is test.

yjhjstz
authored and
oppenheimer01
committed
Fix CTAS crash.

avamingli
authored and
oppenheimer01
committed
Fix gitignore.

avamingli
authored and
oppenheimer01
committed
Fix: gpdiffcheck/query_finish_pending/segspace/dispatch cases

leo
authored and
oppenheimer01
committed
fix hang when shutdown in checkpoint

yjhjstz
authored and
oppenheimer01
committed
fix memory overflow in Dispatch Context.

yjhjstz
authored and
oppenheimer01
committed
Extend a new AM method to do acquire sample rows.

zhangwenchao-123
authored and
oppenheimer01
committed
Analyze table change to happen on QD.

yangjianghua
authored and
oppenheimer01
committed
Fix: only update distribution policy for 'SET DISTRIBUTED BY' statement

leo
authored and
oppenheimer01
committed
Fix: use CBDB bin/include to build unionstore

lss602726449
authored and
oppenheimer01
committed
Fix hashdata storage `vacuum full`

Wang Weinan
authored and
oppenheimer01
committed
Fix: set numsegments of distribution policy to zero for partition child table

leo
authored and
oppenheimer01
committed
Retire `enable_serverless` (Part 1)

wangweinan
authored and
oppenheimer01
committed
fix minirepro

kongfanshen
authored and
oppenheimer01
committed
Fix use_physical_tlist to consider hashdata column store.

yangjianghua
authored and
oppenheimer01
committed
Support `createdb`, `dropdb`, etc. tools

wangweinan
authored and
oppenheimer01
committed
Fix plan diffs, including:

kongfanshen
authored and
oppenheimer01
committed
Optimize simple delete not project whole row

yangjianghua
authored and
oppenheimer01
committed
Fix tablespace bug

hanwei
authored and
oppenheimer01
committed
Feature: support user defined heap table

leo
authored and
oppenheimer01
committed
Fix fts probe issue after pg_ctl restart

wangweinan
authored and
oppenheimer01
committed
Fix gpsd

roseduan
authored and
oppenheimer01
committed
Support partition on heap table

leo
authored and
oppenheimer01
committed
Add an auto switch warehouse for chaos test

wangweinan
authored and
oppenheimer01
committed
Add serial schedule CI for heap table

leo
authored and
oppenheimer01
committed
Feature: support warehouse access control management

leo
authored and
oppenheimer01
committed
Collect catalog and dispatch to qes
oppenheimer01
committed
Add pg_calss.relreuseattrs to identify partition could reuse parent's column definitions.

avamingli
authored and
oppenheimer01
committed
Add autopartition grammar in parser

wangweinan
authored and
oppenheimer01
committed
Support IF [NOT] EXISTS when CREATE/DROP WAREHOUSE.

avamingli
authored and
oppenheimer01
committed
Feature: support min/max filter in storage_am.

yangjianghua
authored and
oppenheimer01
committed
support storage type check for column add

wangliang03
authored and
oppenheimer01
committed
change the SCAN_SUPPORT_DEFAULT_COLUMNs macro value

wangliang03
authored and
oppenheimer01
committed
Fix: use XLogRecGetBlockTag to get block number in brin_redo.

leo
authored and
oppenheimer01
committed
Refactory hashdata_manifest(json format)

wangweinan
authored and
oppenheimer01
committed
Feature: create role DEFAULTWAREHOUSE and guc

hanwei
authored and
oppenheimer01
committed
Fix gp_tablespace_location

hanwei
authored and
oppenheimer01
committed
Fix policy relcache changed issue.

avamingli
authored and
oppenheimer01
committed
New tool hd_ctl to create/drop distributed warehouse

lizhaohan
authored and
oppenheimer01
committed
Support Insert for AutoPartition table

wangweinan
authored and
oppenheimer01
committed
concurrent_insert

lss602726449
authored and
oppenheimer01
committed
Table files cleanup after Drop/Truncate/Vacuum

roseduan
authored and
oppenheimer01
committed
Feature: optimize simple aggregate query

leo
authored and
oppenheimer01
committed
create warehouse OPTIONS

avamingli
authored and
oppenheimer01
committed
Feature: recongnize AM by tablespace

hanwei
authored and
oppenheimer01
committed
Move all ProcessUtility into hashdata_utility

wangweinan
authored and
oppenheimer01
committed
Feature: AutoPartition support Copy...FROM... command

wangweinan
authored and
oppenheimer01
committed
Make a start dispatch for the catalog used in init backend
oppenheimer01
committed
Miscellaneous fix: utility mode, hd_ctl enhancement, scripting

lizhaohan
authored and
oppenheimer01
committed
Support vectorization on hashdata table

leo
authored and
oppenheimer01
committed
Incremental Agg Plan based on materialized views.

avamingli
authored and
oppenheimer01
committed
Fix the record empty error in init plpgsql
oppenheimer01
committed
Fix a mistake on RelationReloadNailed
oppenheimer01
committed
Do not use AccessExclusiveLock in Manifest
oppenheimer01
committed
Remove some node dispatch code
oppenheimer01
committed
Feature: support group aggregation defer ivm maintenance.

yangjianghua
authored and
oppenheimer01
committed
Fix some compile error
oppenheimer01
committed
Fix: use IS_QUERY_DISPATCHER() to distinguish backends while accessing metadata

leo
authored and
oppenheimer01
committed
Serverless QE never hold relation lock

wangweinan
authored and
oppenheimer01
committed
Revert "Add cache invaladation synchronization amoung QD and QEs."

lss602726449
authored and
oppenheimer01
committed
Fix: fix serveral problem in catalog dispatch

lss602726449
authored and
oppenheimer01
committed
Fix flake test for copy pg_internal.init
oppenheimer01
committed
Enable catalog collection on all the workers on master
oppenheimer01
committed
Add a new table am routine ScanCatalogPrepare
oppenheimer01
committed
Enable autovacuum process

roseduan
authored and
oppenheimer01
committed
Remove useless function UpdateManifestRecord.

avamingli
authored and
oppenheimer01
committed
Support Subquery in Append Agg.

avamingli
authored and
oppenheimer01
committed
Fix: use MACRO SERVERLESS instead of GUC enable_serverless

leo
authored and
oppenheimer01
committed
Enhance: Support for alter warehouse name suspend/resume/options

lss602726449
authored and
oppenheimer01
committed
Refactor: use MACRO SERVERLESS to improve readability and maintainability

leo
authored and
oppenheimer01
committed
Add SERVERLESS macro on the function load/write rel cache function
oppenheimer01
committed
Enhancement: adjust tablespace for support serverless architecture

hanwei
authored and
oppenheimer01
committed
Refactor: add MACRO SERVERLESS to catalog dispatching related code

leo
authored and
oppenheimer01
committed
Fix: auto analyze inherited table error

roseduan
authored and
oppenheimer01
committed
Use aqumv public function in grouping paths.

avamingli
authored and
oppenheimer01
committed
Remove regular lock on segment
oppenheimer01
committed
Fix work around of materialized view data status.

avamingli
authored and
oppenheimer01
committed
Fix: fts coredump

roseduan
authored and
oppenheimer01
committed
Support min, max in Append Agg Plan.

avamingli
authored and
oppenheimer01
committed
Add create_plan_hook and cursor option

yangjianghua
authored and
oppenheimer01
committed
[CLOUD] Enable delta scan vectorization

yangjianghua
authored and
oppenheimer01
committed
Fix: Retry get hostip from DNS if failed

lss602726449
authored and
oppenheimer01
committed
Fix symbol not found in backstrace

hanwei
authored and
oppenheimer01
committed
[CLOUD] Remove unionstore extention from segment
oppenheimer01
committed
disable autovacuum temporarily

roseduan
authored and
oppenheimer01
committed
Add MACRO 'FAULT_INJECTOR'/'SERVERLESS' to related code

leo
authored and
oppenheimer01
committed
Support COUNT with const value in Append AGG plan.

avamingli
authored and
oppenheimer01
committed
Force CTAS distribution to random in serverless mode.

avamingli
authored and
oppenheimer01
committed
Forbid connecting to QE in utility mode

lizhaohan
authored and
oppenheimer01
committed
Make column case-sensitivity only for output column.

zhangwenchao-123
authored and
oppenheimer01
committed
Clean pg_cron guc optimizer,enable_answer_query_using_materialized_views.

yangjianghua
authored and
oppenheimer01
committed
Eliminate const expressions for Append AGG.

avamingli
authored and
oppenheimer01
committed
Build db without cloud extension

WangWeinan
authored and
oppenheimer01
committed