Adding node layers to tests and loaders#2597

Draft

arienandalibi wants to merge 111 commits into

db_v4from

db_v4_node_layers

Commits on Mar 12, 2026

Updating Parquet* structs to support manually passed export vids, eids, and layer_ids
arienandalibi
committed

Commits on Mar 13, 2026

Allowed IDs to be passed to parquet serialization. Will allow us to pre-compute new IDs and turn them into RecordBatches
arienandalibi
committed

Commits on Mar 17, 2026

Changed Parquet encoding to take GraphView instead of GraphStorage. Lock the graph to get parallel iterators over edges. We filter to respect GraphView filtering behaviour.
arienandalibi
committed

Commits on Mar 18, 2026

Fixed node and edge parallel iterator creation
arienandalibi
committed

Commits on Mar 20, 2026

Fixed path error
arienandalibi
committed

Commits on Mar 23, 2026

Made all the encode_* functions generic over the sink. A sink factory function can now be passed to these functions to determine how the sinks will be created. This will allow us to pass a sink whi…
arienandalibi
committed

Commits on Mar 25, 2026

Commits on Mar 27, 2026

Fixed deadlock caused by DictMapper deep_clone not creating a new lock and reusing the old one.
arienandalibi
committed

Commits on Mar 28, 2026

Merge branch 'db_v4' into db_v4_bulk_ingestion
arienandalibi
committed

Commits on Mar 30, 2026

Commits on Mar 31, 2026

Commits on Apr 1, 2026

Debugging materialize_using_recordbatches to see why it freezes/hangs when run on a big graph.
arienandalibi
committed

Commits on Apr 2, 2026

Commits on Apr 9, 2026

Set up environment variables to configure database properly before materialize test.
arienandalibi
committed

Commits on Apr 10, 2026

Commits on Apr 14, 2026

Commits on Apr 17, 2026

Renamed parquet folder to parquet_encoder
arienandalibi
committed

Commits on Apr 23, 2026

Commits on Apr 24, 2026

Commits on Apr 27, 2026

Commits on Apr 29, 2026

Commits on Apr 30, 2026

Commits on May 1, 2026

Commits on May 6, 2026

Commits on May 7, 2026

Commits on May 8, 2026

Commits on May 11, 2026

Update parquet files in graphql-bench to reflect new columns. Namely, added layer and layer id to nodes_t
arienandalibi
committed

Commits on May 12, 2026

Commits on May 19, 2026