Develop SharefileToSnowflakeDag class (GF)#76

Open

gfitzgerald-ea wants to merge 48 commits intomainfrom

feature/sharefile_to_snowflake_dag_builder_gf

Commits on Mar 6, 2025

test first class method
mberrien-fitzsimons
committed

Commits on Mar 7, 2025

Commits on Mar 11, 2025

updated sharefile to snowflake dag builder script to include global exposure of dag id
mberrien-fitzsimons
committed
removed global function because it did not work for explosing dag id
mberrien-fitzsimons
committed
updated s3.py in attempt to fix metadata_column bug
mberrien-fitzsimons
committed

Commits on Mar 12, 2025

Commits on Mar 13, 2025

updated sharefile sources
mberrien-fitzsimons
committed

Commits on Mar 14, 2025

re-ordered init arguments
mberrien-fitzsimons
committed

Commits on Mar 20, 2025

Commits on Mar 21, 2025

Commits on Mar 24, 2025

Commits on Mar 25, 2025

added controle flow for choosing tansfer from s3 to snowflake step
mberrien-fitzsimons
committed

Commits on Jul 9, 2025

Merge branch 'main' into feature/sharefile_to_snowflake_dag_builder
Greg Fitzgerald
committed

Commits on Aug 1, 2025

Clean up dag and add to init.
Greg Fitzgerald
committed

Commits on Aug 11, 2025

Update SharefileToSnowflakeDag.
Greg Fitzgerald
committed

Commits on Aug 18, 2025

Make local file path more configurable.
Greg Fitzgerald
committed

Commits on Aug 26, 2025

Refactor sharefile_to_snowflake_dag and create ea_csv helper functions.
Greg Fitzgerald
committed

Commits on Sep 10, 2025

Make move_to_processed optional and allow numbered txt columns.
Greg Fitzgerald
committed
Update conditional move_to_provessed task handling.
Greg Fitzgerald
committed

Commits on Sep 16, 2025

Update SharefileToSnowflakeDag and ea_csv docs.
Greg Fitzgerald
committed

Commits on Sep 22, 2025

Add csv_encoding argument to translate_csv_to_jsonl.
Greg Fitzgerald
committed