Releases: SQLMesh/sqlmesh
Releases · SQLMesh/sqlmesh
v0.21.0
✨ Features
- Introduce an additional 'incremental_unmanaged' model kind to support existing incremental mode in dbt projects (#1173) @izeigerman
- Support sessions in the BigQuery adapter (#1185) @izeigerman
🪲 Bug fixes
- Fix styling for cli reference init (#1184) @treysp
- Deserialization of the incremental unmanaged model kind @izeigerman
- Remove SQL dialect config for dbt projects (#1189) @treysp
v0.20.0
✨ Features
- Require dialect arg in sqlmesh config (#1127) @treysp
- Add endpoint to get current version + display version in footer (#1174) @mykalmax
🪲 Bug fixes
- Tab not showing after refresh + store unsaved changes (#1164) @mykalmax
- Quote all identifiers in execute except those coming from fetchdf (#1128) @georgesittas
- Skip directories in a dbt project that the user is not permitted to access (#1179) @crericha
- Make postgres keepalives_idle optional for dbt projects (#1180) @crericha
- Make dbt postgresql targeting read database name from profile correctly @lu0x1a0
🛠️ Refactor
👽 Other
- Reorder cli quickstart (#1168) @treysp
- Return an empty array of columns instead of an error when columns_to_types is None (#1169) @vchan
- Reorder notebook quickstart (#1170) @treysp
- Add dbt adapter link to install page (#1176) @treysp
- Remove extra check mark (#1182) @treysp
- Revert "Remove extra check mark (#1182)" (#1183) @treysp
v0.19.0
🪲 Bug fixes
- Normalize model name, issue for dbt snowflake @tobymao
- Fix Windows faulthandler and seed path (#1162) @eakmanrq
- Allow reverting to previous versions (#1163) @eakmanrq
- Json bigquery types show up as TYPE_KIND_UNSPECIFIED @tobymao
🧹 Chore
- Rename --promote-all to --include-unmodified (#1166) @izeigerman
v0.18.0
✨ Features
- Improve file explorer (#1044) @mykalmax
- Promote only changed snapshots in dev environments (#1131) @izeigerman
- Show scrollbar on hover for all scrollable blocks (#1141) @mykalmax
- Add support for forward_only and disable_restatement flags to incremental models (#1144) @izeigerman
- Add sorting/filtering to table (#1138) @mykalmax
- Improve consistent styling for inputs + use radix/select for selectors (#1151) @mykalmax
- Prettier Slack webhook notifications (#1145) @z3z1ma
- Add keyboard support to the SearchList component (#1143) @mykalmax
- Determine time_column from bigquery partition_by config (#1153) @crericha
- Add ttl to snapshot cache (#1158) @tobymao
- Add progress bar for snapshot creation (#1157) @georgesittas
- Re-use ModelConfirmation component from IDE page (#1155) @mykalmax
🪲 Bug fixes
- Properly support DataFrames when doing INCREMENTAL_BY_UNIQUE_KEY (#1119) @eakmanrq
- Normalize model names and dependencies as sqlglot dialect (#1126) @tobymao
- Populate unittest inputs before rendering query, which may access the input tables (#1121) @crericha
- Improve SQL syntax in editor (#1095) @mykalmax
- Migration for view models (#1124) @izeigerman
- Databricks session_configuration can be None (#1129) @eakmanrq
- Allow forward-only on added external models (#1130) @eakmanrq
- Allow partials when loading configs + Personal Config Overrides Project (#1136) @eakmanrq
- Manually check if sqlglot ready when loading Editor component (#1142) @mykalmax
- Display compiled query in model docs (#1149) @mykalmax
- Re-introduce the 'sqlmesh' jinja flag for dbt projects @izeigerman
- Skip auto categorization for snapshots that indirectly modify models with missing schema (#1147) @izeigerman
- Failing tests @izeigerman
- Unique type discriminator for GCPPostgresConnectionConfig (#1152) @crericha
- Only migrate snapshots that are paused (#1154) @izeigerman
- Missing intervals should not include indirect non breaking @tobymao
- Fix windows paths for executables (#1156) @eakmanrq
- Update the Airflow integration test @izeigerman
- Create_external_models refetch existing external models closes #1132 @tobymao
- File disappear after dragging + add long press to enable dragging (#1159) @mykalmax
- Correctly handle missing intervals for forward-only snapshtos when effective_from is set (#1160) @izeigerman
- Fix the total number of tasks for the snapshot creation progress bar (#1161) @izeigerman
🛠️ Refactor
- Make sqlmesh incremental blocks more clear (#1140) @crericha
- Remove hydrating and missing_intervals from state_sync (#1116) @tobymao
- Make scheduler explicitly take SnapshotIdLike since it refetches from state_sync @tobymao
🧹 Chore
- Bump sqlglot to v17.3.0 (#1111) @georgesittas
- Add type so eslint understands when value is exists (#1092) @mykalmax
- Updated packages (#1134) @mykalmax
👽 Other
v0.17.0
✨ Features
- Add tranpile option to format (#1057) @z3z1ma
- Use dialect when (de)serializing model expressions (#1027) @georgesittas
- Add Snowflake authenticator connection config for dbt projects. (#1066) @crericha
- Add more builtin audits (#1051) @z3z1ma
- Pass 2 of more useful builtin audits (#1068) @z3z1ma
- Code editor enhancement (#1019) @mykalmax
- Enhance notification target functionality (#944) @vchan
- Add tags support for dbt projects. (#1087) @crericha
- Add a state sync cache for performance @tobymao
- Add progress bar for migrations (#1102) @georgesittas
🪲 Bug fixes
- Use correct quote policy in dbt projects. Create correct relation instances in the adapter (#1058) @izeigerman
- More bigquery table api issues (#1059) @tobymao
- Parse cluster_by in dbt models before converting to SQLMesh models (#1060) @izeigerman
- Map relations to snapshot physical tables in the dbt adapter (#1064) @izeigerman
- Bigquery catalog ast @tobymao
- Prevent creation of schema for symbolic models (#1061) @izeigerman
- Always set global variables for dbt packages. Manually extract macro references in additional to the ones fetched from the manifest (#1069) @izeigerman
- Support int64 range partitioning for BQ dbt projects (#1070) @izeigerman
- Allow multiple statements after rendering jinja for pre- / post-statements (#1072) @izeigerman
- Handle optional model and audit paths in the API (#1071) @vchan
- Propagate table properties when replacing query (#1076) @izeigerman
- Make sure to skip a node only once when concurrently processing a DAG (#1079) @izeigerman
- Support legacy property names in the dbt BQ target (#1080) @izeigerman
- Fallback to model dialect when rendering an audit query (#1081) @izeigerman
- Support dbt_utils.star prefix and suffix using dbt version of the macro (#1085) @crericha
- Fetch columns-to-types mapping from the target DW when determining a type of the time column (#1083) @izeigerman
- Make all BigQuery db calls retryable (#1084) @eakmanrq
- Deterministic order when computing fingerprint for jinja macro packages (#1088) @izeigerman
- Fix bigquery nested types (#1089) @tobymao
- Update views only for snapshots that are new to the target environment. Close state sync connections properly (#1093) @izeigerman
- (docs) Fix integration docs links @tobymao
- Circular ref debug_mode @tobymao
- Handle corrupt snapshots due to upgrades closes #1063 (#1091) @tobymao
- Support older versions of BigQuery python library (#1096) @izeigerman
- Preserve the model query cache after fetching snapshots from state sync (#1098) @izeigerman
- Cli failure due to missing package (#1099) @z3z1ma
- Include database in dbt source fqns when it differs from the project's database (#1101) @crericha
- Logging import in CLI @izeigerman
- Jinja rendering comments (#1105) @tobymao
- Remove redundant get_snapshots call when promoting to a dev environments (#1107) @izeigerman
- Determine duckdb database from db filename if not specified. (#1106) @crericha
- Duckdb default catalog name is main for dbt version < 1.5. (#1109) @crericha
- Use schema for table diff summary table (#1112) @izeigerman
- Snapshot intervals erroneously classified as dev (#1113) @izeigerman
- Invalid AST when constructing BQ parition by expressions for dbt models (#1114) @izeigerman
- The skip-tests flag in CLI @izeigerman
- Treat end date as inclusive only for models with a daily cadency (#1115) @izeigerman
🛠️ Refactor
- Macro reference extraction doesn't need dialect specific sql. using generic for performance (#1067) @tobymao
🧹 Chore
- Polish up chi square test and allow auditing for dependence OR independence (#1073) @z3z1ma
- Upgrade sqlglot to v17 (#1090) @tobymao
- Update table diff styling and expand tests (#1077) @treysp
- Remove noisy warnings @izeigerman
- Add ability to ignore warning messages in CLI @izeigerman
- Bumpt sqlglot version to 17.2.0 (#1108) @izeigerman
👽 Other
- Correct deleted model output in models guide (#1062) @treysp
- Auto rollback migration if it fails (#1075) @tobymao
- Enforce dynamic ins/over and make db ins/over (#1074) @eakmanrq
- Add link to Python API reference (#1082) @treysp
- Add table diff guide (#1078) @treysp
- Add new built-in audits to audits guide (#1094) @treysp
- Revert "Feat: add a state sync cache for performance" @tobymao
- Add details for bigquery connection (#1097) @adrianbr
- Add type discriminator to notification targets (#1103) @vchan
- Revert "Revert "Feat: add a state sync cache for performance"" (#1104) @tobymao
- Add notification documentation (#1086) @vchan
- Replace NaN with None in tests (#1110) @vchan
- Add table diff guide to mkdocs (#1117) @treysp
v0.16.1
v0.16.0
✨ Features
- Add ability to invalidate the environment (#1034) @izeigerman
- Support partitioned_by expressions for bigquery (#1041) @crericha
- Cluster by closes #570 (#1046) @tobymao
- Introduce pinned environments which are omitted by the janitor process (#1043) @izeigerman
- Table Diff (#1005) @mykalmax
🪲 Bug fixes
- Skip dbt tests that reference disabled models (#1037) @izeigerman
- Use date type for the 'ds' attribute in the example project @izeigerman
- Display empty state if lineage is empty + fix regex for detecting text inside. MODEL (#1029) @mykalmax
- Bigquery create table requires correct trunc method for column type (#1048) @crericha
- Tables with dots and more conservative optimization (#1052) @tobymao
- Preserve yaml order (#1054) @tobymao
- Use version-specific compilation error for dbt projects (#1055) @izeigerman
- Use target dbt adapter relation and column classes. (#1056) @crericha
- Format_expressions star rewrite @tobymao
🧹 Chore
👽 Other
v0.15.3
🪲 Bug fixes
- Force quoting on unsafe table identifiers (#1028) @georgesittas
- Emit the query optimization warning only when rendering the model's query @izeigerman
- Add pseudo columns for ingest time partitioned tables (#1033) @z3z1ma
- Validate model definition only after the schema for it is set (#1035) @izeigerman
- Validate model def in loader only when schema is updated @izeigerman
- Various Databricks related fixes (#1036) @eakmanrq
👽 Other
v0.15.2
🪲 Bug fixes
- Use unoptimized query when checking whether the query contains star projection @izeigerman
- Replace tables after optimizing the query (#1030) @izeigerman
v0.15.1
🪲 Bug fixes
- Make the missing schema warning less noisy (#1025) @izeigerman