Skip to content

databricks - model default parameter not recognised #5709

@paddy-devan

Description

@paddy-devan

When using sqlmesh from a databricks notebook, the model_defaults property kind: full is ignored. I have tried various combinations of capitalisation, ordering the properties within the model_defaults block etc., but in all cases it is ignored and the resulting database objects are views. To clarify, I mean the snapshotted objects and not the virtual layer.

Other default properties such as the inferred name and dialect seem to be working fine - it's just the kind property.

config.yml:

gateways:
  databricks:
    connection:
      type: databricks
    state_connection:
      type: postgres
      host: xxx
      port: xxx
      user: xxx
      password: xxx
      database: sqlmesh_state

default_gateway: databricks

model_naming:
  infer_names: true

model_defaults:
  dialect: databricks
  kind: full

physical_schema_mapping:
  '.*': _sqlmesh

notebook:

%pip install sqlmesh[databricks]
%restart_python
import sqlmesh
%context --gateway databricks ./models/../

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions