Skip to content

state:modified selectors do not select a column databricks_tags change #1446

@pyrobat

Description

@pyrobat

Describe the bug

Column level databricks_tags do not get picked up when using the state:modified selectors.

Steps To Reproduce

  1. Build the following models with a dbt run -s tag_test

tag_test.sql:

select 1 as tag_column

tag_test.yml

models:
  - name: tag_test
     columns:
       - name: tag_column
  1. Copy the manifest to a location (e.g. target/) to do a deferred run.

  2. Update tag_test.yml with a databricks_tag

models:
  - name: tag_test
     columns:
       - name: tag_column
          databricks_tags:
            test_tag: 'test_value'
  1. Run dbt run -s state:modified --defer --state target/
~~~ dbt run -s state:modified --defer --state defer/
23:52:55  Running with dbt=1.10.11
23:52:59  Registered adapter: databricks=1.10.12
23:53:01  Found 63 models, 53 data tests, 2 seeds, 2 operations, 15 sources, 9 metrics, 955 macros, 5 semantic models, 1 saved query
23:53:01  The selection criterion 'state:modified' does not match any enabled nodes
23:53:01  Nothing to do. Try checking your model configs and model specification args

Expected behavior

I expect state:modified to pick up the column level documentation change.

Screenshots and log output

Logs above in repro steps.

System information

The output of dbt --version:

Core:
  - installed: 1.10.11
  - latest:    1.11.9  - Update available!

  Your version of dbt-core is out of date!
  You can find instructions for upgrading here:
  https://docs.getdbt.com/docs/installation

Plugins:
  - databricks: 1.10.12 - Update available!
  - spark:      1.9.3   - Update available!

  At least one plugin is out of date with dbt-core.
  You can find instructions for upgrading here:
  https://docs.getdbt.com/docs/installation

The operating system you're using: macOS 26.4

The output of python --version: Python 3.11.15

Additional context

This is necessary to ensure our CI and CD can continue to use slimCI to test and apply these changes on merge. Without this, tags can be in our repo, but not applied until the next time the model gets run by a schedule. Since databricks_tags will be tied to ABAC, we want to make sure repo configuration matches deployment configuration.

Was redirected here from dbt core (dbt-labs/dbt-core#10189 (comment))

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions