Feature Request: Support for column-level databricks tags

[stevenayers]

trafficstars

Describe the feature

The new support for Databricks tags on tables & views is really useful. Any chance of supporting column tags too? This is useful for tagging columns that contain particularly sensitive data.

In the same way that tags sits under config on a model, but tags is a top-level attribute on columns:

models:
  - name: foo
    description: I'm a teapot
    config:
      tags:
        - hourly
      databricks_tags:
        - foo
    columns:
      - name: id
        tags:
          - bla
      - name: bank_details
        tags:
          - bla
        databricks_tags:
          - don't publish this column on the internet please
      - name: date
        data_type: date

Are you interested in contributing this feature?

Sure, let me know if how I've designed the spec in YAML looks good, and I'll raise a PR for the feature.

[benc-db]

Yes, looks good. Please base your PR on the 2.0.latest branch.

[Us3rname]

Any update on this feature request? I'm also in a need for this feature.

[stevenayers]

I haven't had time to progress this yet, I'll look into it in the next week.

[zg-brynneh]

@stevenayers just checking if you have any update on this feature request? I could also use this feature.

[stevenayers-bge]

Sorry @benc-db @mi-volodin I won't have time to work on this

[benc-db]

@stevenayers-bge acknowledged. We are trying to get a change internally that will allow us to take these actions at create time without needing to know column types; this feature will either come when that change happens, or when I work on column masks, whichever comes first.