dbt-databricks
dbt-databricks copied to clipboard
Setting table properties is really slow
trafficstars
Describe the feature
Setting many table properties is slow (e.g. when you use them for column documentation) because when you set one table property, Hive Metastore rewrites all of them.
Proposal
Enhance dbt-databricks to fetch all the comments, do a diff with what's in the dbt project and only issue updates if the diffs don't match.
Who will this benefit?
Everyone! Faster table properties would be nice!