dbt-databricks icon indicating copy to clipboard operation
dbt-databricks copied to clipboard

Setting table properties is really slow

Open bilalaslamseattle opened this issue 3 years ago • 0 comments
trafficstars

Describe the feature

Setting many table properties is slow (e.g. when you use them for column documentation) because when you set one table property, Hive Metastore rewrites all of them.

Proposal

Enhance dbt-databricks to fetch all the comments, do a diff with what's in the dbt project and only issue updates if the diffs don't match.

Who will this benefit?

Everyone! Faster table properties would be nice!

bilalaslamseattle avatar Jul 02 '22 18:07 bilalaslamseattle