dbt-databricks
dbt-databricks copied to clipboard
Liquid Clustering configuration for Python-based models
Describe the feature
Similar to Liquid Clustering for SQL-based Delta tables in this PR, similar functionality should also be implemented for Python-based model. Currently Liquid Clustering doesn't have stable API in Python, so the implementation of this feature request might wait for that.
Describe alternatives you've considered
Additional context
Who will this benefit?
Databricks customer who wish to use Liquid Clustering & dbt.
Are you interested in contributing this feature?
Yes
Thanks for filing this. Once the python config that I've been working on becomes part of a mainstream release, I will tackle this.
Just updating to note that this work (the python support) is waiting on PySpark to support this feature. Until then not much I can do, since liquid clustering needs to be declared as part of table create.
This issue has been marked as Stale because it has been open for 180 days with no activity. If you would like the issue to remain open, please remove the stale label or comment on the issue.