dbt-databricks icon indicating copy to clipboard operation
dbt-databricks copied to clipboard

Liquid Clustering configuration for Python-based models

Open ammarchalifah opened this issue 1 year ago • 3 comments

Describe the feature

Similar to Liquid Clustering for SQL-based Delta tables in this PR, similar functionality should also be implemented for Python-based model. Currently Liquid Clustering doesn't have stable API in Python, so the implementation of this feature request might wait for that.

Describe alternatives you've considered

Additional context

Who will this benefit?

Databricks customer who wish to use Liquid Clustering & dbt.

Are you interested in contributing this feature?

Yes

ammarchalifah avatar Aug 09 '23 17:08 ammarchalifah

Thanks for filing this. Once the python config that I've been working on becomes part of a mainstream release, I will tackle this.

benc-db avatar Aug 16 '23 20:08 benc-db

Just updating to note that this work (the python support) is waiting on PySpark to support this feature. Until then not much I can do, since liquid clustering needs to be declared as part of table create.

benc-db avatar Sep 13 '23 16:09 benc-db

This issue has been marked as Stale because it has been open for 180 days with no activity. If you would like the issue to remain open, please remove the stale label or comment on the issue.

github-actions[bot] avatar Apr 01 '24 01:04 github-actions[bot]