dbt-databricks
dbt-databricks copied to clipboard
A dbt adapter for Databricks.
I recently switched my project to unity catalog, but setting the +location_root in the projects.yml isn't affecting where or how schemas get created. databricks-dbt created the schema as a 'managed'...
### Describe the feature Databricks Unity Catalog requires that the `USE_SCHEMA` grant be applied to the parent schema without which grants applied to a model have no effect. Currently dbt...
### Describe the bug Running dbt incremental model with multiple unique keys and merge strategy caused this error: ``` The "collect" action failed. You hit a bug in Spark or...
### Describe the bug A clear and concise description of what the bug is. What command did you run? What happened? When the model for a materialized view is run,...
### Describe the bug Sources do not have support for [Databricks clones](https://docs.databricks.com/en/sql/language-manual/delta-clone.html) in [DatabricksRelationType](https://github.com/databricks/dbt-databricks/blob/1d21b328fd2ca57cabe0b8bd2dd09fdbcc884a3b/dbt/adapters/databricks/relation.py#L31-L37) ### Steps To Reproduce I've encountered this issue in a few places but most recently using...
### Describe the feature A clear and concise description of what you want to happen. Using Spark UDF From DBT will be helpful. As discussing in dbt-spark, Something like using...
### Describe the feature We've been having trouble making `pip` happy with SQLAlchemy 2.X.X installed in the same python environment as `dbt-databricks`. This is because `dbt-databricks` pins to `databricks-sql-python <...
### Describe the bug As of 1.7, streaming tables are always dropped when model materialized as 'streaming_table' is run, rather than simply refreshed. ### Steps To Reproduce - create a...
### Describe the bug When switching from `materialized='materialized_view'` to `materialized='materialized_view'` an incorrect statement is issued ``` 11:40:17 Dropping relation `some`.`dbt_eongaro`.`test` because it is of type materializedview 11:40:17 On model.umc_poc.test: drop...
### Describe the feature Currently, there is no way (at least that I know) to run a python models inside a job cluster. It is possible to run SQL models...