dbt-databricks
dbt-databricks copied to clipboard
databricks
A dbt adapter for Databricks.
### Describe the bug We are using merge incremental strategy in dbt and have tried the [on_schema_change](https://docs.getdbt.com/docs/build/incremental-models#:~:text=You%20can%20configure%20the%20on_schema_change%20setting%20as%20follows.) = "sync_all_columns" in order to handle any additions or deletions of columns. However,...
### Describe the bug I would like to try using the materialization type of `clone` so that I can have a model that "publishes" tested data runs downstream from the...
### Describe the bug Since the additions of - updating the liquid clustering https://github.com/databricks/dbt-databricks/pull/765 and - updating column descriptions https://github.com/databricks/dbt-databricks/commit/198b56900a18c957388984b20687d5a32d01c530 We no break concurrency because of alter table statements running...
### Describe the bug Custom strategies are supported in dbt-core and allow users to write macros that define incremental merge startegies ( https://docs.getdbt.com/docs/build/incremental-strategy#custom-strategies ). As long as the strategy macro...
Resolves # ### Description ### Checklist - [ ] I have run this code in development and it appears to resolve the stated issue - [ ] This PR includes...
Resolves # ### Description ### Checklist - [ ] I have run this code in development and it appears to resolve the stated issue - [ ] This PR includes...
### Describe the feature dbt recently introduced a new incremental strategy: https://docs.getdbt.com/docs/build/incremental-microbatch ### Who will this benefit? Users who are sick of micromanaging incremental strategy for time-series tables.
Resolves #821 ### Description Enhance `_wait_for_cluster_to_start` to wait for library installation Previously, the `_wait_for_cluster_to_start` function only checked if the cluster state was 'running'. This update adds a check to ensure...
https://github.com/databricks/dbt-databricks/blob/38aefbf86371341f09f39b2ae93224ba2f21270d/dbt/adapters/databricks/python_submissions.py#L404 ### Describe the bug When executing python models in submission_method: all_purpose_cluster, the dbt-databricks connector is not recognizing when the cluster is still installing libraries. This produces python models to...
### Problem When executing a dbt python model, users must choose between an `all-purpose cluster` or a `job cluster` to run Python models (see [docs](https://docs.getdbt.com/docs/build/python-models#specific-data-platforms)). This requirement limits the ability...
