dbt-databricks
dbt-databricks copied to clipboard
A dbt adapter for Databricks.
### Describe the bug Since Numpy released its latest version 2.0, it is not compatible with an older version of Pandas. However, dbt-databricks in version 1.8.3 only supports pandas up...
### Describe the bug When using `dbt_project_evaluator` I get the error below. I have set ` spark.databricks.delta.schema.autoMerge.enabled` to true, but it's not evolving the schema. Ultimately I'd love to know...
fix: address dbt seed command error when seed file is partially defined in the config file Resolves #723 ### Description ### Checklist - [x] I have run this code in...
### Describe the bug I'm upgrading from dbt-databricks version 1.6.5 to version 1.8.3 and stumbled upon an issue when trying to use the `dbt seed`. As I didn't find any...
### Describe the feature Make the `job_id`, `run_id` and `task_run_id` from job runs in Databricks available in the `adapter_response` in `run_results.json`. Currently I only see `query_id` and `_message` available in...
### Describe the bug Since the release of the new 0.29.0 version of databricks-sdk, the dbt job running on our databricks cluster, using dbt-databricks==1.6.5 version, started to fail with the...
### Describe the bug The Databricks adapter is missing the `external` relation type which is a part of the dbt adapter contract: https://github.com/dbt-labs/dbt-adapters/blob/main/dbt/adapters/contracts/relation.py#L23. This type is usually assigned to relations...
### Describe the bug When I specify a column with data_type struct when using model contracts, then i get a runtime error. ### Steps To Reproduce 1. Created a model...
### Describe the feature Hi @benc-db , Does DBT currently support model level retry? I didn't find information in DBT website. But I think this can be a useful feature,...
### Describe the feature Add support for the new `MERGE WITH SCHEMA EVOLUTION` syntax available on the current and preview channel SQL Warehouse versions. https://docs.databricks.com/en/delta/update-schema.html#schema-evolution-syntax-for-sql. This is especially useful if...