dbt-databricks
dbt-databricks copied to clipboard
databricks
A dbt adapter for Databricks.
### Describe the feature Create and orchestrate Delta Live Tables using `dbt-databricks` ### Describe alternatives you've considered Delta Live Tables can be set up using the Databricks UI, but this...
### Describe the bug When deploying materializations I will randomly get: ``` Runtime Error in 20:40:59 Error running query: org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: at least one column must be specified for the...
### Describe the bug `dbt run` fails for models materialized as tables when the `location_root` is updated. ### Steps To Reproduce 1. Define `model_a` as materialized as a table 2....
### Describe the bug When running dbt docs generate with JSON logs enabled I receive an error: `Encountered an error while generating catalog: Object of type DatabricksRelation is not JSON...
### Describe the bug The instance is killed with the reason `OOMKilled`. Seems there is a memory leakage. ### Steps To Reproduce When run `dbt build` with multiple threads enabled,...
We've just published the release cut of dbt-core 1.2.0, `dbt-core 1.2.0rc1` ([PyPI](https://pypi.org/project/dbt-core/1.2.0rc1/) | [GitHub release notes](https://github.com/dbt-labs/dbt-core/releases/tag/v1.2.0rc1)). https://github.com/dbt-labs/dbt-core/discussions/5468 is an open discussion with more detailed information, and https://github.com/dbt-labs/dbt-core/issues/5474 is for keeping...
### Describe the feature `ZORDER` is a useful way to get natural colocation for data. It can only be run as part of the [OPTIMIZE](https://docs.databricks.com/spark/latest/spark-sql/language-manual/delta-optimize.html) command. I would like to...
### Describe the feature Setting many table properties is slow (e.g. when you use them for column documentation) because when you set one table property, Hive Metastore rewrites all of...
### Describe the feature Some of the functionality in [dbt-utils](https://github.com/dbt-labs/spark-utils/blob/main/macros/dbt_utils/cross_db_utils/dateadd.sql) can be simplified if we had a Databricks-specific implementation. For example, `dateadd` can be much simpler and more performant.
Partly resolves https://github.com/brooklyn-data/dbt_artifacts/issues/61 ### Description Add local file upload functionality to the adapter. The main motivation for this is to make [dbt_artifacts](https://github.com/brooklyn-data/dbt_artifacts) compatible with Databricks. In order to do so...
