dbt-databricks
dbt-databricks copied to clipboard
A dbt adapter for Databricks.
TLDR: lazy-loading `agate` speeds up the load time of dbt by about 3.5%. Most instances of `agate` are unnecessary as dbt only uses it in a select few situations, and...
I am using the dbt artifacts package for monitoring ETL runs, dbt artifacts supports logging the number of rows affected but requires the adapter to return this information, currently it...
Would like to use [generated columns](https://docs.databricks.com/delta/generated-columns.html) in our dbt models. The use case is to have partitioning based on generated column from a timestamp field so end users wouldn't need...
### Describe the bug This is a strange one. I'm currently trying to set up a DBT workflow where each new feature branch of a DBT project would auto-provision a...
### Describe the feature Similar to Liquid Clustering for SQL-based Delta tables in this [PR](https://github.com/databricks/dbt-databricks/pull/398), similar functionality should also be implemented for Python-based model. Currently Liquid Clustering doesn't have stable...
### Describe the bug I ingest raw data in a bronze table. One of the fields starts with a "#". The first `dbt run` works successfully but other attempts fail...
### Describe the bug User unable to connect to warehouse even though they are getting a `200` response, error is `dict expected at most 1 argument, got 2`. ### Steps...
## Background Minor version `v1.8` is targeted for final release within dbt Core on May 9, 2024. It will come somewhat sooner to dbt Cloud users. ~~As a maintainer of...
dbt-databricks should override the default dbt create_schema(relation) macro in such a location of the schema (and the tables within the schema) can be provided. This way the schema and tables...
### Describe the feature When I run generic dbt commands (such as dbt debug), my [project defaults](https://docs.getdbt.com/docs/build/python-models#specific-data-platforms) to using the all_purpose_cluster defined in my connection profile. When I execute `dbt...