dbt-spark
dbt-spark copied to clipboard
dbt-labs
dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
### High Level Task Following the pattern of the other adapters, create an `integration.yml` that contains the logic to replace the current CircleCI pattern. ### Acceptance Criteria 1. `integration.yml` exists...
```[tasklist] ### Moving off CircleCI - [ ] https://github.com/dbt-labs/dbt-spark/issues/719 - [ ] https://github.com/dbt-labs/dbt-spark/issues/722 - [ ] https://github.com/dbt-labs/dbt-spark/issues/739 - [ ] https://github.com/dbt-labs/dbt-spark/issues/723 - [ ] https://github.com/dbt-labs/dbt-spark/issues/731 - [ ] ~~Validate/Fix `integration-spark-databricks-http`~~...
### Describe the feature #### Context Currently, the project relies on GoDataDriven's spark images for its base image in the docker-compose as well as the test configuration. The problem here...
### Is this your first time submitting a feature request? - [X] I have read the [expectations for open source contributors](https://docs.getdbt.com/docs/contributing/oss-expectations) - [X] I have searched the existing issues, and...
### Current Behavior This is a consistently failing new test. It's only failing for the `databricks_cluster` and `databricks_http_cluster` profiles. ### Expected Behavior Tests should be passing ### Steps To Reproduce...
closes #1031 adapter implementation for https://github.com/dbt-labs/dbt-adapters/issues/192 ### Problem & Solution See https://github.com/dbt-labs/dbt-adapters/pull/191 ### Checklist - [x] I have read [the contributing guide](https://github.com/dbt-labs/dbt-core/blob/main/CONTRIBUTING.md) and understand what's expected of me - [x]...
### Is this your first time submitting a feature request? - [X] I have read the [expectations for open source contributors](https://docs.getdbt.com/docs/contributing/oss-expectations) - [X] I have searched the existing issues, and...
Spark >= 3.0 can discover tables/views from multiple catalogs, such as a Hive or Glue catalog. This is a prerequisite to enable so-called three-part identifiers for dbt-spark (`catalog.schema.table`). To keep...
### Is this a new bug in dbt-spark? - [X] I believe this is a new bug in dbt-spark - [X] I have searched the existing issues, and I could...
