dbt_artifacts
dbt_artifacts copied to clipboard
Adding support for Amazon Athena
Overview
Adds support Amazon Athena.
Update type - breaking / non-breaking
- [ ] Minor bug fix
- [ ] Documentation improvements
- [ ] Quality of Life improvements
- [x] New features (non-breaking change)
- [ ] New features (breaking change)
- [ ] Other (non-breaking change)
- [ ] Other (breaking change)
- [ ] Release preparation
What does this solve?
Adding Amazon Athena support as per feature request.
Outstanding questions
I am a bit unsure about a few pieces of the dbt_project config. I have added table_type and incrememntal_strategy config conditionally for Athena, but I haven't tested how these affect other databases.
The additional config in the incremental test model is required because by default in Athena if you cast 'apple' to varchar the default response creates a varchar(5) column which doesn't accept a varchar(6) - 'banana', unless you select a table_type that allows for (some) schema evolution (iceberg).
What databases have you tested with?
- [ ] Snowflake
- [ ] Google BigQuery
- [ ] Databricks
- [ ] Spark
- [x] Athena
- [ ] N/A