dbt_artifacts icon indicating copy to clipboard operation
dbt_artifacts copied to clipboard

Adding support for Amazon Athena

Open brendan-cook-87 opened this issue 2 years ago • 0 comments

Overview

Adds support Amazon Athena.

Update type - breaking / non-breaking

  • [ ] Minor bug fix
  • [ ] Documentation improvements
  • [ ] Quality of Life improvements
  • [x] New features (non-breaking change)
  • [ ] New features (breaking change)
  • [ ] Other (non-breaking change)
  • [ ] Other (breaking change)
  • [ ] Release preparation

What does this solve?

Adding Amazon Athena support as per feature request.

Outstanding questions

I am a bit unsure about a few pieces of the dbt_project config. I have added table_type and incrememntal_strategy config conditionally for Athena, but I haven't tested how these affect other databases.

The additional config in the incremental test model is required because by default in Athena if you cast 'apple' to varchar the default response creates a varchar(5) column which doesn't accept a varchar(6) - 'banana', unless you select a table_type that allows for (some) schema evolution (iceberg).

What databases have you tested with?

  • [ ] Snowflake
  • [ ] Google BigQuery
  • [ ] Databricks
  • [ ] Spark
  • [x] Athena
  • [ ] N/A

brendan-cook-87 avatar Nov 27 '23 06:11 brendan-cook-87