bruin
bruin copied to clipboard
Add Athena table summary support for data diff
Summary
- implement GetTableSummary for Athena with schema/data statistics support
- add an Athena type mapper and unit coverage for summary stats
- document Athena as a supported backend for bruin data-diff
Testing
- go test ./pkg/athena ./pkg/diff
Closes #1224
Hey @Sakeeb91 Thanks for the PR! Just to clarify, has this been tested with a real Athena connection ? We want to ensure the integration works against a live Athena instance as well.
Hey @Sakeeb91 Thanks for the PR! Just to clarify, has this been tested with a real Athena connection ? We want to ensure the integration works against a live Athena instance as well.
I would require working AWS/Athena credentials to run that end-to-end check
@Sakeeb91 no problem . We will test it on our end and get the pr merged as soon as possible