bruin icon indicating copy to clipboard operation
bruin copied to clipboard

Add Athena table summary support for data diff

Open Sakeeb91 opened this issue 4 months ago • 3 comments

Summary

  • implement GetTableSummary for Athena with schema/data statistics support
  • add an Athena type mapper and unit coverage for summary stats
  • document Athena as a supported backend for bruin data-diff

Testing

  • go test ./pkg/athena ./pkg/diff

Closes #1224

Sakeeb91 avatar Oct 17 '25 18:10 Sakeeb91

Hey @Sakeeb91 Thanks for the PR! Just to clarify, has this been tested with a real Athena connection ? We want to ensure the integration works against a live Athena instance as well.

terzioglub avatar Oct 18 '25 20:10 terzioglub

Hey @Sakeeb91 Thanks for the PR! Just to clarify, has this been tested with a real Athena connection ? We want to ensure the integration works against a live Athena instance as well.

I would require working AWS/Athena credentials to run that end-to-end check

Sakeeb91 avatar Oct 19 '25 12:10 Sakeeb91

@Sakeeb91 no problem . We will test it on our end and get the pr merged as soon as possible

terzioglub avatar Oct 20 '25 13:10 terzioglub