dynamicio
dynamicio copied to clipboard
feat: Implement read from Athena functionality
Context
It is required that Dynamicio can directly read dataframes from AWS Athena.
- Further details about getting started with dynamicio can be found here
Task
- [ ] Implement a
WithAthena
mixin class with aread_from_athena
method that reads tables from AWS athena
Suggested Approach
Dynamicio already uses the boto3 library to access AWS. You'll want to continue using the boto3 class for authentication, and reading/writing where possible.
Please contact [email protected]
for instructions on how to test your code against a test AWS Athena instance.
Acceptance Criteria
- [ ] The
read_from_athena
method should read whole tables (every column & row) directly from AWS athena.select * from tablename
. - [ ] All existing tests pass.
- [ ] New tests written as required.
- [ ] Readme & docs are updated to reflect the new changes.
The Process
Please fork this repo, commit your changes on a branch, then send @miodohelper a PR request when your work is ready for review. Miodo will review the code before sending the PR for a final review by @Christos-Hadjinikolis.
Expected Duration
8hrs