aws-sdk-pandas
aws-sdk-pandas copied to clipboard
Support `to_sql` over Data API
Is your feature request related to a problem? Please describe. Can't use Data API to write a data frame to an Aurora db
Describe the solution you'd like
Support for to_sql
over the Data API, similar to regular Postgres:
https://github.com/awslabs/aws-data-wrangler/blob/7441c4fba88b49abe47d17d6b1dd63f9f0199dde/awswrangler/postgresql.py#L282-L293
With the Data API connector added in #828, I suppose most of the same logic could be used. Although I'm not fully aware of the Data APIs limitations around record size and result set limits.
Looking into it further, probably more of the DB-API 2.0 methods would need to be implemented, expanding support from just cursor.execute()
now.
Something similar has been done already in this project: https://github.com/cloud-utils/aurora-data-api/blob/main/aurora_data_api/init.py
This issue requires triage and should be assigned.
thanks! :)