aws-sdk-pandas icon indicating copy to clipboard operation
aws-sdk-pandas copied to clipboard

Support `to_sql` over Data API

Open adilosa opened this issue 3 years ago • 2 comments

Is your feature request related to a problem? Please describe. Can't use Data API to write a data frame to an Aurora db

Describe the solution you'd like Support for to_sql over the Data API, similar to regular Postgres: https://github.com/awslabs/aws-data-wrangler/blob/7441c4fba88b49abe47d17d6b1dd63f9f0199dde/awswrangler/postgresql.py#L282-L293

With the Data API connector added in #828, I suppose most of the same logic could be used. Although I'm not fully aware of the Data APIs limitations around record size and result set limits.

adilosa avatar Oct 29 '21 22:10 adilosa

Looking into it further, probably more of the DB-API 2.0 methods would need to be implemented, expanding support from just cursor.execute() now.

Something similar has been done already in this project: https://github.com/cloud-utils/aurora-data-api/blob/main/aurora_data_api/init.py

adilosa avatar Oct 29 '21 22:10 adilosa

This issue requires triage and should be assigned.

github-actions[bot] avatar Mar 10 '22 18:03 github-actions[bot]

thanks! :)

adilosa avatar May 22 '23 23:05 adilosa