aws-sdk-pandas
aws-sdk-pandas copied to clipboard
aws
Swap JDBC for Arrow ADBC
Leveraging the Arrow ADBC Driver has a number of advantages:
- A single, universal driver would replace all existing, proprietary drivers (mssql, postgres...)
- Better performance due to not processing each row separately and tapping into pyarrow to avoid serialization/deserialization
Additional context https://arrow.apache.org/docs/dev/format/ADBC.html
P.S. Please do not attach files as it's considered a security risk. Add code snippets directly in the message body as much as possible.
The implementation for this is in progress for Postgresql (see development branch). However, we are currently blocked by this bug in Pandas: https://github.com/pandas-dev/pandas/issues/57539
Marking this issue as stale due to inactivity. This helps our maintainers find and focus on the active issues. If this issue receives no comments in the next 7 days it will automatically be closed.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
Marking this issue as stale due to inactivity. This helps our maintainers find and focus on the active issues. If this issue receives no comments in the next 7 days it will automatically be closed.