aws-sdk-pandas
aws-sdk-pandas copied to clipboard
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Par...
Hi Team, We're significant users of AWS and depend on aws-sdk-pandas for our research. Currently, the library does not support Numpy v2 which is blocking the upgrade of our environments....
### Describe the bug When trying to write a dataframe to an s3 path for which we don't have write permission, the access denied error is caught but another exception...
Reading the [documentation](https://aws-sdk-pandas.readthedocs.io/en/stable/tutorials/019%20-%20Athena%20Cache.html) I was expecting the Athena cache to work also with the unload_approach=True parameter, but looking at the code I see that it is not intended to work...
**Is your feature request related to a problem? Please describe.** I want the value to be indexed as string. instead it is indexed as an object **Describe the solution you'd...
Hello I'd like to implement a lambda in aws account A that connects to a Redshift cluster in aws account B using aws wrangler ```python import awswrangler as wr con_redshift...
### Describe the bug When I try to write a dataframe using `wr.s3.to_parquet()` method it often throws the following error on some columns: ``` UndetectedType Impossible to infer the equivalent...
**Is your idea related to a problem? Please describe.** Iceberg has a lot of nice features we'd like to use, and [AWS create table as supports it now out of...
### Describe the bug Unit tests are transiently failing with similar errors to below. One possible explanation is it is dropping a trailing 0, thus failing the test. This would...
Hi, Is it possible to specify a schema when trying to write data to an rds postgres database? During creation of the connection, for example: ```python rds_connection = wr.data_api.rds.RdsDataApi( resource_arn="arn:aws:rds:eu-west-2:XXXXXX:cluster:XXXXXX",...
### Describe the bug Methods such as `awswrangler.s3.to_parquet()` contain an `encryption_configuration` parameter (for encrypting the data), which [relies on dependencies](https://aws-sdk-pandas.readthedocs.io/en/stable/stubs/awswrangler.typing.ArrowEncryptionConfiguration.html#awswrangler.typing.ArrowEncryptionConfiguration) from `pyarrow.parquet.encryption`. However, these dependencies do not exist in the...