aws-sdk-pandas

aws-sdk-pandas copied to clipboard

Why doesn't postgresql.to_sql support a TRUNCATE overwrite_method?

1

I've mostly used the SDK for loading data into Redshift, so I surprised to learn that postgresql.to_sql doesn't support a TRUNCATE overwrite_method. I need to preserve table indexes, so dropping...

senorcinco

Data is not being totally written with append using awswrangler to_deltalake with multiple lambdas running in parallel

1

### Describe the bug We created an empty delta table with pyspark so that it can be appended with awswrangler's **to_deltalake** method with lambdas running in parallel. But when we...

camposvinicius

filters for awswrangler.s3.read_parquet

1

A while back there was a thread requesting this feature. Any progress? It is quite unfortunate not being able to use `filters` directly as they are friendlier compared to `partition_filter`....

DRKolev-code

Provide option to skip commit in postgresql.to_sql to allow usage of transactions

1

**Is your idea related to a problem? Please describe.** Currently, if there are no exceptions when calling awswrangler.postgresql.to_sql then commit is automatically done: https://github.com/aws/aws-sdk-pandas/blob/b13fcd8d169feb3219b4b4fff025dc6089cfe03b/awswrangler/postgresql.py#L359 It makes it impossible to use...

Salatich

feat: add ArrowDBC module

23

### Feature or Bugfix - Feature ### Detail - Add module which makes use of the [Arrow Database Connectivity](https://arrow.apache.org/docs/dev/format/ADBC.html) ### Relates - #1756 By submitting this pull request, I confirm...

LeonLuttenberger

Cannot write parquet in an S3 path that includes white spaces when using ray

1

When using ray, trying to write a parquet file to a path that includes spaces an error is returned. i.e. `ArrowInvalid: Expected a local filesystem path, got a URI: 's3://mybucket/path...

andreaschiappacasse

**Is your idea related to a problem? Please describe.** A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] [athena.unload](https://aws-sdk-pandas.readthedocs.io/en/stable/stubs/awswrangler.athena.unload.html#awswrangler-athena-unload)、[athena.read_sql_query](https://aws-sdk-pandas.readthedocs.io/en/stable/stubs/awswrangler.athena.read_sql_query.html#awswrangler-athena-read-sql-query) and [athena.start_query_execution](https://aws-sdk-pandas.readthedocs.io/en/stable/stubs/awswrangler.athena.start_query_execution.html#awswrangler-athena-start-query-execution) supports [client-side...

tk09291197

Question regarding wr.athena.to_iceberg

4

I am having a hard time trying to figure where the to_iceberg method tries to create and subsequently destroy the temporary table needed for the INSERT INTO … SELECT statement....

rossiellog

chore(deps): bump the production-dependencies group across 1 directory with 9 updates

6

Bumps the production-dependencies group with 9 updates in the / directory: | Package | From | To | | --- | --- | --- | | [boto3](https://github.com/boto/boto3) | `1.34.74` |...

dependabot[bot]

AWS SDK support for Timestream influxDB

1

Whether timestreamDB API influxDB?

sanjivjha