aws-sdk-pandas

aws-sdk-pandas copied to clipboard

*P.S. Please do not attach files as it's considered a security risk. Add code snippets directly in the message body as much as possible.*

malachi-constant

**Is your feature request related to a problem? Please describe.** Ensure `wr.s3.read_parquet` runs at scale leveraging Ray **Additional context** This is part of the Wrangler @ Scale release **Links** -...

jaidisido

Timestream write ray support

35

### Feature or Bugfix - Feature - Refactoring ### Detail - Ray support for timestream write - num_threads argument changed to use_threads to be consistent with the rest of awswrangler...

cnfait

Wrangler to support Hudi/Iceberg datasets read/write

8

**Is your idea related to a problem? Please describe.** No **Describe the solution you'd like** It would be good to have support for CDC data lake formats like Apache Hudi,...

anandshah123

LOCK parameter in to_sql/copy

3

Currently using wr.redshift.to_sql/copy() to store data to redshift in an airflow pipeline, where multiple dags write to the same table. I run into this serializable isolation error: `Serializable isolation violation...

aeeladawy

Length mismatch when using read_parquet chunked

11

**Describe the bug** When reading a large parquet file from S3 using read_parquet, I get errors like `ValueError: Length mismatch: Expected axis has 75536 elements, new values have 6741043 elements`....

samjeckert

Disable Scan selects for parquet files

9

### Feature or Bugfix - Bugfix ### Detail - S3 SELECT queries with a Scan range don't really make sense for parquet files, that's why we should fall back to...

maxispeicher

Add ability to write DF as a bulk load job in Amazon Neptune

5

**Is your idea related to a problem? Please describe.** Add ability to load/update data from a data frame via the bulk loader. **Describe the solution you'd like** The fastest way...

bechbd

wr.s3.read_parquet() errors if any files are missing

6

**Is your idea related to a problem? Please describe.** Currently when using `wr.s3.read_parquet(path=list_of_paths)` with a list of file paths, if any individual file does not exist, the following error is...

dhorkel

aws wrangler preprocessing regex strings in query causing query to error

4

**Describe the bug** Query regex expressions with a double backslash will cause the query to error when executed by `awswrangler.athena.read_sql_query()`. But the same query run in the Athena console will...

jconwell