aws-sdk-pandas

aws-sdk-pandas copied to clipboard

Ray Logging

16

### Feature - Add RayLogger class to instantiate logger object per Ray Task. ### Relates - #1551 By submitting this pull request, I confirm that my contribution is made under...

malachi-constant

Allow to pass in additional arguments to Timestream create table

1

It would be great if we could pass arguments through to the boto client in the `awswrangler.timestream.create_table` call See https://aws-sdk-pandas.readthedocs.io/en/stable/stubs/awswrangler.timestream.create_table.html#awswrangler.timestream.create_table At the moment, it is quite limited **Describe the solution...

farridav

### Describe the bug I discovered a number of issues to address while using Athena `unload_approach`: 1. `unload_approach` input argument does not exist for `athena.read_sql_table` 2. Database and table names...

jaidisido

Add support for 'tabix' formatted genomics/genetics data

4

**Geneticists and genomics scientists cannot natively get data from S3 when it's compressed using the most common format for that data type** Tabular data in genetics and genomics is often...

MattBrauer

feat: Pass additional partition projection params to wr.s3.to_parquet & cat…

2

Pass additional parititon projection params to wr.s3.to_parquet & catalog methods ### Feature or Bugfix - Feature ### Relates - #1613 By submitting this pull request, I confirm that my contribution...

kukushking

projection partitions in s3 to_parquet method

1

### Describe the bug I am using s3 to_parquet method to create a table in Glue catalog and store the data in the S3 bucket. I want to maintain partitions...

alekya1024

Hitting S3 Request Rate Limits

3

Hi all, we have an issue that is rather difficult to reproduce and diagnose. The question is: When executing `awswrangler.s3.to_parquet(dataset=True)`, what HTTP requests are executed, and is there a way...

liquidcarbon

Postgres JSONB field is (mostly) unsupported

3

### Describe the bug JSONB is an optimized version of JSON inside postgres. From the point of retrieval, it should behave the same way as normal JSON field. While trivial...

arogozhnikov

s3.read_parquet(map_types) handles int and string inconsistently

1

### Describe the bug `awswrangler.s3.read_parquet()` has the keyword argument `map_types`. In my understanding, it should decide whether awswrangler applies dtype mapping on top of the pandas schema that already exists...

marcelmindemann

Inconsistent argument names

1

Argument names seem inconsistent. In `athena.read_sql_query` we have arguments `database` and `ctas_database_name`, whereas in `athena.create_ctas_table` we have `database` and `ctas_database`. It seems that `_name` suffix would not be necessary. In...

vpietilainen