aws-sdk-pandas icon indicating copy to clipboard operation
aws-sdk-pandas copied to clipboard

filters for awswrangler.s3.read_parquet

Open DRKolev-code opened this issue 1 year ago • 1 comments

A while back there was a thread requesting this feature. Any progress? It is quite unfortunate not being able to use filters directly as they are friendlier compared to partition_filter. (It is doubly confusing given the new name of awswrangler:)).

DRKolev-code avatar Apr 19 '24 13:04 DRKolev-code

Hi @DRKolev-code thanks for opening this. As discussed here this would incur major refactoring of the library to use the new PyArrow Dataset API. We'll add it to the backlog.

kukushking avatar May 17 '24 18:05 kukushking

Marking this issue as stale due to inactivity. This helps our maintainers find and focus on the active issues. If this issue receives no comments in the next 7 days it will automatically be closed.

github-actions[bot] avatar Jul 17 '24 03:07 github-actions[bot]