aws-sdk-pandas
aws-sdk-pandas copied to clipboard
filters for awswrangler.s3.read_parquet
A while back there was a thread requesting this feature. Any progress? It is quite unfortunate not being able to use filters directly as they are friendlier compared to partition_filter. (It is doubly confusing given the new name of awswrangler:)).
Hi @DRKolev-code thanks for opening this. As discussed here this would incur major refactoring of the library to use the new PyArrow Dataset API. We'll add it to the backlog.
Marking this issue as stale due to inactivity. This helps our maintainers find and focus on the active issues. If this issue receives no comments in the next 7 days it will automatically be closed.