aws-sdk-pandas icon indicating copy to clipboard operation
aws-sdk-pandas copied to clipboard

Requests for Additional Argument `name_function` on `awswrangler.s3.to_parquet()`

Open JaeryunYim opened this issue 1 year ago • 2 comments

Describe the solution you'd like I hope that awswrangler.s3.to_parquet() method has an argument similar to name_function of dask.dataframe.to_parquet() for the case of dataset=True and partition_cols is set. For me, the existing argument filename_prefix is not enough because each partitioned filename always contains some hash value which I don't want. https://docs.dask.org/en/stable/generated/dask.dataframe.to_parquet.html

JaeryunYim avatar May 03 '24 06:05 JaeryunYim

Thanks for opening this @JaeryunYim. Added to the backlog.

kukushking avatar May 17 '24 18:05 kukushking

Marking this issue as stale due to inactivity. This helps our maintainers find and focus on the active issues. If this issue receives no comments in the next 7 days it will automatically be closed.

github-actions[bot] avatar Aug 17 '24 12:08 github-actions[bot]