object-store-python icon indicating copy to clipboard operation
object-store-python copied to clipboard

Published 20 hours ago • verified publisher icon roeap

Add support for put_multipart

Open rupurt opened this issue 1 year ago • 4 comments

Howdy,

Love the bindings so far! Are there any plans to add support for put_multipart?

Cheers

rupurt avatar Apr 05 '24 21:04 rupurt

I've started a PR to try and add these functions in https://github.com/roeap/object-store-python/pull/14. Do you have any suggestions or docs on how I should be adding these?

rupurt avatar Apr 05 '24 22:04 rupurt

Is there a limitation on uploaded object size given that multipart upload is not part of API?

arogozhnikov avatar Aug 05 '24 17:08 arogozhnikov

there should not be other then the upstream store. of course very large objects can always fail since there is more room for network errors during a large time period ..

That said, multi-part uploads mainly allow for parallelizing the upload and should have a significant performance impact on large amounts of data - especially for single very large files.

roeap avatar Aug 05 '24 20:08 roeap

there should not be other then the upstream store

thx, good to know (just thinking out loud: then for S3 that's 5GB max)

arogozhnikov avatar Aug 05 '24 20:08 arogozhnikov