cloud-files icon indicating copy to clipboard operation
cloud-files copied to clipboard

Published 20 hours ago • verified publisher icon seung-lab

Multipart Uploads / Composite Uploads

Open william-silversmith opened this issue 4 years ago • 1 comments

It'd be nice if CF could transparently take advantage of multipart uploads for very large files.

https://docs.aws.amazon.com/AmazonS3/latest/dev/uploadobjusingmpu.html https://cloud.google.com/storage/docs/composite-objects

william-silversmith avatar Jul 09 '20 02:07 william-silversmith

For google, this capability seems to be you upload smaller individual files then compose them into a single unit. That could be pretty useful for multi-process upload, less so for multi-threaded upload.

william-silversmith avatar Aug 12 '20 05:08 william-silversmith

Resolved in https://github.com/seung-lab/cloud-files/pull/86 and https://github.com/seung-lab/cloud-files/pull/85

william-silversmith avatar Feb 18 '24 07:02 william-silversmith