skyplane icon indicating copy to clipboard operation
skyplane copied to clipboard

[small] Parallelize multipart-upload requests in `ReplicatorClient`

Open sarahwooders opened this issue 2 years ago • 0 comments

The object store call obj_store_interface.initiate_multipart_upload(dest_obj) is not parallelized and is a bottleneck for large numbers of chunks per object. The calls initiate the multipart uploads should be parallelized.

sarahwooders avatar May 03 '22 02:05 sarahwooders