s5cmd icon indicating copy to clipboard operation
s5cmd copied to clipboard

Feature request: limit upload and download bandwidth

Open lilianabiven opened this issue 2 years ago • 4 comments

s5cmd is a very fast tool but sometimes it can be too fast. We're using it to upload backups of production servers, but it takes almost all the bandwidth available, therefore not leaving enough bandwidth for the other services running on the host. A command line argument to limit the bandwidth usage would be great, similar to s3cmd's --limit-rate

lilianabiven avatar Apr 11 '22 07:04 lilianabiven

There is on option on the cp command called --concurrency. I use it to make copies faster, but you can also use it to make transfers slower by forcing a low number of concurrent connections. "cp --concurrency 10" for example. The only place the --concurrency option is shown is in the release notes for the 1.0.0 version. I wish they would add it to the documentation!

mikefarace avatar May 03 '22 10:05 mikefarace

Thank you @mikefarace I will experiment with this flag, it seems to be what we need.

lilianabiven avatar May 03 '22 10:05 lilianabiven

@lilianabiven Hi, do you still need this --limit-rate flag? Does --concurrency flag works for you?

ilkinulas avatar Jun 27 '22 13:06 ilkinulas

Hi @ilkinulas, the --concurrency could do the job but a --limit-rate flag would be much easier to use as we could directly input a bandwidth value, instead of having to find the right --concurrency value for our bandwidth.

lilianabiven avatar Jun 30 '22 08:06 lilianabiven