nextcloud
Feature Request: Limit amount of parallel up-/downloads
Especially for Nextcloud on a weaker hardware (such as Raspberry Pis) it would be nice if we could limit the amount of parallel uploads or downloads (not just the bandwidth).
Expected behaviour
If the number of parallel uploads is set to 1: Just one file is uploaded to the server at the same time. The upload of file #II starts after upload of file #I has finished.
If the number is set to 2: A maximum of two files is uploaded simultaneously..
...
Actual behaviour
We can only limit the bandwidth used, not the number of parallel uploads. On e.g. a Raspberry Pi this means we have to move files into the synchronised folder one by one to avoid a server hiccup sometimes.
Steps to reproduce
Put many files into a synchronised folder at once. The client will immidiately start to upload many of them at once. If the server is not capable of handling that many requests at the same time it will at least heavily slow down.
Client configuration
Client version: 2.5.1final
Operating system: Windows
OS language: German
Server configuration
Operating system:
Web server: Raspbian
Nextcloud version: 14
Storage backend (external storage): External HDD
+1 on this feature. I'm working with very large files, and I want to process them ASAP. I use Nextcloud to synchronize files (rather than serial copying), because I also need multi-platform support, overnight queuing, and automatic resume if the connection drops. I'd like to queue up dozens of files ranging from 1-10GB, but if I queue up a bunch, it always uploads exactly three files at a time. My upstream bandwidth is only 700KB/s, so if it's trying to synchronize three 10GB files, I have to wait 12 hours, and then all three files will complete simultaneously. I would much rather have one file complete every four hours.
In a typical single-network-connection bandwidth-limited scenario, which is surely the most common Nextcloud use case, I can't think of a good reason for concurrent uploads rather than serial uploads. I think it's good to support concurrent uploads, but it's important (and trivial) to allow the user to control this.
I have the same issue - low bandwidth and some large files, often with time-outs. It can take more than 12 hours to download a 4gb file (not all of us have fast broadband available).
Since the 90s (or earlier?) we've had the ability to "resume" file transfers. Even if you cannot figure out a way to allow us to transfer one file at a time, at least save the part-file and resume it later!
[EDIT a few days later - I have 2 files (one a 4gb panorama, the other a 2gb movie) that are STILL trying to download from weeks before I wrote this message. Why? Nextcloud has decided that many are "conflict files" despite the same date, checksum, size, location, name etc. No 'resume' function means that after 15 or more hours my connection might go down, and those files have to be started yet again, as they have been for the last few weeks. So 3 issues, too many files being downloaded simultaneously means no one file can complete. No resume function means if the connection is lost on a large file, the whole transfer has to start again, and those damned conflict files because something gets screwed up and Nextcloud cannot tell there is no difference between files. Right now I am glad I've not made a donation!]
Hi,
is there anything new in this regard ? I was looking for the same thing and found this quite old thread.
@ksapp-dell No there is nothing planned at the moment. However, you are welcome to implement this feature:)
Hi,
Ok. I can imagine how much work this is. Unfortunately I am really bad in programming. I did this very long time ago in the late 80's so I think that I can not help a lot here and take the role of the user (-;
You could simply decrease the value of OWNCLOUD_MAX_PARALLEL environment variable from 6 (default) to 2, e.g.
You could simply decrease the value of OWNCLOUD_MAX_PARALLEL environment variable from 6 (default) to 2, e.g.
That does not work to limit the max parallel upload from a web client
Still relevant I use my nextcloud to synchronise roms or videofiles, sometimes these files are up to 20gb-50gb each which is really annoying if there are multiple files synced at the same time, especially on slower devices/sdcards
