Please support using multiple tcp connection for file downloading/uploading

[ytrezq]

My isp is throttling per tcp connection speed.

So that in my case using rclone copy folder onedrive: is capped at around 100Mb/s

But if I do that same copy using multiple rclone mount using different cache dir and mount points then I’m getting an equivalent amount of 100Mb/s per mount point through splitting the upload through several copies.

It would be great that instead of dealing with several rclone commands I would be to use a single rclone copy myfolder onedrive: but with using a --concurrent-connection 4 option or even go further by adding the ability to use this with several network interfaces matching different isp.

[ytrezq]

This is really about using several connections as transferring several files at once over the same connection (increasing --transfer beyond default value) doesn’t change the transfer rate unlike using several rclone commands.

[ncw]

Using --transfer should increase the number of connection in use unless onedrive is connecting via HTTP/2.

If you take a look at a transfer with -vv --dump headers then you'll be able to see whether HTTP/2 is in use.

A global flag to disable HTTP/2 would probably be a good idea if so...

[ytrezq]

@ncw it’s http 1.1 already. So this isn’t related.

[ncw]

If it is http 1.1 then it should be using 1 TCP connection per file or download thread which is what you wanted.

Can you try this beta with the --disable-http2 flag? Then multi thread downloads should each use their own TCP stream as wil --transfers.

v1.56.0-beta.5411.6c0e25033.fix-5253-disable-http2 on branch fix-5253-disable-http2 (uploaded in 15-30 mins)

[ncw]

Any luck with --disable-http2 ?

[ytrezq]

@ncw as I said, http2 was already disabled, so it s something else.

[ncw]

I was hoping you'd try that flag anyway if you've got time - thanks.

[ghost]

fwiw i've been having some issues with onedrive being able to get remotely close to my gigabit speed on downloads (it's been doing a max of about 8-10 MB/s with http2).

On this version however, with http2 disabled, it's getting over 100 MB/s.

[ncw]

fwiw i've been having some issues with onedrive being able to get remotely close to my gigabit speed on downloads (it's been doing a max of about 8-10 MB/s with http2).

On this version however, with http2 disabled, it's getting over 100 MB/s.

That is good to know thanks.

I've merged that flag to master now which means it will be in the latest beta in 15-30 minutes and released in v1.56

[ytrezq]

@ncw also, https://beta.rclone.org/branch/fix-5253-disable-http2/v1.56.0-beta.5411.6c0e25033.fix-5253-disable-http2/ is lacking linux static builds.

[ncw]

That flag is now in the latest beta so you don't need that branch any more @ytrezq

[xiahuaijia]

I had the same problem with my nginx webdav The number of tcp connections is always only one with nginx http2 enabled

the --disable-http2 option worked for me, but it doesn't seem to be updated in the documentation rclone.org/docs

[ncw]

the --disable-http2 option worked for me, but it doesn't seem to be updated in the documentation rclone.org/docs

You are right, it isn't...

I've added a bit of docs for that which will go live on the website when 1.58 is released.

[ncw]

Note that this is likely caused by https://github.com/golang/go/issues/37373 if adding --disable-http2 makes things run quicker