Sigurd Spieckermann

Seems related to iterative/dvc-http#27, although for me with GitLab's generic packages repository as the storage backend the upload fails after ~5 minutes without truncation. It would be interesting to understand...

Thanks for taking the time to reply to my issue, @skshetry! :pray: > [...] does it support uploads to arbitrary prefix? You've actually brought up a limitation of GitLab's generic...

@skshetry I've been doing some digging and _think_ the error originates from the [AIOHTTP client timeout configuration in `dvc-objects`](https://github.com/iterative/dvc-objects/blob/ebee28733103ac2b13c5207f640394ff03603699/src/dvc_objects/fs/implementations/http.py#L116-L121) where the [`sock_read=self.REQUEST_TIMEOUT`](https://github.com/iterative/dvc-objects/blob/ebee28733103ac2b13c5207f640394ff03603699/src/dvc_objects/fs/implementations/http.py#L120) setting seems to cause the timeout after exactly...

@skshetry Thanks for the pointers, I hadn't seen those issues. In that case, disabling all timeouts seems to be only a workaround for cases that don't suffer from the random...

@skshetry When I don't set the timeout, it takes ~15 minutes, and the transfer succeeds then. I have an upload bandwidth of ~10 Mbit/s. When I upload smaller files which...

~~I just noticed that the upload using `requests` succeeded, i.e. the file is present in GitLab's generic packages repository, although a timeout exception was raised. :thinking:~~

@skshetry Sorry, I copied the output before cURL was actually done, somehow not thinking it would contain helpful information. :man_facepalming: I've edited the above comment with the server response output.

@skshetry The `httpx`-based upload script also fails with a timeout exception after ~15 minutes: ```shell-session $ python upload_httpx.py Traceback (most recent call last): File "/httpcore/_exceptions.py", line 8, in map_exceptions yield...

> @sisp, my understanding about `sock_read` timeout is that it's a timeout waiting to read the data. @skshetry I'm wondering, isn't it expected that this timeout kicks in when a...

@skshetry In addition to my previous suggestion, or as an alternative one, how about adding support for [chunked transfer encoding](https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Transfer-Encoding#chunked_encoding)? I've adapted the `requests`-based upload script to use chunked transfer...