docker-gitlab icon indicating copy to clipboard operation
docker-gitlab copied to clipboard

Image registry error when layer is larger than 1GB

Open hegedussz opened this issue 1 year ago • 1 comments

The docker push failed when the layer is larger than 1 GB.

Storage is set to S3 (MinIO). The chunk size has been increased.

REGISTRY_STORAGE_S3_CHUNKSIZE: 514288000

I see that during upload the size of the root disk under GitLab is reduced. Probably the tmp file is placed in /var/lib/nginx/body.

Is there a way to set the proxy_request_buffering variable in the gitlab-registry nginx conf file?

GitLab version: 16.3.0 (sameersbn/gitlab:16.3.0) Registry version: registry:2.8.2

hegedussz avatar Sep 01 '23 16:09 hegedussz

Are you running your instance in front of CloudFlare or a similar service? If so, please check that you are not proxying. Many of these proxying services, like CloudFlare, have an upload limit. For example, I'm using CloudFlare free DNS; I disabled the CloudFlare proxy and used raw DNS forward because the free CloudFlare DNS proxying service has an upload limit of 100MB. When I updated my DNS record for raw export and turned off the proxying, the upload went through without a hitch. I hope this helps you. To find your issue, please draw an exact network path of your setup, including services like CloudFlare.

CloudFlare is known to cause issues like this; however, it's hard to find because only a few people know about the 100MB upload size limit when using the CloudFlare free DNS upload limit.

Screenshot 2023-11-27 at 13 24 31

gjrtimmer avatar Nov 27 '23 05:11 gjrtimmer