rancher icon indicating copy to clipboard operation
rancher copied to clipboard

[BUG]

Open mbathe19 opened this issue 2 years ago • 12 comments

Rancher Server Setup

  • Rancher version: rancher/rancher:latest (2.7.5)
  • Installation option (Docker install/Helm Chart): docker
    • If Helm Chart, Kubernetes Cluster and version (RKE1, RKE2, k3s, EKS, etc):
  • Proxy/Cert Details:

Information about the Cluster

  • Kubernetes version:
  • Cluster Type (Local/Downstream):
    • If downstream, what type of cluster? (Custom/Imported or specify provider for Hosted/Infrastructure Provider):

User Information

  • What is the role of the user logged in? (Admin/Cluster Owner/Cluster Member/Project Owner/Project Member/Custom)
    • If custom, define the set of permissions:

Describe the bug

Hey trying to get rancher up in running, unfortunately its not getting up because of the following errors. Tried different version with the same result. Is there a problem with: https://git.rancher.io?

fatal: unable to access 'https://git.rancher.io/system-charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/07/13 12:29:38 [ERROR] error syncing 'library': handler catalog: Update failed: fatal: unable to access 'https://git.rancher.io/charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/07/13 12:29:51 [ERROR] error syncing 'system-library': handler catalog: Clone failed: Cloning into 'management-state/catalog-cache/6bda4fa402575032915dc735ad66131a2f8a36ff38c6fb593402ad315fbfdf85'...
fatal: unable to access 'https://git.rancher.io/system-charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/07/13 12:30:12 [ERROR] error syncing 'library': handler catalog: Update failed: fatal: unable to access 'https://git.rancher.io/charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/07/13 12:30:22 [ERROR] error syncing 'system-library': handler catalog: Clone failed: Cloning into 'management-state/catalog-cache/6bda4fa402575032915dc735ad66131a2f8a36ff38c6fb593402ad315fbfdf85'...
fatal: unable to access 'https://git.rancher.io/system-charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/07/13 12:30:47 [ERROR] error syncing 'library': handler catalog: Update failed: fatal: unable to access 'https://git.rancher.io/charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/07/13 12:30:53 [ERROR] error syncing 'system-library': handler catalog: Clone failed: Cloning into 'management-state/catalog-cache/6bda4fa402575032915dc735ad66131a2f8a36ff38c6fb593402ad315fbfdf85'...
fatal: unable to access 'https://git.rancher.io/system-charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/07/13 12:31:21 [ERROR] error syncing 'library': handler catalog: Update failed: fatal: unable to access 'https://git.rancher.io/charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/07/13 12:31:25 [ERROR] error syncing 'system-library': handler catalog: Clone failed: Cloning into 'management-state/catalog-cache/6bda4fa402575032915dc735ad66131a2f8a36ff38c6fb593402ad315fbfdf85'...
fatal: unable to access 'https://git.rancher.io/system-charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/07/13 12:31:58 [ERROR] error syncing 'system-library': handler catalog: Clone failed: Cloning into 'management-state/catalog-cache/6bda4fa402575032915dc735ad66131a2f8a36ff38c6fb593402ad315fbfdf85'...
fatal: unable to access 'https://git.rancher.io/system-charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/07/13 12:32:04 [ERROR] error syncing 'library': handler catalog: Update failed: fatal: unable to access 'https://git.rancher.io/charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/07/13 12:32:29 [ERROR] error syncing 'system-library': handler catalog: Clone failed: Cloning into 'management-state/catalog-cache/6bda4fa402575032915dc735ad66131a2f8a36ff38c6fb593402ad315fbfdf85'...
fatal: unable to access 'https://git.rancher.io/system-charts/': The requested URL returned error: 502
: exit status 128, requeuing

To Reproduce

Result

Expected Result

Screenshots

Additional context

If you need more informations let me know. Regards,

Michel

mbathe19 avatar Jul 13 '23 12:07 mbathe19

Even i do have the same issue.

time="2023-07-17T17:09:18Z" level=error msg="error syncing 'rancher-partner-charts': handler helm-clusterrepo-ensure: git -C /var/lib/rancher-data/local-catalogs/v2/rancher-partner-ch │ │ arts/8f17acdce9bffd6e05a58a3798840e408c4ea71783381ecd2e9af30baad65974 fetch origin -- 53b05e3afbc42f183efc9e61a6484171b3abc579 error: exit status 128, detail: fatal: unable to access │ │ 'https://git.rancher.io/partner-charts/': The requested URL returned error: 502\n, requeuing" │

Also if i clone the repo, I ended up with fatal error

git clone --depth=1 -n --branch master https://git.rancher.io/partner-charts Cloning into 'partner-charts'... fatal: unable to access 'https://git.rancher.io/partner-charts/': The requested URL returned error: 502

SS: image

gajapathi28 avatar Jul 18 '23 11:07 gajapathi28

👍🏼 ⬆️ same issue - bump to get attention on this

00r2 avatar Aug 29 '23 14:08 00r2

Another me too. Saw on Rancher 2.7.5. then downgraded to 2.7.2 and still saw it. Then it started working again.

jmckeown2 avatar Sep 22 '23 20:09 jmckeown2

Same here. I'm submitting a support ticket to see how to fix.

jcox10 avatar Sep 22 '23 21:09 jcox10

Today it is working fine for me, I'm not getting 502 errors. Maybe the git repo was offline and now it is fixed?

jcox10 avatar Sep 25 '23 21:09 jcox10

I am seeing the same now on v2.7.9, which is the current latest

2023/12/04 14:32:31 [INFO] Updating global catalog system-library
2023/12/04 14:32:32 [ERROR] error syncing 'library': handler catalog: Clone failed: Cloning into 'management-state/catalog-cache/380859f1003fe7603cddc6c15b34b7263f1f0deaa92ddcde465811d032ee7078'...
error: RPC failed; HTTP 502 curl 22 The requested URL returned error: 502
fatal: the remote end hung up unexpectedly
: exit status 128, requeuing
2023/12/04 14:32:33 [ERROR] error syncing 'library': handler catalog: Clone failed: Cloning into 'management-state/catalog-cache/380859f1003fe7603cddc6c15b34b7263f1f0deaa92ddcde465811d032ee7078'...
fatal: unable to access 'https://git.rancher.io/charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/12/04 14:32:34 [ERROR] error syncing 'library': handler catalog: Clone failed: Cloning into 'management-state/catalog-cache/380859f1003fe7603cddc6c15b34b7263f1f0deaa92ddcde465811d032ee7078'...
fatal: unable to access 'https://git.rancher.io/charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/12/04 14:32:34 [ERROR] error syncing 'library': handler catalog: Clone failed: Cloning into 'management-state/catalog-cache/380859f1003fe7603cddc6c15b34b7263f1f0deaa92ddcde465811d032ee7078'...
fatal: unable to access 'https://git.rancher.io/charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/12/04 14:32:35 [ERROR] error syncing 'library': handler catalog: Clone failed: Cloning into 'management-state/catalog-cache/380859f1003fe7603cddc6c15b34b7263f1f0deaa92ddcde465811d032ee7078'...
fatal: unable to access 'https://git.rancher.io/charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/12/04 14:32:36 [INFO] Catalog sync done. 7 templates created, 0 templates updated, 0 templates deleted, 0 templates failed
2023/12/04 14:32:37 [ERROR] error syncing 'library': handler catalog: Clone failed: Cloning into 'management-state/catalog-cache/380859f1003fe7603cddc6c15b34b7263f1f0deaa92ddcde465811d032ee7078'...
fatal: unable to access 'https://git.rancher.io/charts/': The requested URL returned error: 502
: exit status 128, requeuing
2023/12/04 14:32:40 [INFO] Updating global catalog helm3-library
2023/12/04 14:32:41 [INFO] Helm icon error: open management-state/catalog-cache/f341cfdfa521a9aa2b993cb34b26bb91b2d173ef1a7df8d41b8921b0e4f82788/charts/mariadb/mariadb-stack-220x234.png: no such file or directory
2023/12/04 14:32:41 [INFO] Catalog sync done. 11 templates created, 0 templates updated, 0 templates deleted, 0 templates failed
2023/12/04 14:32:43 [ERROR] error syncing 'library': handler catalog: Clone failed: Cloning into 'management-state/catalog-cache/380859f1003fe7603cddc6c15b34b7263f1f0deaa92ddcde465811d032ee7078'...
fatal: unable to access 'https://git.rancher.io/charts/': The requested URL returned error: 502

jiridoko avatar Dec 04 '23 14:12 jiridoko

Rancher 2.9, same issue

alexsalex avatar Jul 19 '24 01:07 alexsalex

Rancher 2.8, having the same issue

ricardosilva86 avatar Jul 23 '24 07:07 ricardosilva86

Same Issue with latest -> V2.9 (31.07.2024)

max5800 avatar Jul 31 '24 12:07 max5800

how I managed to fix that: sudo echo "nameserver 192.168.1.1" >> /etc/resolv.conf it was an issue with not resolving on the DNS ;)

ricardosilva86 avatar Aug 06 '24 20:08 ricardosilva86

how I managed to fix that: sudo echo "nameserver 192.168.1.1" >> /etc/resolv.conf it was an issue with not resolving on the DNS ;)

I don't think thats the solution. The "https://git.rancher.io" can be resolved. "https://git.rancher.io/system-charts/" gets me a 404, this is a dead link and not a DNS Problem.

max5800 avatar Aug 06 '24 20:08 max5800

Rancher 2.8.5

2024/08/29 01:02:11 [ERROR] error syncing 'rancher-partner-charts': handler helm-clusterrepo-download: update failure: Repo [https://git.rancher.io/partner-charts] is not accessible: Get "https://git.rancher.io/repos/partner-charts/commits/main": net/http: TLS handshake timeout, requeuing
2024/08/29 01:02:18 [ERROR] error syncing 'rancher-partner-charts': handler helm-clusterrepo-download: update failure: git -C /var/lib/rancher-data/local-catalogs/v2/rancher-partner-charts/8f17acdce9bffd6e05a58a3798840e408c4ea71783381ecd2e9af30baad65974 fetch origin -- main error: exit status 128, detail: fatal: unable to access 'https://git.rancher.io/partner-charts/': The requested URL returned error: 502
, requeuing
2024/08/29 01:02:28 [ERROR] error syncing 'rancher-partner-charts': handler helm-clusterrepo-download: update failure: Repo [https://git.rancher.io/partner-charts] is not accessible: Get "https://git.rancher.io/repos/partner-charts/commits/main": net/http: TLS handshake timeout, requeuing
2024/08/29 01:02:32 [ERROR] error syncing 'rancher-partner-charts': handler helm-clusterrepo-download: update failure: git -C /var/lib/rancher-data/local-catalogs/v2/rancher-partner-charts/8f17acdce9bffd6e05a58a3798840e408c4ea71783381ecd2e9af30baad65974 fetch origin -- main error: exit status 128, detail: fatal: unable to access 'https://git.rancher.io/partner-charts/': The requested URL returned error: 502
, requeuing

zlingqu avatar Aug 29 '24 01:08 zlingqu

Same here with Rancher "stable" 2.9.1

2024/09/05 07:21:51 [ERROR] error syncing 'helm3-library': handler catalog: Clone failed: Cloning into 'management-state/catalog-cache/f341cfdfa521a9aa2b993cb34b26bb91b2d173ef1a7df8d41b8921b0e4f82788'...
fatal: unable to access 'https://git.rancher.io/helm3-charts/': OpenSSL/3.1.4: error:80000002:system library::No such file or directory

And from my browser the URL is not reachable too.

Sispheor avatar Sep 05 '24 07:09 Sispheor

Rancher v2.8.5 time="2024-12-19T00:13:28Z" level=error msg="error syncing 'rancher-partner-charts': handler helm-clusterrepo-download: update failure: git -C /var/lib/rancher-data/local-catalogs/v2/rancher-partner-charts/8f17...5974 fetch origin -- main error: exit status 128, detail: fatal: unable to access 'https://git.rancher.io/partner-charts/': The requested URL returned error: 502\n, requeuing"

Actually it's possible to clone, but it's very slow.

$ git clone --depth 1 --single-branch https://git.rancher.io/partner-charts/
Cloning into 'partner-charts'...
remote: Counting objects: 23405, done.
remote: Compressing objects: 100% (9835/9835), done.
Receiving objects:   6% (1482/23405), 115.00 MiB | 1.07 MiB/s

vonhutrong avatar Dec 19 '24 06:12 vonhutrong

Rancher v2.10.3 fatal: unable to access 'https://git.rancher.io/charts/': The requested URL returned error: 502 fatal: unable to access 'https://git.rancher.io/system-charts/': The requested URL returned error: 502

andesonik avatar Mar 04 '25 11:03 andesonik