minikube启动失败

[hgdhot]

重现问题所需的命令：minikube start --image-mirror-country=cn --registry-mirror=https://p9uapo9p.mirror.aliyuncs.com

失败的命令的完整输出：

Exiting due to K8S_INSTALL_FAILED: updating control plane: downloading binaries: downloading kubelet: download failed: https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.1/bin/linux/arm64/kubelet?checksum=file:https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.1/bin/linux/arm64/kubelet.sha256: getter: &{Ctx:context.Background Src:https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.1/bin/linux/arm64/kubelet?checksum=file:https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.1/bin/linux/arm64/kubelet.sha256 Dst:/home/work/.minikube/cache/linux/arm64/v1.24.1/kubelet.download Pwd: Mode:2 Umask:---------- Detectors:[0x3237278 0x3237278 0x3237278 0x3237278 0x3237278 0x3237278 0x3237278] Decompressors:map[bz2:0x3237278 gz:0x3237278 tar:0x3237278 tar.bz2:0x3237278 tar.gz:0x3237278 tar.xz:0x3237278 tar.zst:0x3237278 tbz2:0x3237278 tgz:0x3237278 txz:0x3237278 tzst:0x3237278 xz:0x3237278 zip:0x3237278 zst:0x3237278] Getters:map[file:0x40003da760 http:0x400147e1e0 https:0x400147e230] Dir:false ProgressListener:0x31f3150 Insecure:false DisableSymlinks:false Options:[0x14f9120]}: invalid checksum: Error downloading checksum file: bad response code: 404

minikube logs命令的输出：

使用的操作系统版本：Linux localhost.localdomain 5.11.12-300.el7.aarch64 #1 SMP Thu Aug 19 09:02:08 UTC 2021 aarch64 aarch64 aarch64 GNU/Linux

[hgdhot]

@denverdino 麻烦帮忙看下，谢谢

[hgdhot]

😄 minikube v1.24.0 on Centos 7.9.2009 (arm64) ✨ Automatically selected the docker driver 🎉 minikube 1.26.0 is available! Download it: https://github.com/kubernetes/minikube/releases/tag/v1.26.0 💡 To disable this notice, run: 'minikube config set WantUpdateNotification false'

✅ Using image repository registry.cn-hangzhou.aliyuncs.com/google_containers 👍 Starting control plane node minikube in cluster minikube 🚜 Pulling base image ... > registry.cn-hangzhou.aliyun...: 321.58 MiB / 321.58 MiB 100.00% 3.25 MiB 🔥 Creating docker container (CPUs=2, Memory=2200MB) ... 🐳 Preparing Kubernetes v1.22.3 on Docker 20.10.8 ...

❌ Exiting due to K8S_INSTALL_FAILED: updating control plane: downloading binaries: downloading kubelet: download failed: https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.22.3/bin/linux/arm64/kubelet?checksum=file:https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.22.3/bin/linux/arm64/kubelet.sha256: getter: &{Ctx:context.Background Src:https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.22.3/bin/linux/arm64/kubelet?checksum=file:https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.22.3/bin/linux/arm64/kubelet.sha256 Dst:/home/work/.minikube/cache/linux/v1.22.3/kubelet.download Pwd: Mode:2 Umask:---------- Detectors:[0x3083e58 0x3083e58 0x3083e58 0x3083e58 0x3083e58 0x3083e58 0x3083e58] Decompressors:map[bz2:0x3083e58 gz:0x3083e58 tar:0x3083e58 tar.bz2:0x3083e58 tar.gz:0x3083e58 tar.xz:0x3083e58 tar.zst:0x3083e58 tbz2:0x3083e58 tgz:0x3083e58 txz:0x3083e58 tzst:0x3083e58 xz:0x3083e58 zip:0x3083e58 zst:0x3083e58] Getters:map[file:0x4000a46400 http:0x40011c7b20 https:0x40011c7b40] Dir:false ProgressListener:0x3045b50 Insecure:false Options:[0x142bbc0]}: invalid checksum: Error downloading checksum file: bad response code: 404

[denverdino]

过去没有配置 arm64 的binary同步，我修改一下同步脚本。

[hgdhot]

好的多谢，多久能生效呢

[denverdino]

同步中，估计需要几个小时

[hgdhot]

麻烦再帮忙看下这个问题，想启动一个多节点的minikube, 启动了很长时间没有成功，拉镜像好像没有访问国内的仓库，谢谢 😄 [multinode-demo] minikube v1.24.0 on Centos 7.9.2009 (arm64) ✨ Using the docker driver based on existing profile 👍 Starting control plane node multinode-demo in cluster multinode-demo 🚜 Pulling base image ... 🏃 Updating the running docker "multinode-demo" container ... ❗ This container is having trouble accessing https://k8s.gcr.io 💡 To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/ ❗ The image 'k8s.gcr.io/coredns/coredns:v1.8.4' was not found; unable to add it to cache. ❗ The image 'k8s.gcr.io/kube-controller-manager:v1.22.3' was not found; unable to add it to cache. ❗ The image 'gcr.io/k8s-minikube/storage-provisioner:v5' was not found; unable to add it to cache. ❗ The image 'k8s.gcr.io/kube-scheduler:v1.22.3' was not found; unable to add it to cache. ❗ The image 'k8s.gcr.io/kube-proxy:v1.22.3' was not found; unable to add it to cache. ❗ The image 'k8s.gcr.io/pause:3.5' was not found; unable to add it to cache. ❗ The image 'k8s.gcr.io/etcd:3.5.0-0' was not found; unable to add it to cache. ❗ The image 'k8s.gcr.io/kube-apiserver:v1.22.3' was not found; unable to add it to cache. 🐳 Preparing Kubernetes v1.22.3 on Docker 20.10.8 ... ❌ Unable to load cached images: loading cached images: stat /home/work/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.22.3: no such file or directory 💢 initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1 stdout: [init] Using Kubernetes version: v1.22.3 [preflight] Running pre-flight checks [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

stderr: [WARNING Swap]: running with swap on is not supported. Please disable swap [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' error execution phase preflight: [preflight] Some fatal errors occurred: [ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-apiserver:v1.22.3: output: Error response from daemon: Get "https://k8s.gcr.io/v2/": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) , error: exit status 1 [ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-controller-manager:v1.22.3: output: Error response from daemon: Get "https://k8s.gcr.io/v2/": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) , error: exit status 1 [ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-scheduler:v1.22.3: output: Error response from daemon: Get "https://k8s.gcr.io/v2/": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) , error: exit status 1 [ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-proxy:v1.22.3: output: Error response from daemon: Get "https://k8s.gcr.io/v2/": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) , error: exit status 1 [ERROR ImagePull]: failed to pull image k8s.gcr.io/pause:3.5: output: Error response from daemon: Get "https://k8s.gcr.io/v2/": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) , error: exit status 1 [ERROR ImagePull]: failed to pull image k8s.gcr.io/etcd:3.5.0-0: output: Error response from daemon: Get "https://k8s.gcr.io/v2/": dial tcp 142.250.157.82:443: i/o timeout , error: exit status 1 [ERROR ImagePull]: failed to pull image k8s.gcr.io/coredns/coredns:v1.8.4: output: Error response from daemon: Get "https://k8s.gcr.io/v2/": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) , error: exit status 1 [preflight] If you know what you are doing, you can make a check non-fatal with --ignore-preflight-errors=... To see the stack trace of this error execute with --v=5 or higher

[denverdino]

启动命令？

[hgdhot]

minikube start --nodes 3 -p multinode-demo --image-mirror-country=cn

[ZongrongLi]

❌ Exiting due to K8S_INSTALL_FAILED: updating control plane: downloading binaries: downloading kubectl: download failed: https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.20.2/bin/linux/amd64/kubectl?checksum=file 还是404 这玩意行不行啊

[denverdino]

1.20 EOL in 28 Feb 2022 现在只同步了1.21之后的版本,