Kind extension unable to create a cluster
Bug description
I had a need to completely recreate my podman-machine-default instance and once I got everything updated, kind was unable to create a cluster for me. It went through the motions of ensuring the node image, preparing the node, writing the configuration, and starting the control-plane. This final step eventually fails.
After preparing to copy the log, I finally noticed that kind is calling docker to verify that the node came up.
I have docker installed and configured with multiple contexts to manage the several remote nodes in our network. kind was installing it's node and then checking the remote node for health... none of the necessary software existed on that node.
Operating system
Windows 11 Pro 23H3 (10.0.22631.3155)
Installation Method
Winget (Windows)
Version
1.7.0
Steps to reproduce
- Configure docker to use a remote, pure docker host without necessary podman desktop configurations
- run
kind init - wait for 'starting control-plane' to time out
Relevant log output
⯠kind create cluster --name cluster
Creating cluster "cluster" ...
â Ensuring node image (kindest/node:v1.27.1) đŧ
â Preparing nodes đĻ
â Writing configuration đ
â Starting control-plane đšī¸
Deleted nodes: ["cluster-control-plane"]
ERROR: failed to create cluster: failed to init node with kubeadm: command "docker exec --privileged cluster-control-plane kubeadm init --skip-phases=preflight --config=/kind/kubeadm.conf --skip-token-print --v=6" failed with error: exit status 1
Command Output: I0314 15:25:26.216004 236 initconfiguration.go:255] loading configuration from "/kind/kubeadm.conf"
W0314 15:25:26.217624 236 initconfiguration.go:332] [config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=JoinConfiguration
[init] Using Kubernetes version: v1.27.1
[certs] Using certificateDir folder "/etc/kubernetes/pki"
I0314 15:25:26.237103 236 certs.go:112] creating a new certificate authority for ca
[certs] Generating "ca" certificate and key
I0314 15:25:26.462340 236 certs.go:519] validating certificate period for ca certificate
[certs] Generating "apiserver" certificate and key
[certs] apiserver serving cert is signed for DNS names [cluster-control-plane kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 172.18.0.2 127.0.0.1]
[certs] Generating "apiserver-kubelet-client" certificate and key
I0314 15:25:26.804138 236 certs.go:112] creating a new certificate authority for front-proxy-ca
[certs] Generating "front-proxy-ca" certificate and key
I0314 15:25:26.929822 236 certs.go:519] validating certificate period for front-proxy-ca certificate
[certs] Generating "front-proxy-client" certificate and key
I0314 15:25:27.039907 236 certs.go:112] creating a new certificate authority for etcd-ca
[certs] Generating "etcd/ca" certificate and key
I0314 15:25:27.352954 236 certs.go:519] validating certificate period for etcd/ca certificate
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [cluster-control-plane localhost] and IPs [172.18.0.2 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [cluster-control-plane localhost] and IPs [172.18.0.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
I0314 15:25:28.249978 236 certs.go:78] creating new public/private key files for signing service account users
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0314 15:25:28.357250 236 kubeconfig.go:103] creating kubeconfig file for admin.conf
[kubeconfig] Writing "admin.conf" kubeconfig file
I0314 15:25:28.404295 236 kubeconfig.go:103] creating kubeconfig file for kubelet.conf
[kubeconfig] Writing "kubelet.conf" kubeconfig file
I0314 15:25:28.520138 236 kubeconfig.go:103] creating kubeconfig file for controller-manager.conf
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0314 15:25:29.022128 236 kubeconfig.go:103] creating kubeconfig file for scheduler.conf
[kubeconfig] Writing "scheduler.conf" kubeconfig file
I0314 15:25:29.105490 236 kubelet.go:67] Stopping the kubelet
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
I0314 15:25:29.391406 236 manifests.go:99] [control-plane] getting StaticPodSpecs
I0314 15:25:29.399636 236 certs.go:519] validating certificate period for CA certificate
I0314 15:25:29.399734 236 manifests.go:125] [control-plane] adding volume "ca-certs" for component "kube-apiserver"
I0314 15:25:29.399744 236 manifests.go:125] [control-plane] adding volume "etc-ca-certificates" for component "kube-apiserver"
I0314 15:25:29.399751 236 manifests.go:125] [control-plane] adding volume "k8s-certs" for component "kube-apiserver"
I0314 15:25:29.399757 236 manifests.go:125] [control-plane] adding volume "usr-local-share-ca-certificates" for component "kube-apiserver"
I0314 15:25:29.399763 236 manifests.go:125] [control-plane] adding volume "usr-share-ca-certificates" for component "kube-apiserver"
I0314 15:25:29.404914 236 manifests.go:154] [control-plane] wrote static Pod manifest for component "kube-apiserver" to "/etc/kubernetes/manifests/kube-apiserver.yaml"
I0314 15:25:29.404937 236 manifests.go:99] [control-plane] getting StaticPodSpecs
I0314 15:25:29.405143 236 manifests.go:125] [control-plane] adding volume "ca-certs" for component "kube-controller-manager"
I0314 15:25:29.405162 236 manifests.go:125] [control-plane] adding volume "etc-ca-certificates" for component "kube-controller-manager"
I0314 15:25:29.405168 236 manifests.go:125] [control-plane] adding volume "flexvolume-dir" for component "kube-controller-manager"
I0314 15:25:29.405174 236 manifests.go:125] [control-plane] adding volume "k8s-certs" for component "kube-controller-manager"
I0314 15:25:29.405180 236 manifests.go:125] [control-plane] adding volume "kubeconfig" for component "kube-controller-manager"
I0314 15:25:29.405190 236 manifests.go:125] [control-plane] adding volume "usr-local-share-ca-certificates" for component "kube-controller-manager"
I0314 15:25:29.405197 236 manifests.go:125] [control-plane] adding volume "usr-share-ca-certificates" for component "kube-controller-manager"
I0314 15:25:29.405995 236 manifests.go:154] [control-plane] wrote static Pod manifest for component "kube-controller-manager" to "/etc/kubernetes/manifests/kube-controller-manager.yaml"
I0314 15:25:29.406011 236 manifests.go:99] [control-plane] getting StaticPodSpecs
I0314 15:25:29.406206 236 manifests.go:125] [control-plane] adding volume "kubeconfig" for component "kube-scheduler"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
I0314 15:25:29.412245 236 manifests.go:154] [control-plane] wrote static Pod manifest for component "kube-scheduler" to "/etc/kubernetes/manifests/kube-scheduler.yaml"
W0314 15:25:29.412656 236 images.go:80] could not find officially supported version of etcd for Kubernetes v1.27.1, falling back to the nearest etcd version (3.5.7-0)
I0314 15:25:29.413371 236 local.go:65] [etcd] wrote Static Pod manifest for a local etcd member to "/etc/kubernetes/manifests/etcd.yaml"
I0314 15:25:29.413387 236 waitcontrolplane.go:83] [wait-control-plane] Waiting for the API server to be healthy
I0314 15:25:29.414554 236 loader.go:373] Config loaded from file: /etc/kubernetes/admin.conf
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0314 15:25:29.425135 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 8 milliseconds
I0314 15:25:29.928622 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:30.426542 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:30.928942 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:25:31.426285 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:31.926574 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:32.425855 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:32.929306 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:25:33.432250 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 5 milliseconds
I0314 15:25:33.927556 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:25:34.429233 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:25:34.928882 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:25:35.426472 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:35.926442 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:25:36.427463 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:36.929072 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:25:37.426921 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:37.928570 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:25:38.429992 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 4 milliseconds
I0314 15:25:38.927767 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:25:39.426417 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:39.928799 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:25:40.426617 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:40.928599 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:25:41.426777 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:25:41.926408 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:42.427337 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:42.927250 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:43.426510 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:43.927551 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:25:44.431041 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 5 milliseconds
I0314 15:25:44.926519 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:25:45.427374 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:45.927673 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:25:46.426031 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:46.929050 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:25:47.427350 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:25:47.927121 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:48.427093 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:48.926343 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:49.431462 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 5 milliseconds
I0314 15:25:49.927336 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:50.427378 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:25:50.927378 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:25:51.427207 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:51.928843 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 2 milliseconds
I0314 15:25:52.426681 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:52.926605 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:53.426493 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:25:53.926230 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:54.429374 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:25:54.928127 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:25:55.427725 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:25:55.926045 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:56.426682 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:25:56.927212 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:57.429680 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:25:57.926107 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:58.427203 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:25:58.927049 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:59.426661 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:25:59.926470 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:00.426908 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:00.930546 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 4 milliseconds
I0314 15:26:01.428831 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:26:01.926634 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:02.425903 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:02.926704 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:03.426868 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:03.926668 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:04.426400 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:04.927201 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:05.427017 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:05.926226 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:06.429655 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:26:06.926603 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:07.426496 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:07.929322 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:26:08.427800 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:08.931260 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 4 milliseconds
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp [::1]:10248: connect: connection refused.
I0314 15:26:09.426643 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:09.926557 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:10.426246 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:10.927897 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:11.426856 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:11.927776 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 2 milliseconds
I0314 15:26:12.426625 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:12.926441 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:13.426758 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:13.926420 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp [::1]:10248: connect: connection refused.
I0314 15:26:14.427004 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:14.926455 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:15.426383 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:15.929653 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:26:16.426081 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:16.926912 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:17.426192 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:17.927052 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:18.429744 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:26:18.929105 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:26:19.427137 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:19.930512 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 4 milliseconds
I0314 15:26:20.426710 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:20.926543 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:21.426384 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:21.927286 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:22.428589 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 2 milliseconds
I0314 15:26:22.926760 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:23.426506 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:23.926515 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp [::1]:10248: connect: connection refused.
I0314 15:26:24.427437 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:24.927117 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:25.429598 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:26:25.926363 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:26.427338 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:26.927319 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:27.427138 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:27.926472 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:28.426408 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:28.926906 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:29.426454 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:29.927325 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:30.426588 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:30.926378 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:31.427375 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:31.927457 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:32.426087 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:32.926533 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:33.426323 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:33.927686 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:34.426715 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:34.926822 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:35.426451 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:35.927436 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:36.427258 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:36.926747 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:37.425982 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:37.926217 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:38.426962 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:38.926476 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:39.426741 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:39.926122 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:40.429619 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:26:40.929712 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:41.426726 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:41.926248 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:42.429685 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:26:42.928777 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:26:43.426070 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:43.926989 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:44.426424 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp [::1]:10248: connect: connection refused.
I0314 15:26:44.926457 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:45.427234 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:45.927247 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:46.431594 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 5 milliseconds
I0314 15:26:46.929054 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:26:47.426513 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:47.926408 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:48.429601 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:26:48.926450 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:49.427532 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:49.926431 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:50.432677 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 6 milliseconds
I0314 15:26:50.926469 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:51.431905 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 5 milliseconds
I0314 15:26:51.926872 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:52.426476 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:52.926555 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:53.426304 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:53.927396 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:54.427245 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:54.927013 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:55.428057 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:55.926386 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:56.427231 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:56.929561 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:26:57.426637 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:26:57.926445 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:58.427208 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:58.931269 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 5 milliseconds
I0314 15:26:59.427208 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:26:59.926712 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:00.426587 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:27:00.926588 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:01.426511 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:01.926524 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:27:02.428787 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:27:02.926737 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:27:03.425944 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:03.926010 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:04.426500 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:04.927256 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:05.426962 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:05.926225 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:06.427013 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:06.926463 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:07.427435 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:27:07.926436 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:08.427279 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:08.930781 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 5 milliseconds
I0314 15:27:09.425796 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:09.926267 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:10.426801 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:10.926458 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:11.426887 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:11.926488 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:12.429121 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 2 milliseconds
I0314 15:27:12.927080 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:13.426333 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:13.927236 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:14.427550 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:27:14.926320 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:15.430293 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:27:15.927081 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:16.429441 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:27:16.927378 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:17.427144 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:17.930995 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 5 milliseconds
I0314 15:27:18.426452 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:18.927271 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:19.427260 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:19.930022 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:27:20.426462 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:20.927017 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:21.429276 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 3 milliseconds
I0314 15:27:21.927233 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:22.427559 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:27:22.926370 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:23.427119 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 0 milliseconds
I0314 15:27:23.926816 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
I0314 15:27:24.426519 236 round_trippers.go:553] GET https://cluster-control-plane:6443/healthz?timeout=10s in 1 milliseconds
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp [::1]:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all running Kubernetes containers by using crictl:
- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock logs CONTAINERID'
couldn't initialize a Kubernetes cluster
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/init.runWaitControlPlanePhase
cmd/kubeadm/app/cmd/phases/init/waitcontrolplane.go:108
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
cmd/kubeadm/app/cmd/phases/workflow/runner.go:259
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
cmd/kubeadm/app/cmd/phases/workflow/runner.go:446
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
cmd/kubeadm/app/cmd/phases/workflow/runner.go:232
k8s.io/kubernetes/cmd/kubeadm/app/cmd.newCmdInit.func1
cmd/kubeadm/app/cmd/init.go:111
github.com/spf13/cobra.(*Command).execute
vendor/github.com/spf13/cobra/command.go:916
github.com/spf13/cobra.(*Command).ExecuteC
vendor/github.com/spf13/cobra/command.go:1040
github.com/spf13/cobra.(*Command).Execute
vendor/github.com/spf13/cobra/command.go:968
k8s.io/kubernetes/cmd/kubeadm/app.Run
cmd/kubeadm/app/kubeadm.go:50
main.main
cmd/kubeadm/kubeadm.go:25
runtime.main
/usr/local/go/src/runtime/proc.go:250
runtime.goexit
/usr/local/go/src/runtime/asm_amd64.s:1598
error execution phase wait-control-plane
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
cmd/kubeadm/app/cmd/phases/workflow/runner.go:260
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
cmd/kubeadm/app/cmd/phases/workflow/runner.go:446
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
cmd/kubeadm/app/cmd/phases/workflow/runner.go:232
k8s.io/kubernetes/cmd/kubeadm/app/cmd.newCmdInit.func1
cmd/kubeadm/app/cmd/init.go:111
github.com/spf13/cobra.(*Command).execute
vendor/github.com/spf13/cobra/command.go:916
github.com/spf13/cobra.(*Command).ExecuteC
vendor/github.com/spf13/cobra/command.go:1040
github.com/spf13/cobra.(*Command).Execute
vendor/github.com/spf13/cobra/command.go:968
k8s.io/kubernetes/cmd/kubeadm/app.Run
cmd/kubeadm/app/kubeadm.go:50
main.main
cmd/kubeadm/kubeadm.go:25
runtime.main
/usr/local/go/src/runtime/proc.go:250
runtime.goexit
/usr/local/go/src/runtime/asm_amd64.s:1598
Additional context
I didn't notice the docker call until I went to copy the log. At which point I understood why the kind container never showed up on my local podman machine.