macOS HA Node does not complete joining cluster
Summary
I have a 5 node microk8s cluster in HA mode that is composed wholly of Ubuntu instances. I wanted to add macOS nodes to the existing cluster.
- I run
microk8s add-nodeon one of the existing nodes. - I then run the generated command inside the microk8s multipass VM running on the macOS node.
ubuntu@microk8s-vm:~$ microk8s join 192.168.2.5:25000/{stuff}/{other_stuff}
Contacting cluster at 192.168.2.5
Waiting for this node to finish joining the cluster. .. .. ..
ubuntu@microk8s-vm:~$ kubectl get pods
E0220 11:56:44.849246 26848 memcache.go:255] couldn't get resource list for metrics.k8s.io/v1beta1: client rate limiter Wait returned an error: context deadline exceeded - error from a previous attempt: unexpected EOF
.
continues to successfully display all of the pods in the cluster
- Run
kubectl get nodes. Themicrok8s-vmnode does not exist in the list. - I checked
dqlite, and themicrok8s-vmnode's IP address does exist in there. microk8s inspectdoes not report any errors (says the services are running)microk8s statusreports that microk8s is not running...
ubuntu@microk8s-vm:~$ microk8s inspect
Inspecting system
Inspecting Certificates
Inspecting services
Service snap.microk8s.daemon-cluster-agent is running
Service snap.microk8s.daemon-containerd is running
Service snap.microk8s.daemon-kubelite is running
Service snap.microk8s.daemon-k8s-dqlite is running
Service snap.microk8s.daemon-apiserver-kicker is running
Copy service arguments to the final report tarball
Inspecting AppArmor configuration
Gathering system information
Copy processes list to the final report tarball
Copy disk usage information to the final report tarball
Copy memory usage information to the final report tarball
Copy server uptime to the final report tarball
Copy openSSL information to the final report tarball
Copy snap list to the final report tarball
Copy VM name (or none) to the final report tarball
Copy current linux distribution to the final report tarball
Copy network configuration to the final report tarball
Inspecting kubernetes cluster
Inspect kubernetes cluster
Inspecting dqlite
Inspect dqlite
Building the report tarball
Report tarball is at /var/snap/microk8s/4567/inspection-report-20230220_120100.tar.gz
ubuntu@microk8s-vm:~$ microk8s status
microk8s is not running. Use microk8s inspect for a deeper inspection.
I would expect some sort of error somewhere. Either when joining the cluster, or when starting microk8s, or somewhere. It's also strange that status reports that it's not running, but inspect seems to think all the services are running.
/var/snap/microk8s/current/var/kubernetes/backend/cluster.yaml contains the microk8s-vm IP address on both the remote nodes and the microk8s-vm node itself.
Inspection Report: https://drive.google.com/file/d/1PIxdJHVfmkY01NJ8g1G1h4a1FHAucFGH/view?usp=share_link
Can I get any feedback on this?
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.