Microk8s is not running, but some pods does

[ZhouJian26]

Summary

I have a cluster in HA with MicroK8s version 1.29 stable. I found the cluster crashed for no apparent reason, and I can't figure out how to solve this problem. On each node, microk8s status says microk8s is not running. Use microk8s inspect for a deeper inspection. However, microk8s inspect indicates that everything is working fine.

I noticed that I'm unable to perform microk8s kubectl get nodes, which result with Error from server: rpc error: code = Unknown desc = query (try: 0): theid

I tried stopping and restarting MicroK8s on each node, and I also restarted all the servers multiple times.

I see that some services are running while others simply cannot start. The most common error I'm seeing is: error=rpc error: code = Unknown desc = query (try: 0): theid.

Commands like kubectl get namespace are working fine

Reproduction Steps

I'm unable to reproduce this cluster state with a brand new one.

Introspection Report

inspection-report-20240731_131206.tar.gz

Can you suggest a fix?

no, idea

Are you interested in contributing with a fix?

I do not have the skill to do it