edgemesh icon indicating copy to clipboard operation
edgemesh copied to clipboard

edgemesh‘s pod can’t work on the edge

Open zz952332446 opened this issue 2 years ago • 8 comments

master

  • network: public server with public ip
  • k8s:1.21.0 ( installed with kubeadm)
  • keadm: 1.8.2
keadm init --advertise-address=public ip --kubeedge-version=1.8.2
  • kubeedge: 1.8.2

  • edgemesh: installed with HELM :

helm install edgemesh --set server.nodeName=**  --set server.publicIP=*** https://raw.githubusercontent.com/kubeedge/edgemesh/main/build/helm/edgemesh.tgz

I config edgemesh according to EdgeMesh

agent

  • net: Campus Network
  • keadm: 1.8.2
  • kubeedge: 1.8.2

question

edgemesh's pod can work on the master, but on the edge can't work

this is ·kubectl get no

this is kubectl get pod -A, you can see the pod:edgemesh-agent is pending.

On the agent, It doesn't have any container about edgemesh-agent

Or, it has containers about edgemesh-agent, but they can't work,even restart again and again like the following png: image-20220310200914407

error log

I can't get logs helpful according to systemctl status edgecore or journalctl -u edgecore.service -b

Through systemctl status docker: it seems that docker was stuck in something?? image-20220310202646605

zz952332446 avatar Mar 10 '22 14:03 zz952332446

  1. checkout edgecore.yaml, need set clusterDNS and clusterDomain, metaServer need enable: true, refer to: https://edgemesh.netlify.app/guide/getting-started.html#manual-installation
  2. test local apiserver in edge node, like: curl 127.0.0.1:10550/api/v1/services
  3. print some edgemesh-agent logs for me

Poorunga avatar Mar 11 '22 02:03 Poorunga

  1. checkout edgecore.yaml, need set clusterDNS and clusterDomain, metaServer need enable: true, refer to: https://edgemesh.netlify.app/guide/getting-started.html#manual-installation
  2. test local apiserver in edge node, like: curl 127.0.0.1:10550/api/v1/services
  3. print some edgemesh-agent logs for me

Thanks,

  1. I set clusterDNS as 169.254.96.16, metaServer is enabled
  2. I can get response
  3. I try edgemesh again, log from edgecore is: image-20220311121740305

I can't start containers about edgemesh even usedocker start image-20220311121758876

zz952332446 avatar Mar 11 '22 04:03 zz952332446

Try deploy other test pod to edge node? such as nginx image

Poorunga avatar Mar 11 '22 04:03 Poorunga

Try deploy other test pod to edge node? such as nginx image

master deploy other pod to the edge without edgemesh?(my master and my agent are not under the same network)

zz952332446 avatar Mar 11 '22 06:03 zz952332446

Try kubectl apply -f https://github.com/kubeedge/kubeedge/raw/master/build/deployment.yaml, then observe that nginx can run normally on the edge node?

You need to make sure your kubeedge cluster is normal first, kubeedge itself has nothing to do with edgemesh

Poorunga avatar Mar 11 '22 06:03 Poorunga

Try kubectl apply -f https://github.com/kubeedge/kubeedge/raw/master/build/deployment.yaml, then observe that nginx can run normally on the edge node?

You need to make sure your kubeedge cluster is normal first, kubeedge itself has nothing to do with edgemesh

I can't deploy it on the edge node, because I don't deploy flannel and kube-proxy on the edge. I add nodeAffinity according to this doc in order to make edgemesh work well

zz952332446 avatar Mar 14 '22 00:03 zz952332446

I can't deploy it on the edge node, because I don't deploy flannel and kube-proxy on the edge.

You can run pods on your edge nodes without kube-proxy and any cni plugin.

Poorunga avatar Mar 14 '22 01:03 Poorunga

@Poorunga i am able to access the pod running on edgenode through using NODEPORT, but when i use custom domain to access the same app in ClusterIP , 502 bad gateway occurs.

i'm using kubesphere.

but when, i use aws instance as my edgenode, it works with no issue. (maybe this is because being in same Virtual Private Network)


self manager kubernetes cluster : AWS 1 master, 2 worker edgenode: google cloud instance

caelumpirata avatar Jun 26 '23 07:06 caelumpirata