helm-charts icon indicating copy to clipboard operation
helm-charts copied to clipboard

Published 20 hours ago • verified publisher icon prometheus-community

[prometheus-node-exporter] Question on DaemonSets for node exporter

Open dbbc96 opened this issue 1 year ago • 6 comments

So pardon for this generic question but thought i would ask it here in hopes that someone might know. I just was starting testing out Prometheus. I deployed the kube-prometheus-stack chart if it matters or not.

My question is why is node exporter needing a large number of pods running as a DaemonSets. Basically what i am seeing is that i have multiple pods managed by a DS that can't be scheduled since i have only 1 node. When i look at the DS for it, its starting out with 5 and a recommended value.

dbbc96 avatar Oct 05 '23 02:10 dbbc96

just curious if anyone has any input on this.

dbbc96 avatar Oct 23 '23 15:10 dbbc96

anyone have thoughts on this?

dbbc96 avatar Dec 07 '23 14:12 dbbc96

DaemonSets run one pod per node. Node Exporter needs to run one per node to gather node metrics.

kfox1111 avatar Dec 07 '23 17:12 kfox1111

yeah i get that however when i had tested this, i had 3 nodes and so it had running exporters on those however there were ones that still didn't get scheduled. my guess is that there might be different node exporters that need to run on each node. so there wouldn't be just 1 exporter on each node. but i am guessing on this.

dbbc96 avatar Dec 07 '23 19:12 dbbc96

You might have node taints that affect their scheduling, double-check if you've set the right tolerations

ShadowJonathan avatar Dec 10 '23 16:12 ShadowJonathan

@ShadowJonathan I will check and let you know. I don't think I did.

dbbc96 avatar Jan 17 '24 21:01 dbbc96