beats icon indicating copy to clipboard operation
beats copied to clipboard

Metricbeat: “error getting group status: open /proc/<PID>/cgroup”

Open anaconda2196 opened this issue 2 years ago • 6 comments

OpenSearch v2.5.0

Running Metricbeat-oss (docker.elastic.co/beats/metricbeat-oss:7.10.2) seeing the following error in logs:

instance/metrics.go:285 error getting group status: open /proc/<PID>/cgroup: no such file or directory"

Using ref document - https://www.elastic.co/guide/en/beats/metricbeat/7.10/running-on-kubernetes.html

Any suggestions or pointers to resources would be very much appreciated.

cc @lalit-satapathy @klacabane @roshan-elastic @yug-elastic @fearful-symmetry

anaconda2196 avatar Feb 24 '23 21:02 anaconda2196

Hello @fearful-symmetry

What is also interesting is that metricbeat pushes the other ksm metrics (e.g. pod status, pod phase), but not the limits and requests. That is really odd. Is there any dependency with cgroup error ?

anaconda2196 avatar Feb 27 '23 17:02 anaconda2196

@anaconda2196, 7.10.x is no longer supported. Please upgrade to 7.17.9 if you wish to continue using the 7.x releases

michel-laterman avatar Mar 01 '23 19:03 michel-laterman

Pinging @elastic/elastic-agent-data-plane (Team:Elastic-Agent-Data-Plane)

elasticmachine avatar Mar 01 '23 19:03 elasticmachine

@anaconda2196, 7.10.x is no longer supported. Please upgrade to 7.17.9 if you wish to continue using the 7.x releases

@michel-laterman Does that mean if I want container metrics limits and requests Then I need to upgrade to Metricbeat 7.19.9?

kube-state-metrics v2.x and later no longer export metrics

kube_pod_container_resource_requests_cpu_cores kube_pod_container_resource_requests_memory_bytes kube_pod_container_resource_limits_cpu_cores kube_pod_container_resource_limits_memory_bytes

I tried to backport the support from the metricbeat 7.15.x code base to 7.10.2, but it didn’t work out.

anaconda2196 avatar Mar 01 '23 21:03 anaconda2196

@anaconda2196, 7.10.x is no longer supported. Please upgrade to 7.17.9 if you wish to continue using the 7.x releases

@michel-laterman Does that mean if I want container metrics limits and requests Then I need to upgrade to Metricbeat 7.19.9?

kube-state-metrics v2.x and later no longer export metrics

kube_pod_container_resource_requests_cpu_cores kube_pod_container_resource_requests_memory_bytes kube_pod_container_resource_limits_cpu_cores kube_pod_container_resource_limits_memory_bytes

I tried to backport the support from the metricbeat 7.15.x code base to 7.10.2, but it didn’t work out.

cc

@MichaelKatsoulis - I read your comments on https://github.com/elastic/beats/issues/21520 related to this issue. Can you guide me ?

anaconda2196 avatar Mar 02 '23 05:03 anaconda2196

Hi! We just realized that we haven't looked into this issue in a while. We're sorry!

We're labeling this issue as Stale to make it hit our filters and make sure we get back to it as soon as possible. In the meantime, it'd be extremely helpful if you could take a look at it as well and confirm its relevance. A simple comment with a nice emoji will be enough :+1. Thank you for your contribution!

botelastic[bot] avatar Mar 01 '24 05:03 botelastic[bot]

Closing as it doesn't show up with new versions.

pierrehilbert avatar Jun 03 '24 16:06 pierrehilbert