beats icon indicating copy to clipboard operation
beats copied to clipboard

Improve Metricbeat Kubernetes Volumes dashboard as currently it doesn't show useful information

Open eedugon opened this issue 1 year ago • 1 comments

Describe the enhancement:

The main visualization in our [Metricbeat Kubernetes] Volumes default dashboard is not showing useful information, because the volume name is something generic and usually reused by a lot of pods. It could also mislead users.

For example this visualization is a bit meaningless as the names don't really identify much and actually belong to multiple pods:

Screenshot 2024-05-11 at 11 16 20

Also, the metrics on datadir could be misleagind, as they are averages from a lot of real volumes belonging to different pods.

My proposal would be something like this, very similar, but including the pod names. As you can see the information is clearer.

Screenshot 2024-05-11 at 11 15 49

I have included that visualization as part of a bigger dashboard here, in case you want to take a look.

Describe a specific use case for the enhancement or feature:

Kubernetes Monitoring with Metricbeat or Elastic Agent using the volume metricset.

cc: @gizas

eedugon avatar May 11 '24 10:05 eedugon

Pinging @elastic/obs-ds-hosted-services (Team:obs-ds-hosted-services)

elasticmachine avatar May 15 '24 21:05 elasticmachine

We will keep this issue open because although we have merged an update for the Volumes dashboard still the pod metadata enrichment is not possible without an enhancement (see comment)

To be tracked as part of https://github.com/elastic/beats/issues/39524, where we will need to include the metadata pod watcher in the volume metricset and enrich relevant metrics with pod information

gizas avatar Aug 26 '24 10:08 gizas