pulsar-helm-chart icon indicating copy to clipboard operation
pulsar-helm-chart copied to clipboard

Add node_exporter template

Open rvashishth opened this issue 4 years ago • 2 comments

Is your feature request related to a problem? Please describe. The grafana dashboards should display metrics for nodes and containers. Use prometheus node_exporter to export kubernetes node metrics.

Describe the solution you'd like Define node exporter template as defined at streamnative charts

Additional context Although monitoring.node_exporter is enabled at values.yml file but it seems no template for node_exporters are defined yet.

rvashishth avatar Jan 28 '21 11:01 rvashishth

Probably removed because most clusters will typically already have a similar daemonset?

As a workaround can we just deploy a standard node-exporter?

  • https://github.com/prometheus-community/helm-charts/tree/main/charts/prometheus-node-exporter

mkoertgen avatar Feb 16 '21 18:02 mkoertgen

Added as mentioned above with podAnnotations.scrape: true.

This kind of works but lacks the kubelet_volume_stats_* metrics which were helpful in monitoring e.g. the ledger-usage of the bookies.

Some of the pular-provisioned grafana-dashboards rely on that, e.g. the "Bookie Metrics"-dashboard

image

As you can see the PVC metrics show no data because neither the kubelet_volume_stats_available_bytes nor kubelet_volume_stats_capacity_bytes is exported anymore. However bookie_ledger_dir__pulsar_data_bookkeeper_ledgers_usage is still there

It has been reported that this has changed since 1.12 of the exporter and there in ongoing discussion on pvc metrics, cf.:

  • https://github.com/prometheus-operator/prometheus-operator/issues/2359

It did not dig into the issue in detail but my understanding so far is that this neither solved yet nor is there a clear path how to go about this.

mkoertgen avatar Feb 16 '21 18:02 mkoertgen

Since 3.0.0 chart version, kube-prometheus-stack has been used for Prometheus and Grafana. Closing this issue.

lhotari avatar Jan 26 '24 21:01 lhotari