pulsar-helm-chart
pulsar-helm-chart copied to clipboard
Add node_exporter template
Is your feature request related to a problem? Please describe.
The grafana dashboards should display metrics for nodes and containers. Use prometheus node_exporter to export kubernetes node metrics.
Describe the solution you'd like Define node exporter template as defined at streamnative charts
Additional context
Although monitoring.node_exporter is enabled at values.yml file but it seems no template for node_exporters are defined yet.
Probably removed because most clusters will typically already have a similar daemonset?
As a workaround can we just deploy a standard node-exporter?
- https://github.com/prometheus-community/helm-charts/tree/main/charts/prometheus-node-exporter
Added as mentioned above with podAnnotations.scrape: true.
This kind of works but lacks the kubelet_volume_stats_* metrics which were helpful in monitoring e.g. the ledger-usage of the bookies.
Some of the pular-provisioned grafana-dashboards rely on that, e.g. the "Bookie Metrics"-dashboard

As you can see the PVC metrics show no data because neither the kubelet_volume_stats_available_bytes nor kubelet_volume_stats_capacity_bytes is exported anymore. However bookie_ledger_dir__pulsar_data_bookkeeper_ledgers_usage is still there
It has been reported that this has changed since 1.12 of the exporter and there in ongoing discussion on pvc metrics, cf.:
- https://github.com/prometheus-operator/prometheus-operator/issues/2359
It did not dig into the issue in detail but my understanding so far is that this neither solved yet nor is there a clear path how to go about this.
Since 3.0.0 chart version, kube-prometheus-stack has been used for Prometheus and Grafana. Closing this issue.