grafana icon indicating copy to clipboard operation
grafana copied to clipboard

Cloudwatch: Add missing AWS/Kafka namespace metric HeapMemoryAfterGC

Open gelicia opened this issue 1 year ago • 0 comments

Discussed in https://github.com/grafana/grafana/discussions/66359

Originally posted by ran-ka April 12, 2023 What happened: One of the most important metrics when monitoring Kafka is memory usage.

AWS MSK Best practices: Monitor Apache Kafka memory

We recommend that you monitor the memory that Apache Kafka uses. Otherwise, the cluster may become unavailable.

To determine how much memory Apache Kafka uses, you can monitor the HeapMemoryAfterGC metric. HeapMemoryAfterGC is the percentage of total heap memory that is in use after garbage collection. We recommend that you create a CloudWatch alarm that takes action when HeapMemoryAfterGC increases above 60%.

However, looking here: https://github.com/grafana/grafana/blob/main/pkg/tsdb/cloudwatch/constants/metrics.go

I couldn't find HeapMemoryAfterGC which is the best indicator for a memory issue.

gelicia avatar Feb 15 '24 18:02 gelicia