How to limit kafka exporter metrics

[zarafree]

We wanted to gather only limited metrics from kafka exporter (Not JMX kafka metrics). For example, we need only kafka_consumergroup_current_offset and kafka_consumergroup_lag metrics from kafka exporter. We are getting OOMkilled for kafka exporter. We tried to increase pod limit but no luck so wanted to filter metrics so it will improve performance. any help / suggestions?

[andyast]

how many topics/partitions are you running? We have ~1400 topics with ~7500 partitions and kafka-exporter is using 75MB of ram.

See this response: https://github.com/danielqsj/kafka_exporter/issues/305#issuecomment-1162214186

[msartor92]

It's not a ram problem but a scrape time problem

[trycrmr]

+1

[devopsteam605]

+1