jmx-monitoring-stacks icon indicating copy to clipboard operation
jmx-monitoring-stacks copied to clipboard

Add JMX Exporter Configs for Producers within the Confluent Server

Open nerdynick opened this issue 3 years ago • 1 comments
trafficstars

When Control Center is enabled we leverage the ConfluentMetricsReporter within the Brokers. We should capture these metrics into prometheus.

Example Configs:

- pattern: kafka.producer<type=producer-metrics, client-id=(.+)><>(.+):\w* 
   name: kafka_producer_$2 
   labels: 
     client-id: "$1"
- pattern: kafka.producer<type=producer-node-metrics, client-id=(.+), node-id=(.+)><>(.+):\w* 
   name: kafka_producer_$3 
   labels: 
     client-id: "$1" 
     broker: "$2"
- pattern: kafka.producer<type=producer-topic-metrics, client-id=(.+), topic=(.+)><>(.+):\w* 
   name: kafka_producer_$3 
   labels: 
     client-id: "$1" 
     topic: "$2"

nerdynick avatar Dec 28 '21 18:12 nerdynick

SOme of those were deliberately blacklisted due to the sheer volume that they start producing at scale. Some folks are pretty sensitive to the scrape performance and that caused a bit of pushback. I can try it out again for the 7.x bump and see if it is okay with minimal scrape times.

waliaabhishek avatar Jan 19 '22 18:01 waliaabhishek