kafka-minion-helm-chart icon indicating copy to clipboard operation
kafka-minion-helm-chart copied to clipboard

Published 20 hours ago • verified publisher icon cloudworkz

Question: Custom Metrics

Open cferrera opened this issue 5 years ago • 1 comments

Hey all 👋

I'm kinda new to this so I'm not sure if this question will make sense, sorry if it doesn't.

I'm looking to integrate specific metrics on HPA (Horizontal Pod Autoscaler) from K8s, but since these metrics expose all topics/groups/etc/etc together it won't fit very well. Is there a way to create/query custom metrics?

minReplicas: 1 maxReplicas: 3 metrics: - type: Pods pods: metricName: CONSUMER_LAG_FROM_GROUP_ID_METRIC targetAverageValue: 100

Scaling up based on consumer lag from specific group id

Is this looking possible?

Thank you.

cferrera avatar Nov 18 '19 14:11 cferrera

Hey, I haven't tried the HPA along with prometheus metrics and therefore I can't answer your question. I'll leave this issue opened for some, maybe someone else can help you.

weeco avatar Nov 18 '19 22:11 weeco