charts icon indicating copy to clipboard operation
charts copied to clipboard

Kafka helm, prometheus monitor not working,metrics api request time out

Open onlw opened this issue 3 years ago • 0 comments

Name and Version

bitnami/kafka-18.0.7

What steps will reproduce the bug?

  1. env k8s version:v1.21.5
  2. run command kubectl create namespace kafka helm install saas bitnami/kafka --namespace kafka --version 18.0.7 --set metrics.serviceMonitor.enabled=true --set metrics.kafka.enabled=true --set metrics.serviceMonitor.namespace=monitoring --set metrics.serviceMonitor.interval=15s --set metrics.kafka.containerPorts.metrics=9309 --set metrics.kafka.service.ports.metrics=9309
  3. prometheus request metrics api time out
    Get "http://10.233.66.45:9309/metrics": context deadline exceeded

Are you using any custom parameters or values?

--set metrics.serviceMonitor.enabled=true --set metrics.kafka.enabled=true --set metrics.serviceMonitor.namespace=monitoring --set metrics.serviceMonitor.interval=15s --set metrics.kafka.containerPorts.metrics=9309 --set metrics.kafka.service.ports.metrics=9309

What is the expected behavior?

Prometheus monitor normally

What do you see instead?

image

Additional information

image

metrics api request time out

onlw avatar Aug 09 '22 16:08 onlw

Hi @arleex,

Have you tried increasing the value metrics.serviceMonitor.scrapeTimeout?

I have found the following discussions reporting the same error and in both cases increasing the timeout was suggested:

  • https://discuss.prometheus.io/t/context-dealine-exceeded/975/3
  • https://stackoverflow.com/questions/49817558/context-deadline-exceeded-prometheus

migruiz4 avatar Aug 11 '22 13:08 migruiz4

This Issue has been automatically marked as "stale" because it has not had recent activity (for 15 days). It will be closed if no further activity occurs. Thanks for the feedback.

bitnami-bot avatar Aug 27 '22 01:08 bitnami-bot

Due to the lack of activity in the last 5 days since it was marked as "stale", we proceed to close this Issue. Do not hesitate to reopen it later if necessary.

bitnami-bot avatar Sep 02 '22 01:09 bitnami-bot