Kafka helm, prometheus monitor not working,metrics api request time out
Name and Version
bitnami/kafka-18.0.7
What steps will reproduce the bug?
- env k8s version:v1.21.5
- run command kubectl create namespace kafka helm install saas bitnami/kafka --namespace kafka --version 18.0.7 --set metrics.serviceMonitor.enabled=true --set metrics.kafka.enabled=true --set metrics.serviceMonitor.namespace=monitoring --set metrics.serviceMonitor.interval=15s --set metrics.kafka.containerPorts.metrics=9309 --set metrics.kafka.service.ports.metrics=9309
- prometheus request metrics api time out
Get "http://10.233.66.45:9309/metrics": context deadline exceeded
Are you using any custom parameters or values?
--set metrics.serviceMonitor.enabled=true --set metrics.kafka.enabled=true --set metrics.serviceMonitor.namespace=monitoring --set metrics.serviceMonitor.interval=15s --set metrics.kafka.containerPorts.metrics=9309 --set metrics.kafka.service.ports.metrics=9309
What is the expected behavior?
Prometheus monitor normally
What do you see instead?
Additional information
metrics api request time out
Hi @arleex,
Have you tried increasing the value metrics.serviceMonitor.scrapeTimeout?
I have found the following discussions reporting the same error and in both cases increasing the timeout was suggested:
- https://discuss.prometheus.io/t/context-dealine-exceeded/975/3
- https://stackoverflow.com/questions/49817558/context-deadline-exceeded-prometheus
This Issue has been automatically marked as "stale" because it has not had recent activity (for 15 days). It will be closed if no further activity occurs. Thanks for the feedback.
Due to the lack of activity in the last 5 days since it was marked as "stale", we proceed to close this Issue. Do not hesitate to reopen it later if necessary.