blackbox_exporter icon indicating copy to clipboard operation
blackbox_exporter copied to clipboard

Endpoint Target shows UP in blackbox but alert shows DOWN and Firing

Open DareLekan opened this issue 2 years ago • 2 comments

Good day. I am facing a similar issue here. I have alertmanager and blackbox configured. However, both shows different information for same endpoint. What am I doing wrong. Please help.

I have attached screenshot to help in explaining my pain point alert probe 2 alert probe blackbox probe prometheus config 1 prometheus config 2 prometheus UI alertmanagere prometheus UI alertmanagere22 prometheus UI alertmanagere33 prometheus UI alertmanagere44 prometheus UI blackbox

DareLekan avatar Jun 18 '22 08:06 DareLekan

I see...

The "UP" value in the state column refers to the Prometheus scrape target, not the target of the blackbox module (the next column).

From the Prometheus docs:

up{job="", instance=""}: 1 if the instance is healthy, i.e. reachable, or 0 if the scrape failed.

https://prometheus.io/docs/concepts/jobs_instances/

It means that Prometheus is able to scrape the target and obtain metrics.

You are encouraged to use the mailing list for this type of questions:

https://groups.google.com/g/prometheus-users

mem avatar Jun 18 '22 13:06 mem

Hi @mem I guess I have a similar issue: I would like the prometheus "up" metric to fail, when blackbox-exporter cannot reach a tcp target. Is it possible to configure blackbox exporter to return failure (i.e. http 5xx) to prometheus, when a target check failed?

Thanks for your help

Excpt0r avatar Aug 09 '22 10:08 Excpt0r

Any update on this problem? I am facing the same problem.

hasanbozok avatar Sep 28 '22 14:09 hasanbozok

I did not hear the last in the issue. Had to use a make-shift tool oending when I get a solution.

On Wed, Sep 28, 2022, 3:21 PM Hasan Bozok @.***> wrote:

Any update on this problem? I am facing the same problem.

— Reply to this email directly, view it on GitHub https://github.com/prometheus/blackbox_exporter/issues/931#issuecomment-1260989093, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASMPLBO6YPS5C4IRSPLKEPLWARH4ZANCNFSM5ZEMYMFA . You are receiving this because you authored the thread.Message ID: @.***>

DareLekan avatar Oct 11 '22 08:10 DareLekan

prometheus的target显示up状态,只是代表prometheus能正常和blackbox,kubelet等等Prometheus scrape target组件交互,不代表blackbox写的tpc监控等是正常的,得看alert有没有告警,所以如上属于正常现象

justbuilding avatar Jun 12 '23 02:06 justbuilding

going to close this issue for now because community channels are more suitable for this discussion.

For questions/help/support please use our community channels. There are more people available to potentially respond to your request and the whole community can benefit from the answers provided.

electron0zero avatar Jun 12 '23 09:06 electron0zero