info/error/warning messages to the metrics sent to prometheus

[hmsvigle]

We are getting below metrics from popeye to prometheus.

There is no "message" field in these reports to extract. So that, we can try to fetch these messages separately along with the count, which will server the purpose of having the metrics generated.

Is your feature request related to a problem? Please describe. Basically these reports, when populated to prometheus might not server the purpose to troubleshooting. Hence is it feasible to add error/warning/Info messages to the filter for all the metrics generated ?

Describe the solution you'd like

1. My request is to add error/info/warning Messages to the metrics.
2. It would be helpful, if above messages could be mapped resource-wise/level-wise.

Describe alternatives you've considered I have thought of parsing the json output of popeye to implement this requirement. alternatively looking for other tool, what would provide next step of easy integration to prometheus & grafana.

Additional context Please let me know, if any further clarifications required.

[hmsvigle]

@eminugurkenar @derailed Kindly look into this feature request.

I have created dashboard in grafana as per data sent to prometheus through pushgateway. Currently, I am able to display only the total no of Error/Warn/Ok/Info Messages for every sanitizer. To get the detailed message, I would have to parse the report & segregate type of messages.

It would be beneficial if we can add info/Error/Warn/Ok Messages in the filter itself of existing Metrices or by creating separate Metrics. So that I would be able to display the message itself in Grafana dashboard, instead of parsing the report to segregate Messages.

In this way, it will be a complete solution.

1. Generate the sanitation report
2. Visualize it in Grafana - Along with the counts(numbers), all Messages as well to take appropriate action on them.

Thanks

[derailed]

Fixed v0.20.0