robusta icon indicating copy to clipboard operation
robusta copied to clipboard

Support Grouping of Alerts in Robusta when grouped alerts are received from Alertmanager

Open RoryDoherty opened this issue 1 year ago • 2 comments

Is your feature request related to a problem? When multiple alerts come in that have been grouped by Alertmanager robusta sends a single alert for each

Describe the solution you'd like Robusta should respect the grouping of the alerts and just send one message with all of the alerts details to the configured sinks Something like the following:

<count> <grouping type>
<cluster>
<list of affected pods/containers>

So if you were grouping by alertname and the alert was container restarted then the alert would look something like:

5 alerts for Container Restarted
Cluster: dev-cluster
  - Namespace: <namespace> Container: <container> Pod: <pod-name>
  - Namespace: <namespace> Container: <container> Pod: <pod-name>
  - Namespace: <namespace> Container: <container> Pod: <pod-name>
  - Namespace: <namespace> Container: <container> Pod: <pod-name>
  - Namespace: <namespace> Container: <container> Pod: <pod-name>

Describe alternatives you've considered I don't believe there is an alternative in Robusta for this

Additional context Slack Thread on this issue with suggestions: https://robustacommunity.slack.com/archives/C02R0LVANKY/p1679403942945209

RoryDoherty avatar May 04 '23 15:05 RoryDoherty

Was there a possible solution option in the Slack channel? Unfortunately I can't see the discussion because the messages are older than 90 days...

yanehi avatar Mar 25 '24 15:03 yanehi

No resolution yet, but we are planning to improve how we handle grouping soon.

In the first iteration we are currently planning to add threaded slack messages so that you can define groups and each new alert in the group will go into a running thread for that group of alerts.

Is it important for you to respect the grouping alertmanager sends? Or just to group in general and reduce the number of notifications?

Please feel free to share other thoughts and feedback!

aantn avatar Mar 26 '24 23:03 aantn