alertmanager icon indicating copy to clipboard operation
alertmanager copied to clipboard

email sent per peer

Open sstarcher opened this issue 1 year ago • 2 comments

What did you do?

Each peer will sometimes send an email alert. This alert is separated by 15 seconds which is the default peer timeout.

What did you expect to see?

A single email being sent.

What did you see instead? Under which circumstances?

An email being sent per peer.

Environment

K8S 1.28

  • Alertmanager version:

0.26.0

  • Alertmanager configuration file: group_wait: 30s peer timeout 15s

  • Logs:

None

alertmanager_peer_position is stable with no change pods have been running for 15 days with nothing in the logs

sstarcher avatar Jan 19 '24 13:01 sstarcher

Still looks like the gossip has some problems. Can you run it with log-level debug and check the gossip logs?

TheMeier avatar Mar 10 '24 12:03 TheMeier

I'll try and get some logs in the next few weeks.

sstarcher avatar Mar 26 '24 18:03 sstarcher

I have not had a reproduction of this in about 4 months now so we will close this unless we can reproduce another occurrence.

sstarcher avatar Jul 03 '24 13:07 sstarcher