robusta icon indicating copy to clipboard operation
robusta copied to clipboard

Error preview in slack of pods is not same in some cases

Open laivu266 opened this issue 2 years ago • 8 comments

Hi team,

I'm facing with a problem related to preview the errors of pods in slack.

Screen Shot 2023-02-01 at 13 28 24 As above, there are two alerts about CrashLoopBackOff of pods, but there is difference related to error preview. The first alert I can see the detail of error on that slack thread. But the second alert that I need to download a file to view the error detail. Of course, I like the first alert. Why it have the difference?

Thanks.

laivu266 avatar Feb 01 '23 06:02 laivu266

Thanks for reporting this @laivu266

In the second notification, is there only a single attachment? Or, there is more than 1 attached file?

arikalon1 avatar Feb 01 '23 07:02 arikalon1

@arikalon1 There is only a single attachment in the second notification.

laivu266 avatar Feb 01 '23 07:02 laivu266

One more thing, I didn't receive any Resolved notification after our services get back health

laivu266 avatar Feb 01 '23 07:02 laivu266

Thanks @laivu266 Robusta sends the messages to Slack using the same API call. It's seems like the exact same message, so I'm not sure why it's displayed differently. I do know, that when there are multiple attachments to a Slack message, the attachments are collapsed. @RoiGlinik Do you know why it happens?

Regarding the Resolved notification. Robusta sends 2 types of notifications:

  1. Prometheus alerts
  2. Detections based on k8s API server events

At the moment, the detection based on the API server events, doesn't have a resolved state. (Prometheus alerts does)

arikalon1 avatar Feb 01 '23 09:02 arikalon1

Any update?

laivu266 avatar Feb 02 '23 12:02 laivu266

@laivu266, There is a 1 megabyte file size limit for files uploaded as snippets. Could that be the case? If not, would you be willing to send your runner logs to [email protected] or we could speak in our slack community? see if we can detect something unusual

RoiGlinik avatar Feb 02 '23 14:02 RoiGlinik

Hi @RoiGlinik , I just sent you the app crash log via Slack community. Please check it and help us to investigate. Thanks

laivu266 avatar Feb 06 '23 07:02 laivu266

@laivu266 was this ever resolved?

aantn avatar Feb 22 '24 16:02 aantn