Alerting review

[devopsmatt]

We want to make alerting less burdensome. This work item is to figure out and document ways to:

• [ ] filter out the noise
• [ ] add context to the alerts to make them easier to act on
• [ ] figure out a way to better categorize them, so they can be routed more accurately
• [ ] figure out if any resolutions can be automated
• [ ]

DoD: Documentation around ways to accomplish the tasks above, so that we can create new tickets and schedule the followup deliverables.

[etanb]

FYI @victor-chaparro @chris-kuryak Experience should be aware / a part of any relevant discussions in regards to this ticket.