Context for notifications

[hunter]

Nagios-herald (https://github.com/etsy/nagios-herald) is a nice idea for adding context to email notifications sent out from Nagios. It might make sense to add a similar feature to consul-alerts.

Initial thoughts are to include a graphite query URL (with variable substitution?) to the consul KV with specific relation to the checks. That way we can pull out a window of metrics as an image and include in the notification emails.

Feedback and ideas welcome!

[bcwilsondotcom]

+1! This is a great idea! When I get that dreaded 3AM page, it's nice to have as much data as the system can give me. A graphite query URL sounds like a good place to start. I send all of my system metrics to Graphite and view them through Grafana.

[mar-io]

+1! I also agree this is a great idea and your initial thoughts seem like an implementation that could work and would be useful for graphite users.

[fusiondog]

This should be very easy to implement in the email notifier by simply making changes to the template or without code changes by using a custom template. You just set your template as a value in the consul-alerts/config/notifiers/email/template key Just add your URL where you want it and fill the variables with info from the check. https://github.com/AcalephStorage/consul-alerts/blob/master/notifier/email-notifier.go