missioncontrol icon indicating copy to clipboard operation
missioncontrol copied to clipboard

Monitor and record time to run Athena queries

Open fbertsch opened this issue 6 years ago • 4 comments

There are quite a few options to this:

  1. Monitor and Alert within MC
  2. Collect metrics within MC and output to a third-party service e.g. datadog
  3. Collect metrics with a tool like statsd and output to a third-party service ...etc.

But with monitoring we need to alert as well.

fbertsch avatar May 14 '18 21:05 fbertsch

One option: https://docs.datadoghq.com/developers/dogstatsd/

fbertsch avatar May 14 '18 21:05 fbertsch

FYI: we're already using DogStatsD on Databricks (might be useful for setting this up).

akkomar avatar May 15 '18 13:05 akkomar

Let's try to get this done sooner rather than later, in case we run into problems.

wlach avatar May 16 '18 20:05 wlach

On second thought, I think new relic is probably sufficient for tracking major problems, let's move this to the next milestone.

wlach avatar Jun 06 '18 20:06 wlach