missioncontrol
missioncontrol copied to clipboard
Monitor and record time to run Athena queries
There are quite a few options to this:
- Monitor and Alert within MC
- Collect metrics within MC and output to a third-party service e.g. datadog
- Collect metrics with a tool like statsd and output to a third-party service ...etc.
But with monitoring we need to alert as well.
One option: https://docs.datadoghq.com/developers/dogstatsd/
FYI: we're already using DogStatsD on Databricks (might be useful for setting this up).
Let's try to get this done sooner rather than later, in case we run into problems.
On second thought, I think new relic is probably sufficient for tracking major problems, let's move this to the next milestone.