Monitoring Nomad with InfluxDB

This tutorial walks you through setting up Nomad monitoring pipeline using Prometheus publisher, Telegraf metrics collector, InfluxDB as time series database and Grafana for visualisation.

Metrics Flow

Nomad -> Telegraf -> InfluxDB

Configs

• Nomad
  • Telemetry should be enabled with Prometheus metrics:

  telemetry {
    publish_allocation_metrics = true
    publish_node_metrics       = true
    prometheus_metrics         = true
  }
  

• Telegraf
  • Prometheus input:

  [[inputs.prometheus]]
  urls = ["http://{{NOMAD_NODE_ADDRESS}}:4646/v1/metrics?format=prometheus"]
  

• Grafana dashboards
  • Grafana.com Dashbords
  • Example Nomad jobs with pre-configured data sources and dashboards