Monitoring, tracing, observability in DevOps

[monperrus]

• https://en.wikipedia.org/wiki/Tracing_(software)
• https://en.wikipedia.org/wiki/System_monitoring
• https://en.wikipedia.org/wiki/Network_monitoring
• https://en.wikipedia.org/wiki/Crash_reporter
• https://en.wikipedia.org/wiki/Application_performance_management
• https://en.wikipedia.org/wiki/Website_monitoring
• https://en.wikipedia.org/wiki/Provenance#Computer_science
• https://en.wikipedia.org/wiki/Log_analysis

[monperrus]

See also icinga (thanks to @henriklb for the suggestion)

[monperrus]

Log analysis @Eclipse https://projects.eclipse.org/projects/tools.tracecompass

[MatsJonsson]

We've found Istio ( https://istio.io/ ) to be increasingly useful in this context. KubeSpy ( https://github.com/pulumi/kubespy )is an excellent tool for troubleshooting and diagnosing Kubernetes deployments.

[lsc]

• Prometheus
• Sensu https://sensu.io/
• Zipkin
• the ELK stack.

[MatsJonsson]

+1 for Prometheus

[bittermandel]

Sentry for Error Reporting. https://sentry.io/welcome/

[monperrus]

• OpenZipkin
• Jaeger https://github.com/jaegertracing/jaeger
• https://medium.com/@rakyll/cpdd-critical-path-driven-development-6c2592fb8ea4

(from https://github.com/KTH/devops-course/issues/16#issue-371440053)

[monperrus]

See also Runtime application self-protection https://github.com/KTH/devops-course/issues/18#issuecomment-435888119

[monperrus]

Analytics

[monperrus]

Tools and Benchmarks for Automated Log Parsing. http://arxiv.org/abs/1811.03509

[monperrus]

Does the Fault Reside in a Stack Trace? Assisting Crash Localization by Predicting Crashing Fault Residence https://www.sciencedirect.com/science/article/pii/S0164121218302401

[monperrus]

Having good dashboards is essential in DevOps, see Kibana, etc.

[monperrus]

Made in Alibaba: https://github.com/alibaba/Sentinel

[monperrus]

JVM Profiler Sending Metrics to Kafka (https://kafka.apache.org/), Console Output or Custom Reporter https://github.com/uber-common/jvm-profiler

[monperrus]

https://github.com/madflojo/automatron

[monperrus]

https://github.com/apache/incubator-skywalking

[monperrus]

Time-series database to store monitoring data https://en.wikipedia.org/wiki/Time_series_database

[monperrus]

Prometheus - Monitoring system & time series database https://prometheus.io/

[monperrus]

Netflix Zuul is a gateway service that provides dynamic routing, monitoring, resiliency, security, and more. https://github.com/Netflix/zuul

[monperrus]

OpenTracing https://opentracing.io/

[monperrus]

Nagios https://en.wikipedia.org/wiki/Nagios

[monperrus]

Sensu is a free and open source monitoring that handles cloud environments. Sensu allows you to monitor servers, services, application health, and business KPIs. https://xebialabs.com/technology/sensu/

[bbaudry]

Provenance analysis tools

• SPADE : https://github.com/ashish-gehani/spade
• Camflow : http://camflow.org/

[monperrus]

Framework for instruction-level tracing and analysis of program executions http://static.usenix.org/event/vee06/full_papers/p154-bhansali.pdf

[monperrus]

DevOps Metrics https://queue.acm.org/detail.cfm?id=3182626

[monperrus]

Dapper, a large-scale distributed systems tracing infrastructure at Google http://research.google.com/pubs/pub36356.html

[monperrus]

Chaos Engineering & Observability https://www.infoq.com/news/2019/03/chaos-engineering-observability

[monperrus]

Humio: All of your data: logs, metrics, traces. Search, analyze and visualize instantly. Live system observability. https://humio.com/

[monperrus]

The OpenTracing project https://opentracing.io/

[monperrus]

Papers:

• Stardust: tracking activity in a distributed storage system 2006
• X-trace: A pervasive network tracing framework 2007
• Fay: extensible distributed tracing from kernels to clusters 2012
• So, you want to trace your distributed system? key design s from years of practical experience 2014
• Pivot tracing: Dynamic causal monitoring for distributed systems 2015