Monitor Your Microservices — Logs, Metrics, Pings, and Traces (Workshop)
A presentation at DevOpsDays Amsterdam 2018 in in Amsterdam, Netherlands by Philipp Krenn
Monitor Your Microservices Logs, Metrics, Pings, and Traces Philipp Krenn 44444 @xeraa
Developer !
Disclaimer I build highly monitored Hello World apps
Code https://github.com/xeraa/microservice-monitoring
Application
Simple No discovery, load-balancing,...
Cloud
Open Source
Workshop SSH: ssh workshop@workshop-<number>.xeraa.wtf workshop / secret Elasticsearch: http://localhost:9200 admin / secret Kibana: http://workshop-<number>.xeraa.wtf:5601 admin / secret Application: http://workshop-<number>.xeraa.wtf
Monitoring
Metricbeat: System
Packetbeat
Metricbeat: nginx
Filebeat Modules
Filebeat + JSON MDC, context, stack hash
Heartbeat
Metricbeat: HTTP
Metricbeat: Jolokia
Time Series Visual Builder & Annotations
Auditbeat
Sleuth
2017-03-29 08:08:35.090 INFO [frontend,69a851ed700bf1fa,69a851ed700bf1fa,true] 23575 --- [p-nio-80-exec-2] n.x.MicroserviceMonitoringApplication : Calling home 2017-03-29 08:08:36.149 INFO [frontend,69a851ed700bf1fa,10b1f0a0e2de1253,true] 23575 --- [p-nio-80-exec-3] n.x.MicroserviceMonitoringApplication : You called home
Application: frontend Trace ID: 69a851ed700bf1fa Span ID: 10b1f0a0e2de1253 Send to Zipkin: true
Zipkin
Zipkin Chrome Extension https://github.com/openzipkin/zipkin-browser-extension
More
Alerts * * X-Pack and part of the Elastic Cloud
Machine Learning ** Anomaly Detection of Time Series Data ** X-Pack
Future
APM
Conclusion
System metrics & network Filebeat modules & Auditbeat Application logs
Uptime Application metrics Request tracing
Next https://github.com/xeraa/microservice-monitoring
Questions? Philipp Krenn 44444 @xeraa PS: Sticker
“With microservices every outage is like a murder mystery” is a common complaint. But it doesn’t have to be! This workshop gives an overview on how to monitor distributed applications with the easy to use, open source Elastic Stack.
We dive into:
- System metrics: Keep track of network traffic and system load.
- Application logs: Collect structured logs in a central location.
- Uptime monitoring: Ping services and actively monitor their availability and response time.
- Application metrics: Get the information from Boot’s metrics and health via REST or JMX.
- Request tracing: Use Sleuth to trace requests through a distributed system and Zipkin to show how long each call takes.
And we will do all of that live, since it is so easy and much more interactive that way.
Resources
The following resources were mentioned during the presentation or are useful additional information.
-
GitHub: Demo Code
Monitor your Spring Boot application with the Elastic Stack all around
Buzz and feedback
Here’s what was said about this presentation on social media.
