Monitor Your Microservices — Logs, Metrics, Pings, and Traces (Workshop)

A presentation at DevOpsDays Amsterdam 2018 in June 2018 in Amsterdam, Netherlands by Philipp Krenn

Slide 1

Slide 1

Monitor Your Microservices Logs, Metrics, Pings, and Traces Philipp Krenn 44444 @xeraa

Slide 2

Slide 2

Slide 3

Slide 3

Slide 4

Slide 4

Slide 5

Slide 5

Slide 6

Slide 6

Developer !

Slide 7

Slide 7

Disclaimer I build highly monitored Hello World apps

Slide 8

Slide 8

Code https://github.com/xeraa/microservice-monitoring

Slide 9

Slide 9

Application

Slide 10

Slide 10

Simple No discovery, load-balancing,...

Slide 11

Slide 11

Slide 12

Slide 12

Cloud

Slide 13

Slide 13

Slide 14

Slide 14

Slide 15

Slide 15

Open Source

Slide 16

Slide 16

Slide 17

Slide 17

Slide 18

Slide 18

Workshop SSH: ssh workshop@workshop-<number>.xeraa.wtf workshop / secret Elasticsearch: http://localhost:9200 admin / secret Kibana: http://workshop-<number>.xeraa.wtf:5601 admin / secret Application: http://workshop-<number>.xeraa.wtf

Slide 19

Slide 19

Monitoring

Slide 20

Slide 20

Metricbeat: System

Slide 21

Slide 21

Packetbeat

Slide 22

Slide 22

Metricbeat: nginx

Slide 23

Slide 23

Filebeat Modules

Slide 24

Slide 24

Filebeat + JSON MDC, context, stack hash

Slide 25

Slide 25

Heartbeat

Slide 26

Slide 26

Metricbeat: HTTP

Slide 27

Slide 27

Slide 28

Slide 28

Metricbeat: Jolokia

Slide 29

Slide 29

Time Series Visual Builder & Annotations

Slide 30

Slide 30

Auditbeat

Slide 31

Slide 31

Sleuth

Slide 32

Slide 32

2017-03-29 08:08:35.090 INFO [frontend,69a851ed700bf1fa,69a851ed700bf1fa,true] 23575 --- [p-nio-80-exec-2] n.x.MicroserviceMonitoringApplication : Calling home 2017-03-29 08:08:36.149 INFO [frontend,69a851ed700bf1fa,10b1f0a0e2de1253,true] 23575 --- [p-nio-80-exec-3] n.x.MicroserviceMonitoringApplication : You called home

Slide 33

Slide 33

Application: frontend Trace ID: 69a851ed700bf1fa Span ID: 10b1f0a0e2de1253 Send to Zipkin: true

Slide 34

Slide 34

Zipkin

Slide 35

Slide 35

Zipkin Chrome Extension https://github.com/openzipkin/zipkin-browser-extension

Slide 36

Slide 36

More

Slide 37

Slide 37

Alerts * *   X-Pack and part of the Elastic Cloud

Slide 38

Slide 38

Slide 39

Slide 39

Machine Learning ** Anomaly Detection of Time Series Data **   X-Pack

Slide 40

Slide 40

Slide 41

Slide 41

Future

Slide 42

Slide 42

APM

Slide 43

Slide 43

Conclusion

Slide 44

Slide 44

Slide 45

Slide 45

System metrics & network Filebeat modules & Auditbeat Application logs

Slide 46

Slide 46

Uptime Application metrics Request tracing

Slide 47

Slide 47

Next https://github.com/xeraa/microservice-monitoring

Slide 48

Slide 48

Questions? Philipp Krenn 44444 @xeraa PS: Sticker