groot-mg/observability-tools

Set up for Prometheus, Alert Manager and Grafana dashboards :eyes:

Observability tools

This repository contains configuration for Prometheus, Alert Manager and Grafana dashboards.

How to run

Use the local setup on the repository docker-local-setup.

docker-local-setup will clone this repository and run the tools together with the services where the metrics are provided.

Tools

Prometheus

Prometheus scrapes metrics from the services/container.

The local config is on the file prometheus-local.yml

Alert Manager

Alert Manager connects to Slack Channel. Some rules are defined on Prometheus /prometheus/rules, but the Slack Channel is not automatically provided.

You need to set up the Slack Channel and change the Slack Channel url on alertmanager/config/alertmanager-local.yml and change api_url.

Grafana

Dashboards are already provided inside Grafana.

During the container startup, a backup will be loaded and all dashboards will be available, just access the local address http://localhost:3000 and provides the default user and password admin.

observability-tools's Issues

Set up Health dashboards for docker containers

Is your feature request related to a problem? Please describe.
All running containers should be mapped on grafana for monitoring.

Describe the solution you'd like

• Create dashboards

Additional context
Will check all necessary dashboards and update the task later

• Check how to use cAdvisor and if it can be applied for that.

Create log monitoring

Study how to do this integration.

• Kibana?
• Loki?

I guess loki will be better because we can integrate it with grafana.

Create dashboards to check apps health

• Add dashboard for jvm memory
• Add dashboard for used threads
• Add dashboard for disk usage
• Add dashbaord for network traffic (?)
• Check any other useful dashboard to add

Set up micrometer tracing

Zipkin is being replaced by micrometer tracing: https://spring.io/projects/spring-cloud-sleuth

Set up it for all the applications https://micrometer.io/docs/tracing.

Check if this is supported on grafana