aws-samples/amazon-ecs-fluent-bit-daemon-service

Fluent Bit plugin-based centralized log analysis across Amazon ECS & EKS clusters

Centralized logging in action: multi-cluster log analysis

This repo contains the container runtime definitions and configurations for an end-to-end demo of the Amazon Fluent Bit plugin, showing a multi-cluster (ECS/EKS) log analysis, streaming the log data Kinesis Data Firehose to S3, where we then query the log data with Amazon Athena.

See the blog: Centralized Container Logging with Fluent Bit.

Setup for Amazon ECS

See the ecs/ directory of this repo for all the source files.

Setup for Amazon EKS

See the eks/ directory of this repo for all the source files.

Setup for log analysis

See the log-analysis/ directory of this repo for all the source files.

License

All material available under the Apache License Version 2.0.

amazon-ecs-fluent-bit-daemon-service's Issues

🚨 This example is very old and will soon be replaced

I am working on this: aws/containers-roadmap#1876

Which will provide a much better experience. Some work in progress is here: aws/aws-for-fluent-bit#499

Once the new daemon is released, this repo should be archived or a note should be added that its no longer recommended.