milinbhakta / data-pipeline Goto Github PK
View Code? Open in Web Editor NEWThis project orchestrates a real-time data pipeline using Docker Compose, PostgreSQL, RabbitMQ, Logstash, and Elasticsearch. It automates the process of publishing messages from a PostgreSQL 'user table' to RabbitMQ, which are then consumed by Logstash and indexed into Elasticsearch for efficient querying and analysis.