This project aims to build a scalable and efficient data engineering platform on AWS. The platform consists of several components including data ingestion, storage, processing, aggregation, and visualization.
- Data Ingestion: AWS Kinesis
- Data Storage: AWS S3
- Data Processing: AWS Glue
- Data Aggregation: Glue
- Data Visualization: QuickSight