ghiles10 Goto Github PK

api

docker_word-cloud-movie-reccomendation

econometrics-inflation-r

etl-sql-airflow

This is a simple ETL using postgreSQL, Airflow and twitter API

etl_star_schema_music_data

This repository houses an ETL pipeline that processes music data sourced from a music application. The pipeline retrieves data from logs and files, transforms it, and loads it into a star schema in a PostgreSQL database

filmanalysis

This project aims to collect data on movies from different websites using web scrapping technique. This data is then presented to the user via a user interface built with Flask. The user can choose a movie and display the associated data.The project is deployed with Docker file

gcp_streaming-crypto-etl

This project involves creating a pipeline for real-time cryptocurrency data using modern technologies. The pipeline fetches data from Kucoin API, processes it using kafka and Spark Streaming on a DataProc cluster, and stores it in BigQuery. Apache Airflow orchestrates the process, while Terraform manages the infrastructure.

microservices

real-time-finance-tweets-dashboard

ETL pipeline integrating MongoDB, ElasticSearch, BigQuery, Spark and other relevant technologies

tic-tac-toe-algorithm

twitter_etl_aws

word-coud-movie-recommendation

This project retrieves movie data using web scrapping, creates a database on postgresql and finally displays a word cloud of user reviews and recomendation on a specific movie created in a UI with Dash. a film recommendation system was developed using Principal Component Analysis and K-Means clustering. The project is deployed with Docker compose