sirnicholas1st Goto Github PK
Type: User
Bio: Quite fresh self learned Data Engineer building stuff when I have the time. Currently working as a DE mainly with industrial data.
Type: User
Bio: Quite fresh self learned Data Engineer building stuff when I have the time. Currently working as a DE mainly with industrial data.
This repository for researching and building a pipeline where a client sends data to AWS-iotcore where Kinesis Firehose will buffer and feed the data to a Lambda function.
A flask application where the user can track their expenses.
This repo contains a example how to deploy a simple ETL-lambda using AWS CDK. The Lambda itself will not contain any actual parsing but has examples on how to report and handle batch item failures etc.
This repository contains a simple Flask application that serves as a customer feedback form. The submitted data is sent to a Kafka topic. The Kafka consumer, implemented as a Spark application, processes the data and writes it to a Cassandra table for further analysis.
Scraping steam reviews for God of War using Selenium and BS
the project simulates a small real time dataflow with Apache Kafka and saves the data to Apache Cassandra.
Creating a Steam review classifier with God of War data that was scrapped in a previous project.
The goal is to build an example of a simple data collection pipeline which collects data from multiple customers and uploads the data to Snowflake could look like. The OpenMeteo Api acts as the "customer system" in this case.
An ETL build with Airflow that fetches songs played during the day from Spotify API and uploads the data to Snowflake
Simple pipeline for scraping Steam review data every 30 minutes and uploading it to a Postgres db using Apache Airflow
Comparing different machine learning algorithms on the Titanic data
ETL built with Airflow which fetches data from Open-Meteo API, uploads it to Snowflake and displays the data in PowerBI
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.