Giter Site home page Giter Site logo

sirnicholas1st's Projects

aws-iot-core-pipeline icon aws-iot-core-pipeline

This repository for researching and building a pipeline where a client sends data to AWS-iotcore where Kinesis Firehose will buffer and feed the data to a Lambda function.

budget_app icon budget_app

A flask application where the user can track their expenses.

cdk-etl-lambda icon cdk-etl-lambda

This repo contains a example how to deploy a simple ETL-lambda using AWS CDK. The Lambda itself will not contain any actual parsing but has examples on how to report and handle batch item failures etc.

feedback_processor icon feedback_processor

This repository contains a simple Flask application that serves as a customer feedback form. The submitted data is sent to a Kafka topic. The Kafka consumer, implemented as a Spark application, processes the data and writes it to a Cassandra table for further analysis.

kafka_datastream icon kafka_datastream

the project simulates a small real time dataflow with Apache Kafka and saves the data to Apache Cassandra.

nlp_classification icon nlp_classification

Creating a Steam review classifier with God of War data that was scrapped in a previous project.

snowflake-datapipe icon snowflake-datapipe

The goal is to build an example of a simple data collection pipeline which collects data from multiple customers and uploads the data to Snowflake could look like. The OpenMeteo Api acts as the "customer system" in this case.

spotify_etl icon spotify_etl

An ETL build with Airflow that fetches songs played during the day from Spotify API and uploads the data to Snowflake

steam_2_postgres icon steam_2_postgres

Simple pipeline for scraping Steam review data every 30 minutes and uploading it to a Postgres db using Apache Airflow

titanic_ds icon titanic_ds

Comparing different machine learning algorithms on the Titanic data

weather_etl icon weather_etl

ETL built with Airflow which fetches data from Open-Meteo API, uploads it to Snowflake and displays the data in PowerBI

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.