bermands Goto Github PK

availability_calendar

de_testing_api_parser

Test for design Model data and parsing procedures for definite API

de_testing_pandas

Test task for pandas using

de_testing_sql

Test tasks for testing SQL queries

debezium_confluent_kafka

The test case of using Debezium producer for kafka with AVRO and Schema registry

football_data_pipeline_v1

Data pipeline with using as source - samples of Football matches data with imitation Streaming API. The further points in pipeline will be Kafka, Faust framework and PostgreSQL.

from_kafka_flink_to_postgresql

Example of using Apache Flink as connector to Apache Kafka for storing data to PostgreSQL

gender_detection

Docker application for making gender detection

jupyter_sandbox

kafka-example

Example project for Spring Boot + Apache Kafka + Docker-compose solution

kafka_broker

Deployment kafka cluster in example of SparkStrteaming using

postgres_db

Building PostgreSQL and PG admin from docker

spark_stream_to_bigquery

Consuming stream from Kafka by Spark job on GCP with landing to BigQuery. Dagster as orchestrator.

streaming_api_to_kafka

Example of processing streaming API with publishing to Kafka

test_spark_s3

Simple test of the functionality with AWS S3 from PySpark

weather_api

Architecture of a micro-service that exposes a REST API and delivers the functionality of caching data in local storage

wikipedia_data_pipeline

Data pipeline with using as source - Streaming API from wikipedia.org. The further points in pipeline will be Kafka, Flink framework and PostgreSQL.

youtube_downloader

service for downloading content from youtube and uploading to cloud