Name: Start Data Engineering
Type: User
Twitter: startdataeng
Location: New York
🔭 I write data engineering articles on Start data engineering
👨💻 All of my projects are available at https://github.com/josephmachado
📝 I regularly write articles on https://www.startdataengineering.com/
💬 Ask me about Data engineering, SQL, Databases, Data pipelines, Data infrastructure
📫 How to reach me https://www.startdataengineering.com/contact
📄 Know about my experiences https://www.linkedin.com/in/josephmachado1991/
adv_data_transformation_in_sql
Code for "Advanced data transformations in SQL" free live workshop
adventureworks_exploration
analytical_dp_with_sql
Code for my "Efficient Data Processing in SQL" book.
beginner_de_project
Beginner data engineering project - batch edition
beginner_de_project_stream
Simple stream processing pipeline
bitcoinmonitor
Near real time ETL to populate a dashboard.
change_data_capture
Repo for CDC with debezium blog post
cost_effective_data_pipelines
Cost Efficient Data Pipelines with DuckDB
data
open data for blog content at https://www.startdataengineering.com/
data-engineering-interview-series
Repository for Data Engineering Interview Series
data-pipeline-generator
Data pipeline code generator for portfolio projects
data-quality-w-greatexpectations
Code for data quality with greatexpectations blog
data_engineering_best_practices
Sample project to demonstrate data engineering best practices
data_engineering_best_practices_log
Code to demonstrate data engineering metadata & logging best practices
data_engineering_project_template
A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
data_helper
Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/
data_test_ci
Repository showing how to automate data testing as part of CI
dbt_development
Repo to explain development, CI/CD cycle in dbt
docker-trino-cluster
Multiple node presto cluster on docker container
docker_for_data_engineers
Code for blog at: https://www.startdataengineering.com/post/docker-for-de/
e2e_datapipeline_test
Example repo to create end to end tests for data pipeline.
efficient_data_processing_spark
Code for "Efficient Data Processing in Spark" Course
etl-dashboard
Simple ETL demonstrated with literate programming
files
public file hosting
hive-metastore
how-to-slash-dbt-cost-w-duckdb
iceberg-features
idempotent-data-pipeline
Making data pipelines idempotent
josephmachado
Profile readme
local_dev
Local development environment for python data projects, with Docker
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.
