razevedo1994/data_engineer_roadmap

Personal roadmap to guide my studies.

Data Engineer Roadmap

Created by: Rodrigo Azevedo

• YouTube How Data Engineering Works

Code versioning

• What is version control?
• Versionamento Semântico
• YouTube Curso completo de GIT

Programming Language

• LinuxTips Python Base
• YouTube Python for Data Engineering
• Udemy Complete Python Bootcamp From Zero to Hero in Python

Python Virtual Environments

• YouTubeAmbientes virtuais e instalação de bibliotecas
• Real PythonPython Virtual Environments: A Primer

SQL

• Twitch Curso de SQL do Zero - Teo Calvo
• Udemy The Complete SQL Bootcamp
• YouTube SQL Tutorial - Full Database Course for Beginners

Linux

• YouTube Linux Command Line Full course
• Udemy Linux for Beginners
• Shell Script: Introdução e Como Automatizar Tarefas
• Introduction to automation with Bash scripts
• Bash Automation & Scripting Basics
• 27 Simple Bash Scripting Tips for Beginners
• The Ultimate Programmer’s Guide to Bash Scripting
• 8 Bash Script Tips for Automation Projects

HTTP/HTTPS

• YouTube HTTP Crash Course & Exploration

API's

• YouTube APIs for Beginners - How to use an API
• Youtube What Is A RESTful API? Explanation of REST & HTTP

Docker

• Começando com Docker
• YouTube Docker Tutorial for Beginners
• YouTube Docker Compose Tutorial
• Dockerfile reference
• Dockerfile: principais comandos e instruções
• Docker: Desvendando o DockerFile
• Dockerfile - Principais comandos para criar a receita da imagem
• Dockerfile cheat sheets

Concepts
Big Data: Entenda mais sobre esse conceito
Data Lake vs Data Warehouse
Data Modeling
Data Warehouse
Data Lake
Data Lake
ETL vs ELT
Data Mesh
Batch Processing vs Stream Processing
Batch Processing Example
Stream Processing Example

Big Data Fundamentals

• YouTubeBig Data Tutorial For Beginners
• Udemy The Hadoop Ecosystem

Data Warehouse

• Udemy Data Warehouse Fundamentals for Beginners

Data Orchestration

• Udemy The Complete Hands-On Introduction to Apache Airflow
• Udemy Apache Airflow: The Hands-On Guide
• YouTube Supletivo DH - Apache Airflow

Big Data Processing

• Udemy Spark and Python for Big Data with PySpark

Cloud

• Udemy AWS