Giter Site home page Giter Site logo

data-engineer-roadmap related contents

Best Match Most Stars ↓ Fewest Stars ↑ Most Forks ↓ Fewest Forks ↑

  • chandinidas / cloud-services-company-in-india

    data-engineer-roadmap, As is widely known, the growth of Data in the present age of Information Technology is immense and overwhelming. The problem of storing such quantities of data is a major research ground for enthusiasts today and owing to their consistent efforts over the last decade, the solution of Cloud as a service was devised. Cloud storage enables users to store huge amounts of data remotely and without the ownership of any hardware units. Imagine how tedious and expensive it would have been if all firms today had to host their own storage units for data. It not only would have been a huge overhead expense, but also would have restricted the company’s data and computing flexibility. OpenTeQ provides you with expertise to wield extremely popular and effective cloud services with ease. We make sure that our experts design the most appropriate cloud architecture which fits the use case of your firm such that there is ease of data access, data management and processing. Our service enables you with the advantage of saving investments on skilled cloud engineers and also advanced hardware units unnecessarily. We ensure that your storage and processing requirements are met in along with your data management schemes. Just choose from the several cloud services we offer, and rest assured while we arrange for a smooth roadmap! Read more about <a href="http://www.openteqconsultants.com/cloud-services.html">Cloud Services Company In India</a>

    From user chandinidas

  • kaustubhyerkade / kaustubh-yerkade

    data-engineer-roadmap, DE Stuff - Programming & DSA in Python Distrubuted computation & storage -Hadoop - imp - spark,spark sql file format - json,avro,parquet type of data - structiured & semi sturectured processing mechniasm - batch & real time pub sub -kafka or AWS Kinesis data warehuse desginng amazon - ecomerce, netflix sql complex transactional & no sql databases - key value ,document,columanr base,graph base db,-mongodb,caseendra,hbase - data visualization tools- ETL tools cloud services- experience 🔥𝗜𝗺𝗽𝗼𝗿𝘁𝗮𝗻𝘁 𝗥𝗲𝘀𝗼𝘂𝗿𝗰𝗲𝘀🔥 🔴 Data Engineer Roadmap Document : ➡️https://docs.google.com/document/d/1g...​ 🔴 Python : ➡️ https://www.youtube.com/watch?v=_uQrJ...​ ➡️ https://www.programiz.com/python-prog...​ 🔴 Scala : ➡️ https://www.youtube.com/watch?v=LQVDJ...​ ➡️ http://allaboutscala.com/​ 🔴 Java : ➡️ https://www.youtube.com/watch?v=eIrMb...​ ➡️ https://beginnersbook.com/java-tutori...​ 🔴 Linux, Unix, Shell Scripting : ➡️ https://practice.geeksforgeeks.org/ba...​ ➡️ Above one is free course with invitation code - ELEARNINGBLINUX 🔴 Data Structures & Algorithms : ➡️ https://www.youtube.com/watch?v=5_5oE...​ ➡️ https://www.geeksforgeeks.org/​ ➡️ https://leetcode.com/​ 🔴 DBMS : ➡️ https://www.youtube.com/watch?v=kBdlM...​ ➡️ https://www.studytonight.com/dbms/​ 🔴 SQL Scripting : ➡️ https://www.youtube.com/watch?v=HXV3z...​ ➡️ https://www.youtube.com/watch?v=7S_tz...​ ➡️ https://www.w3schools.com/sql/​ 🔴 Basic Terminologies In BigData : ➡️ https://data-flair.training/blogs/wha...​ ➡️ https://www.edureka.co/blog/what-is-b...​ 🔴 Data Exploration Libraries : ➡️ Pandas - https://www.youtube.com/watch?v=UB3DE...​ ➡️ NumPy - https://www.youtube.com/watch?v=DI8wg...​ 🔴 Data Warehousing Concepts : ➡️ https://www.youtube.com/watch?v=J326L...​ ➡️https://www.tutorialspoint.com/dwh/dw...​. 🔴 BigData Frameworks (Hadoop, Hive, Spark, Sqoop, Nifi, Flume) : ➡️ https://www.youtube.com/results?searc...​ ➡️ https://www.youtube.com/user/edurekaIN​ ➡️ https://data-flair.training/​ ➡️ https://www.edureka.co/​ 🔴 Workflow Schedulers, Dependency Management : ➡️ https://www.youtube.com/watch?v=niJ06...​ ➡️ https://www.youtube.com/watch?v=6RebQ...​ 🔴 NoSQL Databases : ➡️ HBase - https://www.youtube.com/watch?v=NOX6-...​ ➡️ Cassandra - https://www.youtube.com/watch?v=iDhIj...​ ➡️ Elastic Search - https://www.youtube.com/watch?v=1Envk...​ ➡️ MongoDB - https://www.youtube.com/watch?v=pWbMr...​ 🔴 Apache Kafka : ➡️ https://www.youtube.com/watch?v=daRyk...​ 🔴 Dashboarding Tools : ➡️ Tableau - https://www.youtube.com/watch?v=aHaOI...​ ➡️ PowerBI - https://www.youtube.com/watch?v=3u7MQ...​ ➡️ Grafana - https://www.youtube.com/watch?v=CjABE...​ ➡️ Kibana - https://www.youtube.com/watch?v=gQ1c1...​ 🔴 BigData Services in Cloud (AWS) : ➡️ https://www.youtube.com/watch?v=k1RI5...​ ➡️ https://www.youtube.com/watch?v=8PyLr...​ ➡️ https://www.simplilearn.com/aws-big-d...​ 𝗜𝗺𝗽𝗼𝗿𝘁𝗮𝗻𝘁 𝘁𝗼𝗽𝗶𝗰𝘀 𝗶𝗻 𝗦𝗤𝗟 : 📌 Joins 📌 Group By 📌 Nested joins 📌 Case-When conditions 📌 Window functions 𝗧𝗲𝗰𝗵 𝘀𝘁𝗮𝗰𝗸 𝗳𝗼𝗿 𝗿𝗲𝗮𝗹𝘁𝗶𝗺𝗲 𝗱𝗮𝘁𝗮 𝗽𝗶𝗽𝗲𝗹𝗶𝗻𝗲𝘀 : 📌 Apache Kafka 📌 Apache Flink 📌 Apache Storm 📌 AWS Kinesis 📌 Spark Streaming 𝗕𝗶𝗴𝗗𝗮𝘁𝗮 𝗳𝗿𝗮𝗺𝗲𝘄𝗼𝗿𝗸𝘀 𝗮𝗻𝗱 𝗛𝗮𝗱𝗼𝗼𝗽 𝗲𝗰𝗼𝘀𝘆𝘀𝘁𝗲𝗺 : 📌 Hadoop architecture, Map-Reduce, HDFS, Yarn 📌 Apache Spark 📌 Hive 📌 Flume 📌 Sqoop 📌 Zookeeper 📌 Ambari, Hue 📌 Oozie, Airflow, Azkaban 𝗗𝗮𝘁𝗮 𝗩𝗶𝘀𝘂𝗮𝗹𝗶𝘇𝗮𝘁𝗶𝗼𝗻 𝗧𝗼𝗼𝗹𝘀 : 📌 Tableau 📌 Power BI 📌 Qlik Sense 📌 Grafana 📌 Kibana 𝗧𝗿𝗮𝗻𝘀𝗮𝗰𝘁𝗶𝗼𝗻𝗮𝗹 𝗗𝗮𝘁𝗮𝗯𝗮𝘀𝗲𝘀 : 📌 Amazon Aurora 📌 PostgreSQL 📌 MySQL 📌 MariaDB 📌 Oracle 📌 SQL Server 𝗡𝗼-𝗦𝗤𝗟 𝗗𝗮𝘁𝗮𝗯𝗮𝘀𝗲𝘀 : 📌 DynamoDB 📌 Cassandra 📌 MongoDB 📌 ElasticSearch 📌 HBase 📌 Couchbase 📌 Redis Book - Practical Statistics for Data Scientists: 50+ Essential Concepts Using R and Python 2nd Edition,

    From user kaustubhyerkade

  • pritish-sinha / data-engineering

    data-engineer-roadmap, This repository serves as a testament to my continuous skill development and progress on the path of becoming a proficient data engineer. It showcases the projects I have undertaken as part of my learning journey, demonstrating my growth and dedication to mastering each topic outlined in the roadmap of data engineering.

    From user pritish-sinha

Next →

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.