Giter Site home page Giter Site logo

arunp77 / database-datapipeline-etl Goto Github PK

View Code? Open in Web Editor NEW
3.0 1.0 1.0 23.71 MB

SQL, Databases, warehouses, Data lake, cloud storage, MYSQL, Data Pipeline

Home Page: https://arunp77.github.io/Data-engineering.html

License: MIT License

Jupyter Notebook 81.07% HTML 18.93%
apache-airflow apache-nifi aws aws-cloudformation aws-ec2 aws-lambda aws-s3 data-pipeline datawarehouse etl

database-datapipeline-etl's Introduction

๐Ÿ’ซ About Me:

Yellow   Black Simple Profile LinkedIn Banner

Click here to see my portfolio ๐Ÿ”—

Typing SVG


Few resources are as follows:

  • Please have a look on my open source python library at link.
  • Application of Monte-Carlo simulation to finance.
  • Please visit My blog to explore posts on Data science, Data engineering, and others.
  • Please visit my Academic website
  • For Data enginnering tools, please visit my repos at Link

Let's connect on linkedin: : LinkedIn


๐Ÿ”ญ Iโ€™m a data enthusiast with a background in astrophysics.

๐ŸŒฑ Iโ€™m passionate about data analytics, data engineering, machine learning, and deep learning.

๐Ÿ’ฌ Ask me about data analysis, machine learning, and ETL pipelines.

๐Ÿ“ซ You can reach me at [email protected].

๐ŸŒ Socials: I am also available on: LinkedIn Twitter Facebook Instagram

โšก Fun fact: crazy about football.

๐Ÿ“ Address: Observable Universe/Virgo Supercluster/Milky Way Galaxy/Solar System/Earth/Europe/Germany

Feel free to explore my repositories and projects, and don't hesitate to reach out for collaboration or discussions!


๐Ÿ’ป Tech Stack:

  • Programming Languages:

    • Python Pandas NumPy Matplotlib Seaborn Plotly SciPy

    • Machine Learning mlflow Deep Learning scikit-learn Statsmodels TensorFlow PyTorch Keras

    • Mathematica

  • DATABase & tools: SQL MySQL NoSQL MongoDB Google BigQuery Postgres

  • Data Engineering: PySpark Scala Spark Kafka Neo4j Hadoop Apache Spark AWS Google Cloud Platform (GCP) EC2 S3 Lambda Snowflake Snowpipe Apache Airflow Anaconda

  • Version Control: GitLab CI GitHub Actions Jenkins GithubPages

  • Web Development: HTML5 CSS3 Beautiful Soup Selenium Dash FastAPI Flask JavaScript

  • Bash and shell Scripting: Shell Scripting APIs CI/CD Pipelines Unit Test

  • Visualization:

  • Documentation: LaTeX

๐Ÿ“Š GitHub Stats:

Arun's github activity graph

๐Ÿ” Top Contributed Repo

๐Ÿ† GitHub Trophies


๐Ÿ’ฐ My Open Source Contributions

Patreon BuyMeACoffee

Founding member of Vision Analytica.

database-datapipeline-etl's People

Contributors

arunp77 avatar

Stargazers

 avatar  avatar  avatar

Watchers

 avatar

Forkers

anhphha

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.