Light

longbuivan Goto Github PK

followers: 34.0 following: 8.0 repos: 24.0 gists: 0.0

Name: Long Bui

Type: User

Bio: Data Engineer, Technical Author #data-engineering #data-platform #open-sources

Twitter: longdatadevlog

Blog: https://longdatadevlog.com

📓 Hi, I'm Long.

Here are recent thoughts... → see it

I build and document the data systems for bringing data to decentralized data architecture

Development Open Data Solution: building a data toolkit for data engineering StringX, enable data with DataPods
Technical Blogs: reaching readers with technical posts at Blogs and on Talk & Share
Maintain Data Engineering Books: helping others organize and search daily data engineering questions Data Engineering Handbook and breaking data systematic problems with Solid Data Foundations

I write and talk to reinforce the self-learning. Trying to explain things better and simpler, and use knowledge package management to shape everything firmly relevant with Mapping of Contents (MoC).

In case you're interested, reach out to me at social icons below.

Long Bui's Projects

airflow-spark

Docker with Airflow and Spark standalone cluster

airflow-spark-data-pipeline

There is repo for demonstrate a simple video analysis using airflow and spark

arrow

Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing

automated-infra-testing

To run test on localstack whenever deployment

bird_strike_prediction

Use 3 classification models and ensemble to predict an impact of birds strike in aviation

demo-scene

Scripts and samples to support Confluent Platform talks. May be rough around the edges. For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/

dotfile

This is dotfile, to Setup Development Environment as Data Engineer

localstack-dev

This repo for how to use localstack as Mock AWS Cloud.

mage-ai

🧙 Mage is an open-source data pipeline tool for transforming and integrating data.

playbook

Guides for getting things done, programming well, and programming in style.

superset

Apache Superset is a Data Visualization and Data Exploration Platform

system-design-primer

Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

terraform-databricks-lakehouse-blueprints

Set of Terraform automation templates and quickstart demos to jumpstart the design of a Lakehouse on Databricks. This project has incorporated best practices across the industries we work with to deliver composable modules to build a workspace to comply with the highest platform security and governance standards.

tiki_data_scrapper

tiki_scrapper_db

In this repo, this is how to config MySQL and store all data that extracting in front-end of tiki.

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.