hussein-awala Goto Github PK

followers: 59.0 following: 9.0 repos: 49.0 gists: 3.0

Name: Hussein Awala

Type: User

Company: @VoodooTeam

Bio: Sr. Data Engineer at Voodoo | Apache Airflow Committer & PMC member

Twitter: _HusseinAwala

Location: Paris, France

Blog: https://hussein.awala.fr/

Hi there, I'm Hussein

About Myself:

👨🏼‍💻 I'm a Senior Data Engineer within the Ads Network team at Voodoo in Paris, and an Apache committer and PMC member at Apache Airflow
💡 I design, develop and maintain data platforms, especially the modern lakehouse architectures and the stream processing applications
🔬 I am responsible for serving and improving the performance of the ML models and the feature store
🔒 I ensure the security of user data on the data platform, in compliance with the regulations in force (GDPR, e-privacy)
🤝🏻 I contribute to different popular open-source projects (Airflow, Iceberg, Hudi, ...) and my own open-source projects (spark-on-k8s, airflow-duckdb, and async-batcher)
⚡ Fun fact: I am always seeking new opportunities to learn. Also, I love to cook, swim and watch movies or TV series.

Projects I am working on currently:

Improving the performance of a real-time bidding system by implementing a batching mechanism to reduce the resource consumption and the latency, and by optimizing the feature store structure and data freshness
Designing and developing a new lakehouse architecture using spark, iceberg, airflow, dbt and S3, to store the company data in a modern and cheap data store respecting the GDPR

Some frameworks I am working with currently 💻:

Some of my GitHub Stats:

Connect with me:

Hussein Awala's Projects

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

airflow-ci-infra

Automation around CI infrastructure for Apache Airflow

airflow-client-java

Apache Airflow - OpenApi Client for Java

airflow-duckdb

A package to run DuckDB queries from Apache Airflow.

airflow-server

Docker configuration for airflow server with Localexecutor

androidproject

This is the kernel of the news application

argo

Argo Workflows: Get stuff done with Kubernetes.

arrow

Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing

This repository is for active development of the Azure SDK for Python. For consumers of the SDK we recommend visiting our public developer docs at https://docs.microsoft.com/python/azure/ or our versioned developer docs at https://azure.github.io/azure-sdk-for-python.

convex-and-distributed-optimization

data_mining

dataserver

dmlsds

fashion-images-autoencoder

fastapi-app

A simple application developed by python FastAPI

flask

The Python micro framework for building web applications.

gui

create a graphical interface to a project using this project by drag and drop methods

hive

Apache Hive

hudi

Upserts, Deletes And Incremental Processing on Big Data.

hussein-awala

hussein-awala.github.io

iceberg

Apache Iceberg

iceberg-python

Apache PyIceberg

incubator-xtable

Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.

info-vis

lightflow

meteospark

meteo-spark is an open source project that aims to simplify the Climate Data Analysis using PySpark, which allow the processing of very big files saved in the cloud (S3, GCS, ...) on a large pyspark cluster managed by YARN or Kubernetes.

hussein-awala Goto Github PK

Hi there, I'm Hussein

Connect with me:

Hussein Awala's Projects

Recommend Projects

Recommend Topics

Recommend Org