Topic: data-warehouse Goto Github

👇 Here are 479 public repositories matching this topic...

alanchn31 / data-engineering-projects
data-warehouse,Personal Data Engineering Projects
User: alanchn31
data-lake ingest-data data-engineering data-warehouse cassandra aws-redshift mongodb scrapy spark airflow

anna-geller / prefect-streaming
data-warehouse,Example project demonstrating deployment patterns for real-time streaming workflows with Prefect 2.0
User: anna-geller
automation aws data data-engineering dataflow dataflow-ops ecs-fargate engineering prefect real-time

appdynamics / appdynamics.dexter
data-warehouse,Turn your APM data store into a Data Warehouse with advanced reporting, including entities, configuration, metrics, flowmaps, events, snapshots and call graph flame graphs
Organization: appdynamics
Home Page: https://www.appdynamics.com/community/exchange/extension/appdynamics-dexter-data-extraction-enhanced-reporting/
appdynamics flamegraph apm data-warehouse reporting dotnet dotnet-core metrics callgraph snapshot

beneath-hq / beneath
data-warehouse,Beneath is a serverless real-time data platform ⚡️
Organization: beneath-hq
Home Page: https://beneath.dev
dataops mlops data-science data-engineering data-pipelines developer-tools data-warehouse streaming etl analytics

blankerl / dxy-covid-19-data
data-warehouse,2019新型冠状病毒疫情时间序列数据仓库 | COVID-19/2019-nCoV Infection Time Series Data Warehouse
User: blankerl
Home Page: https://lab.isaaclin.cn/nCoV/
2019-ncov data-warehouse

canner / vulcan-sql
data-warehouse,Data API Framework for AI Agents and Data Apps
Organization: canner
Home Page: https://vulcansql.com
api-builder data-lake data-warehouse database sql analytics reporting spreadsheet bigquery duckdb

canner / wren-engine
data-warehouse,Wren Engine is the backbone of the Wren AI project - The semantic engine for LLMs, bringing business context to AI agents.
Organization: canner
Home Page: https://getwren.ai
business-intelligence data data-analysis data-analytics data-lake data-warehouse sql semantic semantic-layer llm

cloudberrydb / cloudberrydb
data-warehouse,Cloudberry Database - Open source alternative to Greenplum Database. Created by the original Greenplum developers.
Organization: cloudberrydb
Home Page: https://cloudberrydb.org/
ai cloudberrydb data-analysis data-warehouse database database-management gpdb greenplum greenplum-database mpp olap postgres postgresql postgresql-database sql

cloudera / hue
data-warehouse,Open source SQL Query Assistant service for Databases/Warehouses
Organization: cloudera
Home Page: https://cloudera.com
sql sql-editor databases data-warehouse query-editor sql-assistant autocomplete compose

dalenewman / transformalize
data-warehouse,Configurable Extract, Transform, and Load
User: dalenewman
etl etl-framework denormalize elasticsearch solr sql-server mysql postgresql sqlce sqlite

data-engineering-community / data-engineering-project-template
data-warehouse,This is a template you can use for your next data engineering portfolio project.
Organization: data-engineering-community
Home Page: https://dataengineering.wiki
data-engineering sql python data data-warehouse etl etl-pipeline

databrewery / cubes
data-warehouse,[NOT MAINTAINED] Light-weight Python OLAP framework for multi-dimensional data analysis
Organization: databrewery
Home Page: http://cubes.databrewery.org
olap data data-warehouse sql multidimensional-analysis cube data-analysis

dimgold / etl_with_python
data-warehouse,ETL with Python - Taught at DWH course 2017 (TAU)
User: dimgold
petl mysql python jupyter-notebook etl data-warehouse data-base mysqldb extract-transform-load csv

dlt-hub / dlt
data-warehouse,data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
Organization: dlt-hub
Home Page: https://dlthub.com/docs
data python data-engineering data-lake data-loading data-warehouse elt extract load transform

domainmod / domainmod
data-warehouse,DomainMOD is an open source application written in PHP & MySQL used to manage your domains and other internet assets in a central location. DomainMOD also includes a Data Warehouse framework that allows you to import your web server data so that you can view, export, and report on your live data.
Organization: domainmod
Home Page: https://domainmod.org
php mysql domains whm cpanel data-warehouse hacktoberfest mariadb

elementary-data / elementary
data-warehouse,The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
Organization: elementary-data
Home Page: https://www.elementary-data.com/
data-lineage data-governance data-warehouse snowflake bigquery data-analysis data-pipelines data-pipeline lineage data-reliability

gclunies / reflekt
data-warehouse,Define, govern, and model event data for warehouse-first product analytics.
User: gclunies
avo customer-data-platform data-modeling data-quality data-warehouse dbt dbt-package events governance product-analytics

getmetamapper / metamapper
data-warehouse,Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.
Organization: getmetamapper
Home Page: https://www.metamapper.io
metamapper data-catalog data-discovery schema-inspection data-warehouse python django data-curation metadata

gokumohandas / data-engineering
data-warehouse,Construct a modern data stack and orchestration the workflows to create high quality data for analytics and ML applications.
User: gokumohandas
airflow data-engineering data-warehouse dbt etl machine-learning mlops orchestration

google / space
data-warehouse,Unified storage framework for the entire machine learning lifecycle
Organization: google
dataset lakehouse machine-learning mlops olap ray tensorflow tensorflow-dataset apache-arrow apache-parquet

googlecloudplatform / bigquery-utils
data-warehouse,Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.
Organization: googlecloudplatform
Home Page: https://cloud.google.com/bigquery/
bigquery google-cloud-platform data-warehouse sql utilities

hydradatabase / hydra
data-warehouse,Hydra: Column-oriented Postgres. Add scalable analytics to your project in minutes.
Organization: hydradatabase
Home Page: https://www.hydra.so
data-warehouse datawarehouse postgres postgresql postgresql-extension

iam-mhaseeb / skytrax-data-warehouse
data-warehouse,A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.
User: iam-mhaseeb
python python3 database data-visualization data-analysis data-warehouse data-warehousing redshift airflow docker

iiasa / ixmp
data-warehouse,The ix modeling platform for integrated and cross-cutting scenario analysis
Organization: iiasa
Home Page: https://docs.messageix.org/ixmp
integrated-assessment energy-system modeling-tool data-warehouse open-source

intermine / intermine
data-warehouse,A powerful open source data warehouse system
Organization: intermine
Home Page: http://intermine.org
data-warehouse java tomcat genomics open-source opensource lgplv3 postgresql clojure clojurescript

izhangzhihao / real-time-data-warehouse
data-warehouse,Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi
User: izhangzhihao
flink data-warehouse real-time-data-warehouse data-warehousing flink-sql debezium kafka elasticsearch delta-lake cdc

massstreetanalytics / etl-framework
data-warehouse,A framework for moving data into a data warehouse.
Organization: massstreetanalytics
Home Page: http://www.datawarehouseetlframework.com/
etl python sqlserver sql etl-framework etl-pipeline etl-components data-warehouse

materializeinc / materialize
data-warehouse,The data warehouse for operational workloads.
Organization: materializeinc
Home Page: https://materialize.com
rust database sql streaming kafka distributed-systems postgresql-dialect materialized-view stream-processing postgresql

multiwoven / multiwoven
data-warehouse,🔥🔥🔥 Open Source Alternative to Hightouch, Census, and RudderStack - Reverse ETL & Customer Data Platform (CDP)
Organization: multiwoven
Home Page: https://squared.ai/multiwoven-reverse-etl
data-engineering reverse-etl data-pipeline data-activation etl react ruby self-hosted open-source dbt

oxnr / awesome-bigdata
data-warehouse,A curated list of awesome big data frameworks, ressources and other awesomeness.
User: oxnr
Home Page: https://github.com/onurakpolat/awesome-bigdata
awesome bigdata data-warehouse data-analytics data-visualization data-stream database data-science data awesome-list

pixelsdb / pixels
data-warehouse,An efficient storage and compute engine for both on-prem and cloud-native data analytics.
Organization: pixelsdb
cloud-database column-store data-lake data-warehouse database olap

pracdata / awesome-open-source-data-engineering
data-warehouse,A curated list of open source tools used in analytical stacks and data engineering ecosystem
Organization: pracdata
awesome awesome-list data-analytics data-engineering data-platform database self-hosted mlops data-storage data

raystack / optimus
data-warehouse,Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Organization: raystack
Home Page: https://raystack.github.io/optimus
airflow etl workflows automation golang bigquery data-warehouse analytics data-modelling analytics-engineering

rello / analytics
data-warehouse,Analytics - Open source data warehouse and reporting for Nextcloud
User: rello
analytics data data-warehouse datasources nextcloud visualization

rudderlabs / rudder-server
data-warehouse,Privacy and Security focused Segment-alternative, in Golang and React
Organization: rudderlabs
Home Page: https://www.rudderstack.com/
privacy warehouse-management data-warehouse customer-data customer-data-pipeline customer-data-platform customer-data-lake segment-alternative data-integration data-synchronization

san089 / udacity-data-engineering-projects
data-warehouse,Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
User: san089
data data-engineering data-engineering-pipeline etl-pipeline cassandra-database postgresql-database data-modeling data-warehouse data-lake airflow

sap-samples / analytics-cloud-datasphere-community-content
data-warehouse,Download content packages for SAP Analytics Cloud and SAP Datasphere. Find technical samples, best practices or business scenarios. Packages contain data models, visualisations and sample data (if applicable).
Organization: sap-samples
analytics content data-warehouse sample sample-code sap-analytics-cloud sap-datasphere

sap-samples / datasphere-content
data-warehouse,Use sample content to explorer SAP Datasphere. The downloads contain sample data as CSV files, but could also include model / metadata information. See the README files for details.
Organization: sap-samples
sap-hana data-warehouse cloud sample sample-code sap-datasphere

scottpersinger / pgwarehouse
data-warehouse,Easily sync your Postgres database to a Snowflake, ClickHouse, or DuckDB warehouse.
User: scottpersinger
analytics clickhouse data-warehouse postgres postgresql snowflake synchronization warehouse

scratchdata / scratchdata
data-warehouse,Scratch is a swiss army knife for big data.
Organization: scratchdata
Home Page: https://www.scratchdata.com
clickhouse data-warehouse hacktoberfest olap bigquery redshift snowflake duckdb motherduck

sharpdata / sharpetl
data-warehouse,Write ETL using your favorite SQL dialects
Organization: sharpdata
Home Page: https://sharpdata.github.io/SharpETL/
etl etl-framework hive scala spark spark-sql sql datawarehouse data-warehouse bigdata flink flink-sql paimon

tensorbase / tensorbase
data-warehouse,TensorBase is a new big data warehousing with modern efforts.
Organization: tensorbase
Home Page: https://tensorbase.io/
rust bigdata database analytics modern infrastructure data data-infrastructure high-performance engineering rust-lang warehouse data-warehouse

titan-systems / titan
data-warehouse,Titan Core - Snowflake infrastructure-as-code. Provision environments, automate deploys, CI/CD. Manage RBAC, users, roles, and data access. Declarative Python Resource API. Change Management tool for the Snowflake data warehouse.
Organization: titan-systems
data-engineering data-warehouse snowflake data-governance dataops secops compliance-as-code devops rbac

tuva-health / tuva
data-warehouse,Main repo including core data model, data marts, reference data, terminology, and the clinical concept library
Organization: tuva-health
Home Page: https://thetuvaproject.com/
analytics-engineering bigquery data-analytics data-governance data-lineage data-pipelines data-warehouse dbt dbt-packages healthcare

ubisoft / mobydq
data-warehouse,:whale: Tool to automate data quality checks on data pipelines
Organization: ubisoft
Home Page: https://ubisoft.github.io/mobydq/
data-quality data-pipeline data-warehouse big-data data-quality-checks data-quality-monitoring

umer7 / data-warehouse-concepts-design-and-data-integration
data-warehouse, Repo for Data Warehouse Concepts, Design, and Data Integration by University of Colorado System (coursera)(Notes,Assignments, quiz and research papers)
User: umer7
data-integration data-warehouse datawarehouse oracle pentaho

unytics / airbyte_serverless
data-warehouse,Airbyte made simple (no UI, no database, no cluster)
User: unytics
airbyte bigquery data-warehouse elt etl data data-analysis data-engineering pipeline

unytics / bigfunctions
data-warehouse,Supercharge BigQuery with BigFunctions
User: unytics
Home Page: https://unytics.io/bigfunctions/
bigquery data data-analytics data-visualization data-warehouse data-engineering

vmware / versatile-data-kit
data-warehouse,One framework to develop, deploy and operate data workflows with Python and SQL.
Organization: vmware
data-science data-engineering sql trino data-lineage etl elt data-pipelines data-engineer data-warehouse warehouse analytics snowflake dataops data-engineering-pipeline python data pipeline data-structures database

wathon / data_engineering_with_python-track-datacamp
data-warehouse,Data Engineer with Python lecture notes from #datacamp.
User: wathon
data-engineering python datacamp-track shell sql scala aws-boto pyspark spark-sql mongodb