izhangit/integrated-data-modelling

Explore fundamental data modeling concepts with practical examples. Create effective data models for various scenarios and learn data optimization techniques.

Integrated-Data-Modelling

Overview

Leveraged Python and PostgreSQL to Perform data modeling, including schema design and SQL analysis. Focused on data warehouse fundamentals, transforming a 3rd Normal Form(3NF) schema into an efficient star schema. Optimized SQL queries through joins and other techniques to enhance performance.

Data Modeling Technique

Technologies Used

• Python
• PostgreSQL
• Jupyter Notebook
• Visual Studio (VS-Code)
• Draw.io

Database Creation

The database was created using PostgreSQL, with scripts available for setup.

Data Warehousing

Implemented data warehousing fundamentals for efficient data storage and retrieval.

Schema Design

Designed and transformed the Schema to transition from 3NF to a Star Schema, enhancing data analysis capabilities.

3NF

⬇

Star Schema

SQL Analysis

Conducted comprehensive SQL analysis to extract valuable insights from the data.

Optimization Techniques

Applied optimization techniques, including table joins and query optimization, to improve SQL performance.

Conclusion

The Project Successfully achieved optimized data modeling, efficient schema design, and improved SQL performance, facilitating enhanced data analysis and decision-making.