Karthik's Projects
This course built upon the knowledge of Apache Spark, Structured Streaming, and Delta Lake to unlock the full potential of the data lakehouse by utilizing the suite of tools provided by Databricks. This course places a heavy emphasis on designs favoring incremental data processing, enabling systems optimized to continuously ingest and analyze...
In the fast-changing world of online shopping, our data whiz, Alex, embarked on an exciting journey. With Python and SQL as trusted companions, he explored a vast e-commerce dataset in three key phases mentioned in the project. We shall perform the role of Alex.
Clustering the regions based on the similar criminal activities in the neighborhoods of Toronto.
This course provides a comprehensive introduction to Databricks SQL. Learnt about ingesting data, writing queries, producing visualizations and dashboards, and how to connect Databricks SQL to additional tools by using Partner Connect.
Explore how to leverage the Databricks Lakehouse Platform to productionalize ETL pipelines. Use Delta Live Tables with Spark SQL and PySpark to define and schedule pipelines that incrementally process new data from a variety of data sources into the Lakehouse, orchestrate tasks with Databricks Workflows, and promote code with Databricks Repos.
Consider the following hypothetical scenario : Resto-grand a successful multi-chained restaurant company has its brands around Europe, India, California. They wanted to start their restaurants in New York state and required some suggestions on where to open them. The aim of the project is to find suitable locations for the restaurants in NY state.
Create a convolution neural network with a maximum of 100k parameters for identifying various fashion images.
As a Marketing Data Analyst the task is to convert the survey results of CodeX, a beverage company into meaningful insights which can help the team to take data driven business decisions.
Implementation of basic ML algorithms from scratch in python...
The main objective of this project is to implement a general machine learning work flow using python scripts.
For Databricks Data Engineering
The goal of the project is to identify the most impactful flight routes during the pandemic to suggest aviation authorities to minimize the flights in such a way as to control the spread of Covid-19 yet keep making sufficient profit.
Sentiment Analysis on low-resource African Languages.
Practice SQL, python using the text book SQL for data analytics. There are several excercises, activities along the chapters of the textbook.
for demo purposes and practice
Develop a predictive model that accurately forecasts student grades based on various relevant features, ultimately assisting educators and institutions in identifying at-risk students and providing tailored support.
The "Healthcare Appointments Analytics" project is a comprehensive data analysis initiative that delves into the intricacies of medical appointments and explores factors influencing patient attendance and no-show rates. By leveraging advanced analytical techniques, the project aims to uncover valuable insights.
To discover the hidden data insights so as to make better decisions for improving the sales and reduce the time spent on gathering the data for summaries. Designed a tableau dashboard to track the year on year KPI.
Information about potable water usage in the past and the future is crucial for water providers to plan and manage water resources and infrastructure and even shape the usage patterns of customers. Modeling factors affecting water usage is as essential as water usage predictions.
This project aims at cleaning the dataset, analyzing the given dataset and mine informational insights using Python and MySQL on the fatalities that occurred at work places.