rachit-mishra Goto Github PK

avazu-ctr-prediction

Click Through Rate Prediction

bigdata_practice

big data using spark and relevant examples

bubble_chart_v4

d3v4 implementation of bubble charts.

capstone

chatgpt-wrapper

API for interacting with ChatGPT using Python and from Shell.

createportfolio

Create Portfolio

data

databricks-certified-data-engineer-professional

The resources of the preparation course for Databricks Data Engineer Professional certification exam

de_01_data_dedup

Data Deduplication and it's need in Data Engineering.

de_01_data_profiling

Data Profiling for better Data Quality tracking, using Spark over Distributed Systems. Aviation data sourced from AirLabs API.

de_02_data_profiling

Data Profiling for better Data Quality tracking, using Spark over Distributed Systems. Aviation data sourced from AirLabs API.

de_03_data_skew_mitigation

To demonstrate and mitigate data skew issues in distributed systems using Apache Spark.

hackerrank

hospitalmedicareanalysis

Analyzing hospital medicare data across states in North Amercia

ipeds_datavisualization

IPEDS data visualization using GGPLOT2/RMD file

iquest

lyricsx

🎶 Lyrics for iTunes, Spotify, Vox and Audirvana Plus.

machinelearningwithtensorflow

models

Models and examples built with TensorFlow

nominatim-docker

100% working container for Nominatim

personal-training

personal training. Referecnes: https://docs.microsoft.com/en-us/azure/cognitive-services/form-recognizer/quickstarts/python-receipts

pyscrub

Built on the powerful PySpark framework and packaged within a Docker environment, PyScrub offers a scalable, flexible, and efficient way to cleanse and profile large datasets. Whether you're dealing with inconsistencies, missing values, or you need to understand your data's structure and quality at a glance, PyScrub is here to help.

spark-stratifier

Stratified Cross Validator for Spark

spotify-playlist-analysis

Analyzing my personal spotify playlists - Exploratory analysis, predictive analysis suggesting likeable/not-so-likeable songs

spotifyreact

A react js based desktop web applicaiton- uses spotify developer api for realtime albums

star-tech-web-dev

An events' website that built for a live client with purpose of attracting local talent in Gandhinagar, India.

tensorflow-movie-recommendations

Using Collaborative Filtering techniques -- Matrix Factorization to build a movie recommender over Tensorflow

travelexpress

Travel Express is a travel base java web application that allows a registered user to book hotels and convenient mode of transportation towards his/her destination. A user can enter any USA county or state the application will display all the hotels with their prices, allows a user to book their choice of hotel, propose a convenient travel mode (flight/train/car) and prepares his/her itenary. Technology and architecture:Uses Java Servlet with oracle 11g and JDBC connectivity. The UI changes after every 30 seconds, uses client-side validation and Jquery. Factory design pattern has been implemented with a 3 layered architecture the UI(handles the user interface), the BO(handles the business rules) and the DAO(handles the database connectivity) to provide a hassle free good customer/user experience. Designed the architecture of database and defined Entity relationship using concepts like ER modelling . The layering and the architecture help in debugging and simulates a real live web travel application.

twitter-etl-using-spark

Extracted and transformed Twitter unstructured data in JSON format into a structured tabular format using Spark Dataframes and stored the data in parquet format in AWS S3 bucket for analyzing with Athena and Tableau in Databricks community edition cluster.

youtube-video-analytics

Analyzing KPIs like sentiment ratio, user engagement, views per category using youtube's official meta data and historical data