avarvind/youtubedataharvestingandwarehousing

Collecting YouTube data using google API and storing the data in MongoDB(NoSQL) and Migrating the stored data from MongoDB into SQL and creating a user friendly Streamlit web app for the visualization and to get a better understanding of the YouTube channels and video details. All with the help of Python and Python libraries.

Youtube_DataHarvesting_And_Warehousing

#Introduction

Collecting YouTube data using google API and storing the data in MongoDB(NoSQL) and Migrating the stored data from MongoDB into SQL and creating a user friendly Streamlit web app for the visualization and to get a better understanding of the YouTube channels and video details. All with the help of Python and Python libraries.

Skills takeaway

• Python scripting
• Data Collection
• API integration
• Streamlit
• Data Management using MongoDB and SQL

Libraries/Packages used

from googleapiclient.discovery import build  # for youtube api
import pymongo  # for mongoDB
import psycopg2  # for postgresSQL
import pandas as pd  # for DataFrame
import streamlit as st  # for web app

Technology Stack Used

1. Python 3.11
2. PostgreSQL
3. MongoDB
4. Google Client Library
5. Streamlit
6. IDE (VS Code)

Contact

• Email:[email protected]
• Linkedin:https://www.linkedin.com/in/arvind-venkateshwaran-97973423a/