Project Scrapes IMDB Website for collecting data of movie actors. After Scraping we apply Personality Prediction to Prediction the Personality of the actors.
I have build this project using Scrapy, Flask and IBM Watson Personality Insights
NOTE - Make sure you change the api-key and url in personality/get_personality.py
This app is divided into two parts
- scraper folder - where all web scraping is done and data is store in database (SQLite3)
- personality folder - where data is displayed on browser using Flask and Personality Prediction is done using IBM Watson - Personality Insights
You will find database at - scraper/database/
Video in this project will explain how to run the application
pip install -r requirements.txt
cd scraper
scrapy crawl actors
cd personality
python flask_app.py
I recommend you to run this application in virtualenv
Useful Link - https://www.ibm.com/watson/services/personality-insights/
Scraping Link - https://www.imdb.com/list/ls068010962/