sharad1126/webscrapper

web scrapping with selenium using chrome driver

WebScrapper

Crawling webpages with selenium using Chrome driver/Firefox headless

If this helped you, consider

Installation

Assuming that you have Selenium, Chrome driver and Firefox headless installed:

git clone https://github.com/sharad1126/WebScrapper
cd WebScrapper
pip install -r requirements.txt

Usage

python final_crawl_selenium.py
#and then wait for 30-35 seconds. In the meantime, driver will also open chrome browser to run the webpage.

python webpage_screenshot.py
#Will save the screenshot at a specified place as per the code

Results

Screenshot

Author

Sharad Agarwal [email protected]