abdansb/nocopyzone

Web Scraping with Selenium and Regular Expression

Untraceable? Think Again: Deciphered by Machine Learning

This Python script is designed for web scraping using Selenium and RegEx. It extracts URLs from a given website up to three levels deep or more.

Installation

Use the following commands to install the necessary Python packages:

pip install requests bs4
pip install selenium
pip install ipython-autotime
apt-get update
apt install chromium-chromedriver

Note: Run the installation commands in a Jupyter Notebook cell or in your terminal.

Usage The script utilizes Selenium with a headless Chrome browser to navigate through web pages. It extracts URLs from different HTML tags with specified attribute prefixes.