ayush-sharma410/realtime_webscraping

Medicine Data Web Scraping

Welcome to the repository for the Medicine Data Web Scraping project. This project involves scraping data for different medicines from Tata 1mg and PharmEasy using Selenium and Puppeteer. The scraped data can be used for various purposes such as analysis, research, or building applications related to healthcare.

Table of Contents

• Introduction
• Installation
  • Selenium
  • Puppeteer
• Usage
• Contributing
• License

Introduction

The Medicine Data Web Scraping project aims to gather data on various medicines from popular online pharmacies such as Tata 1mg and PharmEasy. By utilizing web scraping techniques with Selenium and Puppeteer, you can retrieve information such as medicine names, prices, descriptions, and availability.

Installation

Before getting started with web scraping, you need to install the necessary dependencies for each method. Follow the installation steps below for both Selenium and Puppeteer.

Selenium

To install and set up Selenium for web scraping, follow these steps:

1. Ensure that you have Python installed on your system.

2. Install Selenium using pip:

3. Download the appropriate web driver for your browser:

• Chrome: ChromeDriver
• Firefox: GeckoDriver

4. Add the web driver executable to your system's PATH.

Puppeteer

To install and set up Puppeteer for web scraping, follow these steps:

1. Ensure that you have Node.js installed on your system.

2. Initialize a new Node.js project (if not already initialized):

3. Install Puppeteer as a dependency:

Usage

To use the web scraping methods with Selenium and Puppeteer, follow these steps:

1. Clone the repository:

   git clone https://github.com/Ayush-Sharma410/RealTimeWebScrape.git
   

2. Navigate to the project directory:

 cd RealTimeWebScrape

3. Choose either the Selenium or Puppeteer directory, depending on the method you want to use.

4. Customize the web scraping scripts according to your requirements.

5. Run the respective script using the following command:

- For Selenium:
```bash
pip install selenium


- For Puppeteer:

```bash
npm install puppeteer


6. The script will initiate the web scraping process, and the scraped data will be saved or displayed as per the script implementation



Using Beautiful Soup : https://github.com/Ayush-Sharma410/Medlr