ckellydesign/pyconke-webscraping

This is the demo project for the talk on Web Scraping using Python for PyCon KE '17.

Web Scraping with Python by Robley Gori for PyCONKE 17

This is the demo project for the talk on Web Scraping using Python for PyCon KE held at USIU.

The presentation slides are here

Getting Started

These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.

Prerequisites

The requirements are in the requirements.txt file

Installing

Clone the repository and install the requirements in a virtual environment

cd PyCONKE-WebScraping

virtualenv --python=python2 pycondemo

. /pycondemo/bin/activate

pip install -r requirements.txt

Running

Run the sample scrapper with the following command

python demo.py

Scraping Resources

• Requests - Requests is the only Non-GMO HTTP library for Python, safe for human consumption.
• Beautiful Soup 4 - Beautiful Soup is a Python library designed for quick turnaround projects like screen-scraping.
• Scrapy - An open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.

Authors

• Robley Gori - Initial work

See also the list of contributors who participated in this project.

License

This project is licensed under the MIT License - see the LICENSE.md file for details