itpain/reddit-image-scraper-1

Scanning imgur for submissions of reddit users

Reddit-Image-Scraper

Purpose

This python script enables you to pick a reddit user and automatically download all pictures he / she posted in Imgur links. The number of posts which are scanned can be specified by a number.

Setup

Python

Python 2 or Python 3 must be installed on your computer.

Dependencies

To use this script, you will need the libraries praw and BeautifulSoup. They can be installed by the pip command through your command line as follows:

$ pip install -r requirements.txt

After that, you're good to go!

Installation

To install simply clone the github repo and run setup.py

# Clone the Repo
$ git clone https://github.com/Rookev/Reddit-Image-Scraper.git

# Install
$ python setup.py install

Usage

After installing the package, the console script reddit_scraper can now be used.

Example

Choose a reddit user and download each of his or her Imgur submissions to your local hard drive

$ reddit_scraper User123 5

This command scrapes the last 5 posts of /u/User123, detects his Imgur submissions and downloads it to your desktop in a newly created folder called /User123/

Documentation

Documentation available at readthedocs

Contributions

A more pythonized programming style and documentation with Sphinx was contributed by Sang Han

Personal annotation

With this script I wanted to try out some techniques and skills, so it also had some personal goals:

• Python (development & publishing / installing)
• Web scraping
• Using the social aspect of GitHub (pull requests, merging)