scraperr's Introduction

scraperr

Subreddit image scraper made in Python

🏠 Homepage

Pre-requisites

gallery-dl is required to be installed locally and present on the user's system at runtime.

PRAW is also required for this script to run. To install it:

$ pip3 install praw

or alternatively, use pipenv.

Also, inside the praw.ini file you need to modify the access lines (as described here).

You may also add other accounts by keeping the same structure and changing the line in the scraperr.py file that matches the name of the code block (eg. reddit = praw.Reddit("scraperr"))

[scraperr]
; this is your 14 character personal use script
client_id= 
; this is your 27 character secret
client_secret= 
; this is the name you gave your application
user_agent= 
; this is username for the reddit account the app was created with
username=  
; password for the account
password=

Usage

$ python3 scrapper.py -h

usage: scrapper.py [-h] [-l LIMIT] [-p PERIOD] [-d DIRECTORY] subreddit

positional arguments:
  subreddit             The subreddit from which you wish to download the
                        pictures

optional arguments:
  -h, --help            show this help message and exit
  -l LIMIT, --limit LIMIT
                        Limit the number of posts to download (default: 10)
  -p PERIOD, --period PERIOD
                        The period from when to download the pictures
                        (default: day) -- options: day, month, year, all
  -d DIRECTORY, --directory DIRECTORY
                        The directory for the pictures to be downloaded into
                        (default: reddit-wallpapers/)