Giter Site home page Giter Site logo

auto-dl's Introduction

auto-dl

Automated downloader for tv-shows using youtube-dl. See here for supported sites.

How it works:

  1. Scrape websites and insert episodes in a DB
  2. Matches episodes with subscribed tv-shows
  3. Download episodes and turn on VPN to bypass geoblocking

Requirements:

  • Python 3
  • Requests
  • Beautifulsoup 4
  • PluginBase

Installation:

  1. Clone repository: git clone https://github.com/derEisele/auto-dl.git
  2. Enter directory: cd auto-dl
  3. First run: python3 autodl.py -noscrape -nodl
  4. Edit config: nano conig.ini
  5. Add shows with language: python3 autodl.py -noscrape -nodl -add "Doctor Who" en
  6. Run script: python3 autodl.py

Usage:

Cli Arguments:

  • -nodl: Disables download
  • -noscrape: Disables scrapping
  • -add "<Show>" <language code>: Subscribes show, see above for example.

Configure scrapers:

  • Edit config.ini
  • True = Enabled, else Disabled

Configure directories:

  • Edit config.ini

Recommendations:

Create bash script:

Example:

#!/bin/bash
cd /path/to/auto-dl
python3 autodl.py

Use VPN:

Windscribe offers sometimes 50GB/month for free. If your using windscribe and this script on a server:

Turn off firewall windscribe firewall off to keep ssh available

Use Cron:

crontab -e

Example:

# m h  dom mon dow   command
30 2   *   *   *     /path/to/script.sh

Run in lxc:

lxc is a container system for Linux. In contrast to a Virtual Machine it runs directly on the hardware to preserve performance. So you can limit VPN to this script to insure network connectivity of your computer.

Use a server:

I highly recommend this script to be run on a server since scraping and downloading can take a long time (~20 min/Video @ 25MBit/s). Even a 35$ Raspberry Pi performs well and you can use it in audition as a NAS.

Contribute:

First I want to say thank you for considering contribiuting to this project.

TODO

Take a look at the todo branch if you want to complete the work of others. Feel free to start a pull request to this branch if you are stuck half way through a problem.

Writing a scraper

  • Use other scrapers as an example
  • Please add only full episodes to DB
  • Remove any extra text from show name
  • Make sure, that youtube-dl is able to download videos from this site
  • Note naming scheme for scrapers: <country>_<example>_<com>.py
  • Use a scraper template if you create a scraper for similar sites.
  • Avoid additional requirements

auto-dl's People

Contributors

dereisele avatar

Stargazers

DanozWorld avatar  avatar Teddy Katayama avatar Tyler Forest-Hauser avatar  avatar

Watchers

 avatar  avatar

auto-dl's Issues

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.