Giter Site home page Giter Site logo

videoscrapper's Introduction

videoScrapper

VideoScrapper is a simple application to scrap and download series eposiodes from specific web pages. To be used it's necessary to modify the app.yaml configuration file where you need to specify the nexts fields:

How to use:

app.yaml

The app.yaml configuration file is composed by the next fields

  • OutputPath: This is the path where episodes will be stored when the are downloaded. (only use this field if application is running outside docker).

  • SerieConfigurations: This field specify the list of series you want to track and download. it`s composed by:

    • SerieLink: the root link to scrap the tv serie.
    • SerieName: the name you want to use to store the episodes.
    • Provider: the provider related to the SerieLink, right now only animeshowtv is allowed.

See the app.yaml.example

Running with docker

  • Create a new folder to store the application data (application_home)
  • Add an app.yaml in the application_home and set the SerieConfigurations.
  • Create a new folder for the application output (output_path).
  • Edit the docker.env file setting the previously created folders as DOCKER_OUTPUT_PATH and DOCKER_APPLICATION_HOME
  • execute the next command: make runDocker

command to compile for arm

env GOOS=linux GOARCH=arm GOARM=5 go build

What can we do next:

The main goal of this project is to be able to download videos from different sources. So far animeshowtv and cuevana are the only available providers. But it is possible to add new providers by simply implementing the GeneralDownloadService interface , and registering them in the initializeDownloadServices function.

videoscrapper's People

Contributors

rvillablanca avatar aeperez24 avatar

Stargazers

 avatar

Watchers

James Cloos avatar  avatar

Forkers

rvillablanca

videoscrapper's Issues

Tests are broken

panic: runtime error: invalid memory address or nil pointer dereference [recovered]
        panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0x4851d4]

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.