linuxwhatelse/pyloader

A simple, easy to use, multithreaded downloader with queuing.

pyloader - A simple python downloader

pyloader is a simple, easy to use, multi-threaded downloader with queuing support.

It is NOT a command-line utility but instead something you can (if you want) implement
in one (or more, I don't care :)) of your applications.

I wrote project-specific downloader a few times now and finally decided to create a proper module for it as
I couldn't find an existing one (Haven't spent that much time searching though).

ToDo

Things to implement:

• More unittests
• Pause/Resume downloads

Requirements

What you need:

• Python 2.7 / Python 3.4 and up
• The great python requests module

Installation

From pypi (recommanded)

pip install lwe-pyloader

From source

git clone https://github.com/linuxwhatelse/pyloader
cd pyloader
python setup.py install

Usage

The source has been commented quite well so at any point you might just:

import pyloader
help(pyloader)

To get you started though, check the included examples.
Happy coding! :)

pyloader's Issues

Download slows down after the first item of the queue is finished

It's all in the title, the first item in the queue downloads fast (normal speed). After the first one is finished, the succeeding items downloads slowly. The max_concurrent property is set to 1, the download is super slow if there are two or more concurrent downloads.