iceflowre / unidown Goto Github PK

View Code? Open in Web Editor NEW

0.0 0.0 2.0 2.28 MB

Universal Downloader - update, manage, download.

License: GNU General Public License v3.0

Python 100.00%

downloader python

unidown's Issues

Add code coverage

Setup.py

Proxy/SOCKS5 support

Option to download the first topic post

First topic contains mostly some informations about which is nice to have if possible.

Test manager

Version tag in update.data

Add an version tag in update.data

Get rid of tqdm_option

https://github.com/IceflowRE/Universal-Downloader/blob/master/unidown/tools/tqdm_option.py

Module names should be lowercase

Use explicit dependency versions

Use .format for strings if it is usefull

Add custom file checking

Need custom checking if a good file is downloaded.
Or add after and before methodes?

with filename.open(mode='r', encoding="utf-8") as reader:
  check = reader.readline(14)
    if check == "<!DOCTYPE html":  # if only the html file "Invalid Attachment specified." was downloaded
      download_failed_list.append(at_id)
    else:
      download_succeed_list.append(at_id)

Add documentation

Use modified time from header instead of downloading the whole html

Add 3rd party tool credits

Test cases

Nosetest would be the best.

Own logfile for every plugin

Main log file
Module log files
Link in main log file to the module log file

Threads does not seemed to be downloaded

Add a gui

Put updated download_data in plugin too

Ref: #43

Reoganize to a general downloader

Use argparse to allow commandline arguments

Rename to universal-downloader (unidown)

Delay between the requests

Fix updater to be ready with a new release

Use PyPi as source for update mentioning

Use PyPi as new version source
Push new version to release branch in parallel
Remove release branch 4 weeks after

Add landscape.io badge again

When this is fixed: landscapeio/landscape-issues#290

Restarting of downloads

If the downloader crashes or connection lost, etc. There should be the possibility to restart.

Stop program when no internet connection is available

Review thread parser

Add GitCop

https://gitcop.com

Exceptions

Write own exceptions
Catch module exceptions
Log them

Add test for all raising exceptions of plugin package

Compile python scripts as native applications

If possible.

Use pathlib module instead of os for check existing

Simplify version checking

It can be simplified by simply checking two strings, no splitting needed.

Use utf8 for update.data instead of latin

This needs to update older update.data which uses latin.

In Progress

Travis support

Code climate support

ebooks not found list

eBook not found list will be generated from found threads and not from really downloaded thread files.
A check if all threads are downloaded can be serialized too.

Define types for argpares arguments

Add unidown to PyPi

Add upload script to travis
Provide a long description for PyPi (use Readme)

Put update_time and downloaded_data inside the plugin?

Pro:

everything is at the same place
both are needed againg when, writing the savestate or checking the download

Con:

savestate and last update time are just generated once
needs an extra layer, to save them inside the plugin, because custom plugins shouldnt do this themself

Test

Command line window should stay open after finishing

Passable arguments to a plugin

Enable pylint testing as soon it support Python 3.6

Use setup.py as installation

Subject

Use setup.py as installation for the downloader.

Reason

Simplify execution.

Https support

Since mobileread uses https, the request should use https too.

Code Climate - pycodestyle and other checks

Since code climate is a little bit outdated, an own methode for checking this (pep8, duplicates, etc.) can be implemented. At least if Code Climate do not update as soon as possible.

iceflowre / unidown Goto Github PK

unidown's People

Contributors

Watchers

Forkers

unidown's Issues

Subject

Reason

Recommend Projects

Recommend Topics

Recommend Org