Ability to Disable Downloading Images Older Than Last Rip

[ripmeapp]

Ability to Disable Downloading Images Older Than Last Rip

[rautamiekka]

Unless someone has a better idea, that'd mandate using a file containing the links to the previously downloaded files. For example: https://github.com/rg3/youtube-dl/ can use a file which lists the vid IDs of already fetched vids -after- you DL, which is way easier to implement and use compared to a general pic ripper.

The JSON format I can imagine right now that'll enable matching multiple items from a single address:

{
    "ORIGINAL LINK SUCH AS FOLDER OR ALBUM": {
        "ITEM IN FOLDER OR ALBUM": [
            "DOWNLOAD LINK USED",
            ...
        ], ...
    }, ...
}

For example:

{
    "http://rautamiekka.deviantart.com/gallery/?catpath=/": {
        "http://rautamiekka.deviantart.com/art/Princess-Luna-BIG-COLLAB-colored-0-672156533": [
            "http://img09.deviantart.net/ed89/i/2016/335/4/2/_sleeping_on_the_job___finnish_by_rautamiekka-daq4v9l.png"
        ]
    }, ...
}

That allows for very fine (by folder/album address, item address in the folder/album, the DL link used, the filename used) matching of already-downloaded content, assuming the same format works for everything.

Otherwise we'll need ripper-specific formats built into the specific ripper and an unified API to use the format.

Having this addition to the app would drastically reduce download times.

[cyian-1756]

This was added, to use it click the "Remember URL history" button in the config menu

[rautamiekka]

^ Re-download times, mind you.

[Davrial]

^ *Re-RIP times, mind you. It would be explicitly preventing re-downloads.

Also as for your overspecialization of folder/file details, it wouldnt need to be nearly that complicated. You would just have the ripper document the last time it ran a rip and then have that compare to the metadata on a site which shows its age/timestamp. It would be extra easy with sites like Tumblr where all images are stored with a string name, because then the ripper could just be told to only rip images with a newer string than the most recent image currently saved/ripped for each specific url/folder.

[metaprime]

@rautamiekka That's exactly the solution I imagined. This request has been opened and discussed multiple times in the past, and at least one of those issues is open (probably aggregating links to the duplicates as well).

I support this enhancement as well. I opened an issue for deduplication a week or two ago, but it got closed since "ripme doesn't have deduplication by design".

[metaprime]

@ANonCoder123 This is a distinct issue from deduplication. This is an issue of not downloading URLs already downloaded. It mostly would solve the problem of deduplication (except for duplicates downloaded from different URLs)