tomholford/media-downloader

CLI tool written in Deno to scrape URLs and download linked media files

media-downloader

A basic media downloading tool written in Typescript for Deno. Pass in a URL, select which filetypes you're interested in, and it will scrape the HTML and download all the linked files that match the filter.

Prerequisites

• Deno 1.27.0+

Usage

• -u - (required) the URL to scrape for media links
• -p - (optional) the output path for writing files; defaults to ./output/
• -t - (optional) the filetype(s) to download; defaults to several common image formats
• -R - (optional) after finishing downloading, scan the output directory and remove duplicates

Example

deno run --allow-net --allow-write --allow-read --unstable media_downloader.ts -t jpg -t png -u https://dribbble.com/shots

Install

1. Clone this repo
2. Run this command

deno install --allow-net --allow-write --allow-read --unstable --name media-downloader main.ts

1. Then, use it like so:

media-downloader -u https://example.com

macOS

You will also need to add the deno executables path to your bash_profile:

export PATH="/Users/[your username]/.deno/bin:$PATH"

Supported Sites

This tool has been confirmed to work with imageboards [e.g., 4chan) and thisvid. Feel free to open a PR to contribute more sites to this list.

Roadmap

• Support <img> tags
• Multiple parallel requests
• progress bar
• CI
• release binaries
• tests