willmayger/inovindexer

InovIndexer! Index and Download from a select few urls, known only to a few!

Inov Indexer

Contents

0. Intro.

1. Usage - Starting Fresh (Most Cases).

2. Usage - Starting with JSON File.

3. Usage - Continuing with download.

0. Intro

Indexes links and download links from certain websites and then downloads them. Most of the application uses promises for ease. Please ensure, when writing files, you have a minimum of 10gb available (for the audios)

- Getting started

1. clone this repository & make sure Node.js is installed (LTS) on your machine.
2. run npm install.
3. choose how you want to start the code (three choices below) all located in main.js.
4. you will then be prompted for a url, and then your email and password for that url. (When calling the login class method)

1. Usage - Starting Fresh

When running this for the first time you will want to use this option.

const indexer = new Indexer();

indexer.login()
  .then(() => indexer.startIndex())
  .then(() => indexer.writeJsonObj())
  .then(() => indexer.writeDownloads())
  .catch((err) => {
    console.log(err);
    indexer.end();
  });

2. Usage - Starting with JSON File.

When you have already run the first option once, if you ran it for enough time it would have generated a lessons.json file within the folder lessons/. You can then use this file to save time as this file contains all the indexing information. Just plug this file into the initiation of the class and run the write function.

const fs = require('fs');

const obj = JSON.parse(fs.readFileSync('lessons.json', 'utf8'));
const indexer = new Indexer({ lessons: obj, resume: false });

indexer.login()
  .then(() => indexer.writeDownloads())
  .then(() => indexer.end())
  .catch((err) => {
    console.log(err);
    indexer.end();
  });

3. Usage - Continuing with download.

Almost exactly the same as the previous step (2) however we need to pass in another option which is resume and this needs to be set to true. This will then continue downloading where you left off instead of starting again.

const fs = require('fs');

const obj = JSON.parse(fs.readFileSync('lessons.json', 'utf8'));
const indexer = new Indexer({ lessons: obj, resume: true });

indexer.login()
  .then(() => indexer.writeDownloads())
  .then(() => indexer.end())
  .catch((err) => {
    console.log(err);
    indexer.end();
  });