gnd/archive_downloader

A node.js book downloader from Archive.org

Archive_downloader

A node.js book downloader from Archive.org

Install

For downloading borrowed books from Archive.org you will first need:

apt-get install npm
npm install sleep
npm install request

To convert and OCR the downloaded images into a pdf with make_pdf.sh you will also need:

apt-get install imagemagick tesseract-ocr poppler-tools

Downloading a book:

0. Install EditThisCookie for Chrome, or use something else for cookie extraction
1. Login to archive.org
2. Borrow a book
3. Copy your cookies:

• In EditThisCookie options, first set the preferred export format to 'Semicolon separated name=value pairs'
• Click export and paste just the cookies (without comments) into the cookies = ''; in the node_dl.js
• If you are using another way to retrieve your cookies, just put your cookies into the cookies variable in node_dl.js
• Set other variables like ua (user-agent), pages (how many pages the book has), local_name (where to download and how to name the files)

4. You might want to create a directory for the files, eg. books/my_book. In that case the local_name should be books/my_book/book_name
5. Run node node_dl.js

Converting downloaded files into searchable OCR'ed pdf:

0. Run make_pdf.sh books/my_book output_name
1. This will convert all jp2 files in the folder books/my_book into jpg's, OCR those jpg files and output into separate pdfs and finally join all pdfs into output_name.pdf

archive_downloader's Issues

undefined cookie

Empty .jp2 files

Hello, guys!
Does it still work?
Because I get empty .jp2 files and all of them are the same - 49 bytes of nothing...

Maybe I did something wrong?

improvements to be worked in

> > --> nie poppler-tools, ale poppler-utils
> > 
> > okrem tych par veci som musel rucne doinstalovat:  
> >> npm install sleep
> > inak mi to hadzalo:
> > internal/modules/cjs/loader.js:638
> >     throw err;
> > Error: Cannot find module 'sleep'
> > 
> > a aj toto: 
> >> npm install --save readline-sync
> > inak hadzalo:
> > internal/modules/cjs/loader.js:638
> >     throw err;
> >     ^
> > Error: Cannot find module 'readline-sync'
> > 
> > v readme.md sa pise ze cookie sa pejstuje do node_dl.js, subor sa ale vola archive_dl.js (mozno si ho medzicasom premenoval na tento)
> > 
> > trochu kriticka chyba je ze "cookies" v config.json je mylne ako "cookie"
> > 
> > do config.json treba vlozit aj url_stub, ten v readme.md neni spomenuty, i ked v archive_dl.js v poznamkach je..
> > 
> > no a v archive_dl.js som musel zmenit
> > /* for (var i = 1; i < config.pages + 1; i++) {*/
> > na:
> >   for (var i = 1; i <= config.pages; i++) {
> > inak mi tu premennu z nejakeho dovodu ignoroval a siel bez ohladu na nu do 50
> > 
> > v make_pdf.sh mi OCRko neslo bez toho aby som zmenil:
> > #        tesseract $BOOK/$img -l eng $BOOK/$imgname pdf
> >         tesseract $BOOK/$img $BOOK/$imgname -l eng --dpi 150 pdf```

broken

downloader says Image downloaded but all downloaded files are

Error serving request:
  Image error: not found

maybe the query params are missing after the image file names

this works: https://github.com/MiniGlome/Archive.org-Downloader
set email, password, url ... and get the pdf. simple!

.

Image quality?

Hi,is the image quality using your downloader, better if I borrow normally (eg download the book via ACSM)?