m4heshd / offlinebay Goto Github PK

View Code? Open in Web Editor NEW

118.0 15.0 23.0 957 KB

Official repository of the project OfflineBay

License: MIT License

HTML 16.39% CSS 15.35% JavaScript 68.26%

offlinebay torrent-search torrents electron nodejs javascript

offlinebay's Introduction

OfflineBay by m4heshd

Stable version: 2.0.0

OfflineBay is a free and open-source tool created to hold and parse copies of torrent archive dumps. So it allows you to search and download torrents offline. OfflineBay can parse CSV files with many torrenting related added features. The parsing is programmed to match the structure of dump files created by The Pirate Bay. But any group or organization can follow that same structure to create dump files to be used with OfflineBay.

PLEASE FOLLOW THIS VIDEO TUTORIAL BEFORE YOU START USING OFFLINEBAY

DISCLAIMER:

OfflineBay is Free and Open-source software licensed under MIT License. This software is created to parse CSV dump files created by a third party and any of the data other than this software is not provided by m4heshd. Use the data at your own risk. m4heshd will not be responsible for any of the data acquired using dump files. It is strongly advised not to use OfflineBay for any copyright infringing activities. OfflineBay will not hide or protect you from authorities if you engage in such activities.

Downloads

OfflineBay is distributed as a portable application in favor of the majority. Download the corresponding package and extract the ZIP file. All of the packages should have an executable (double-clickable) along with some other files. File named OfflineBay.exe or OfflineBay.app or OfflineBay would be the executable file.

NOTE: Linux users may need to declare the file as an executable before running - chmod +x OfflineBay

Why downloads are larger than the previous version?
Well, OfflineBay 2 is created using Electron and NodeJS. So the disk footprint could be a little concerning. There is no way around this issue. This is one small compromise for a lot of improvements.

All releases (with source)
Windows (x86 & x64) - Download
MacOS - Download
Linux (x64) - Download
Linux (x86) - Download

WARNING: Since OfflineBay is now open-source you could stumble upon some modified versions of OfflineBay. If you get infected with malware by going off the proper channels, i won't take any blame for them.

If you're looking for the older version of OfflineBay, Downloads are available here.

How to remove OfflineBay?
I personally believe that none of the applications should leave any residue in the removal process. Unlike other portable apps OfflineBay will not leave anything behind once you hit delete on the application folder. It's valid for all platforms. Everything will be removed including Dump files, configurations and error logs.

Build OfflineBay yourself

You will need NodeJS and NPM (Usually packed with NodeJS) installed on your computer to build OfflineBay yourself.

NOTE: When creating OfflineBay i almost managed to completely avoid native modules. But there's a single module named bufferutil that's required by another module. You may run into a few errors when building if you don't have platform build tools for node-gyp. You can simply ignore those errors since the module is an optional dependency. Also since OfflineBay practically has no native dependencies, it's possible to cross-build without any complications. But i cannot guarantee on the outcome.

Clone this repository, cd to that directory and run npm run clean before everything. Then run any of the following commands to build OfflineBay.

Windows (x86 & x64) - npm run dist-win
MacOS - npm run dist-mac
Linux (x64) - npm run dist-linux-64
Linux (x86) - npm run dist-linux-32

Support OfflineBay project

Involvement as a contributor by adding a few lines of code, fixing a bug, respond to issues, testing etc.. would be one of the most helpful methods you could support the project. If you're not a programmer but a creative person, you could definitely get involved in the GUI part of OfflineBay. Follow this link to learn about theming for OfflineBay. If you have some spare coins laying around, you could throw some this way to buy me a coffee..

BTC: 1KpjcftYs8CnG7jVgmzSoKAVT7QGqisYBC
ETH: 0x1EE4130876B4f0aD2303a98787fd3746DD0C84F4
BCH: 1LsY4Ppvrfx21pzs7YaAC3ciLbdwUYj92q

Or you can buy me a "ko-fi" by clicking this button

Got an Issue?

Follow this link to submit your issues. Remember to be descriptive when submitting issues. Also remember that issues area is not meant to ask for help. If you need help or you have any other questions regarding OfflineBay you can simply fire up a conversation on the Suprbay thread.

Known issues

Linux:

Splash window may have a white background instead of transparency [unfixable/SW-HW dependent]
DHT scraping may not work sometimes [unable to trace the issue]

Themes you say?

You can create themes for OfflineBay just using CSS. This repository is dedicated to OfflineBay themes. Visit there to learn more about creating themes.

If you're a regular user, you can also follow the same repository to download themes.

Changelog

Complete Changelog is available here.

License

OfflineBay is licensed under MIT License. So you are allowed to use freely and modify the application. I will not be responsible for any outcome. Proceed with any action at your own risk.

offlinebay's People

Contributors

Stargazers

Watchers

offlinebay's Issues

Where to find a working dump file

Hey all,

just a short question. Where can I find a working dump file?

I tried my best but I can't find one.

Best Regards

How to convert HashCode to MagnetLink? Thanks

Can't build on Raspberry Pi 3

Can't build the repo on raspberry pi:

pi@raspberrypi:~/offlinebay $ npm run dist-linux-32

[email protected] dist-linux-32 /home/pi/offlinebay
electron-packager . OfflineBay --overwrite --platform=linux --arch=ia32 --icon=app/img/icon.png --prune=true --out=dist --app-copyright="Copyright (C) 2018 TechTac"

sh: 1: electron-packager: not found

npm ERR! [email protected] dist-linux-32: electron-packager . OfflineBay --overwrite --platform=linux --arch=ia32 --icon=app/img/icon.png --prune=true --out=dist --app-copyright="Copyright (C) 2018 TechTac"
npm ERR! Exit status 127
npm ERR!
npm ERR! Failed at the [email protected] dist-linux-32 script.
npm ERR! This is most likely a problem with the offlinebay package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR! electron-packager . OfflineBay --overwrite --platform=linux --arch=ia32 --icon=app/img/icon.png --prune=true --out=dist --app-copyright="Copyright (C) 2018 TechTac"
npm ERR! You can get their info via:
npm ERR! npm owner ls offlinebay
npm ERR! There is likely additional logging output above.
npm ERR! System Linux 4.9.35-v7+
npm ERR! command "/usr/bin/nodejs" "/usr/bin/npm" "run" "dist-linux-32"
npm ERR! cwd /home/pi/offlinebay
npm ERR! node -v v0.10.29
npm ERR! npm -v 1.4.21
npm ERR! code ELIFECYCLE
npm WARN This failure might be due to the use of legacy binary "node"
npm WARN For further explanations, please read
/usr/share/doc/nodejs/README.Debian

npm ERR!
npm ERR! Additional logging details can be found in:
npm ERR! /home/pi/offlinebay/npm-debug.log
npm ERR! not ok code 0

Can't Remove offline bay

Hello.
I've just installed offlinebay but I decided to remove it. So when I was going to do it, I click on remove the files but I can't do it, it says that the file is open so I can't remove it, but I don't have it open.
How can I fix it?

No search results older than Aug 2017

When doing a search for anything (I've tried TV shows (NCIS New Orleans), Software (Ubuntu), Movies (Labyrinth) - random things I could come up with that would have old results) - nothing prior to mid- to late Aug 2017 shows up.

ex.) For the Ubuntu search, the OB returns 17 results - the oldest being "Beginning Ubuntu for Windows and Mac Users Start your journey in" Posted on Aug 27, 2017.

When I open the raw dump file in notepad ++ and search for Ubuntu, there are 248 hits for Ubuntu, the next newest is posted August 1, 2017.

Was this a conscious decision to limit the search results, a mis-configuration on my part, or a bug?

Win10 Home x64. OB v2.0.0
I can also test in Ubuntu when I find some time to see if the behavior is the same.

mac os x issue, any fixes

OfflineBay not opening.

On download, I extracted from the .zip file (I'm on windows) and upon opening it I double-clicked the .exe file which prompted with a "Run or Cancel" screen and I clicked run, nothing happened, so I opened with Admin privileges, and still nothing.

Creating own dump files

Hi!

I just wanted to ask, that if i have my own .torrent database, how can i export it to a csv used in pbay dump files? I cannot find nowhere a software does that OR how can i make a dump file readable by this program? It can read the format i see, but i cannot generate from my torrents, i think its a separate program or script. And i mean by the B64 based hash info, the rest; i could solve it... name, size ect... but this B64 decoded column is a binary or something like that if i saw it good... not the usual hash...

Yes i want to use my own dump file with torrents and custom trackers.

Doesn't run when placed in program files x86 directory (Windows 10)

I downloaded the windows version of this, extracted it into my program files x86 folder then ran it. It appears to start, and I can see it in my Task manager but it hasn't done anything asides from this.

I saw in a post afew months ago another user had a similar problem (http://www.horizonhealthinc.com/Thread-Release-OfflineBay-v2-Open-source-and-No-more-Java-dependency?page=2)

Windows 10 Pro
Version 10.0.17134 Build 17134

I just copied the folder into a different directory, under c drive and ran it from there. It's maybe a windows access rights issue. I don't think you need to fix this, but perhaps just mention it in the installation hints.

offlinebay 2.0 error message

Hi, when trying to open offlinebay.exe, it gives an error message (see attached screenshot).

Do you know how to fix that? Are there any detailed step by step installation instructions available for offlinebay, including any installation instructions for java and nodejs if required? Is there anyway you can please get rid of java and nodejs from the next offlinebay version? Thanks.

offlinebay 2.0
windows 10 64 bit
java 8 update 221
java 8 update 221 64 bit

Smart Search doesn't work in OSX 10.3.4

If i enable smart search the application gets stuck on searching. Enabling instant search with smart search doesn't help. I have to uncheck smart search for searching to work.

Debian Buster VM with Virtio QXL won't show the content of the main window

To resolve this I added the --disable-gpu option ie a GNOME .desktop file would look like this:

[Desktop Entry]
Name=OfflineBay
Comment=OfflineBay V2.0.0
GenericName=Search Engine
X-GNOME-FullName=OfflineBay
Exec=/opt/OfflineBay/OfflineBay --disable-gpu
Terminal=false
Type=Application
Icon=/opt/OfflineBay/resources/app/app/img/icon.png
Categories=Network;

or just run from cli:
/opt/OfflineBay/OfflineBay --disable-gpu

Sort by seedcount

It would be nice to sort by seedcount desc.

I'm trying to understand the csv DB and how to maybe read or write it in another software.

The file has this:

#ADDED;HASH(B64);NAME;SIZE(BYTES)
2018-Jan-31 21:01:58;rlrRc5m5ZYEb0WupkEuThZVEUHM=;"Windows 10 Version 1709 x64 (Updated Dec 2017)";10388732142

But the info hash is: DB76A14AF3267009785F93454E84C3883A3BD21B
So how technically I get from the rlrRc5m5ZYEb0WupkEuThZVEUHM= back to the info hash?
I have seen the JS at somewhere but something is missing for me to understand it.

a dump file update enhancement suggestion

Unfortunately, I cannot access thepiratebay.org directly - I have to use either a VPN addon in my Firefox web browser, which fails to download the dump file after several megabytes, or a DNS server, and even then thepiratebay.org server often gives error, and I can only access the site's latest snapshot provided by "Cloudflare's Always Online™ technology", but downloading the dump file is istill impossible.

I think OfflineBay could be a good alternative for such cases as well if it automatically attempted to connect to mirror sites and even, as a last resort, provided the latest dump file hosted directly in this project repository.

I hope you can implement this suggestion as it would be a real relief to many users, I guess.

Thanks a lot.

failed to update

Check internet connection or URL?

https://thepiratebay.org/static/dump/csv/torrent_dump_full.csv.gz

Search icon loads forever - Mac OS 10.13.5

I was able to open and import the dump file but I cannot see the list of torrents. When I try to search something, the searching icon loads forever like this

Logs from Mac console

error	21:22:19.362052 +0500	OfflineBay	nw_path_close_fd Failed to close guarded necp fd 32 [9: Bad file descriptor]

Logs from terminal

» /Applications/OfflineBay.app/Contents/MacOS/OfflineBay                                                                          1 ↵
2018-06-27 22:48:07.414 OfflineBay[6429:288242] *** WARNING: Textured window <AtomNSWindow: 0x7fd1fbc47200> is getting an implicitly transparent titlebar. This will break when linking against newer SDKs. Use NSWindows -titlebarAppearsTransparent=YES instead.

objc[6429]: Class FIFinderSyncExtensionHost is implemented in both /System/Library/PrivateFrameworks/FinderKit.framework/Versions/A/FinderKit (0x7fff864b3c90) and /System/Library/PrivateFrameworks/FileProvider.framework/OverrideBundles/FinderSyncCollaborationFileProviderOverride.bundle/Contents/MacOS/FinderSyncCollaborationFileProviderOverride (0x1103d9cd8). One of the two will be used. Which one is undefined.

Import process ended
Search process ended

Dump Files

I tried to load both csv and gz. Files permissions are

$ ls -l torrent_dump_full.csv*
$ -rw-r--r-- 1 waseem 189397230 Jun 27 21:07 torrent_dump_full.csv
$ -rw-r--r-- 1 waseem  93037900 Jun 27 20:48 torrent_dump_full.csv.gz

Not working 10.14

OfflineBay does not open

Offlinebay not working - Mac OS 10.13.4

I downloaded the OS X version of the app. When trying to open it, the app icon appears in the dock, the app itself is open, but no windows appear and under the menu the only option is to quit.

Add seeds/peers results column and content type search filter

If you could add an option to asynchronously update values in a seeds peers column, then the results could be ordered by likelihood to successfully download files (I know you can double click on each one individually). Also the real site also has a content type search filter that is very useful.

Want to work together?

Hi @techtacoriginal, I have been admiring your work with offline bay. I have been redeveloping some new/old software called the off system also built on electron. I'm planning on building a whole suite of tools for decentralized applications including p2p databases, messaging, and application distribution based up on it. Its all open source and my github is https://github.com/vijayee . The project is js-offs. Let me know if you'd be interested in collaborating.