danielfullmer/nzbfs

NZB Filesystem using FUSE/Python

nzbfs's Issues

Separate nzb and rar extraction into their own scripts

Instead of doing nzb and rar "extraction" within the nzbfs.py process, we could separate those tasks into their own scripts. We'd let nzbfs trigger another script whenever a .nzb file is closed. That script would then parse, create a subdir, and write out protobuf files for each file in the nzb. It could then forward that along to another script for rar extraction, which would work similarly.

zlib.error: Error -3 when calling nzbfs-extract-rars

I'm trying to use the auto-extract feature of nzbfs, but I receive the following error.

Traceback (most recent call last):
File "/usr/local/bin/nzbfs-extract-rars", line 11, in
extract_rars_in_dir(sys.argv[1])
File "/usr/local/lib/python2.7/dist-packages/nzbfs/tools.py", line 114, in extract_rars_in_dir
extract_rar(dirpath, rar_filenames)
File "/usr/local/lib/python2.7/dist-packages/nzbfs/tools.py", line 43, in extract_rar
'%s/%s-raw' % (dirpath, rar_filename))
File "/usr/local/lib/python2.7/dist-packages/nzbfs/files.py", line 452, in load_nzbfs_file
data = zlib.decompress(compressed_data)
zlib.error: Error -3 while decompressing data: unknown compression method

I have the following zlib packages installed.
ii zlib1g:amd64 1:1.2.8.dfsg-1ubuntu1 amd64 compression library - runtime
ii zlib1g-dev:amd64 1:1.2.8.dfsg-1ubuntu1 amd64 compression library - development

Any help would be hugely appreciated. Thank you for the really useful software!

Use Protocol Buffers

Instead of using pickle to serialize file information, use protocol buffers.

Randomly uses 100% of CPU

Sometimes, some thread decides to use up as much CPU as possible. This is probably due to livelock in in the complicated locking system I'm using.

Use a better caching system

Either:

1. Improve the existing cache
2. Use another cache like "beaker"

Specifically, I would really like to have an on-disk cache that is given a particular amount of space it can use, while rotating out old cache entries if they haven't been used for a while.

Add tests