koraktor/rbzip2

bzip2 for Ruby

rbzip2's Issues

New version release?

The most recently released version of this gem on Rubygems is 0.2.0. I'd like to use this gem as a dependency in BrickAndMortar but I can't get 0.2.0 to work. The current commit, f8ab1ea, seems to work just fine for me (decompression only).

Is someone working on making a new release soon, or could I help to accomplish this?

If you're concerned about the gem not being stable enough yet, how about a release candidate version like 0.3.0-rc1?

Very bad performance of JRuby 1.7.4

I am trying to use this gem under JRuby 1.7.4 for decompressing file compressed in bzip2.

The size of compressed file is 422Kb. The decompressed file have 7.9M. Decompression by bzip2 in Linux take less than 1s.

When I am using the gem, the part of code RBzip2::Decompressor.new file take around 30s and the read part take more than 30mins ( yes minutes ). During the decompression Jruby process is taking 100% of one core on my PC. I am running it on Fedora 16. Java version 1.7.0.

FFI backend doesn't work on Windows

BZip2's public API functions use the stdcall calling convention on Windows, but rbzip2 tries to load them using the default cdecl convention. This leads to the functions not being found by FFI:

C:/Ruby225/lib/ruby/gems/2.2.0/gems/ffi-1.9.18-x86-mingw32/lib/ffi/library.rb:275:in `attach_function': Function 'BZ2_bzRead' not found in [bz2] (FFI::NotFoundError)
        from C:/Ruby225/lib/ruby/gems/2.2.0/gems/rbzip2-0.3.0/lib/rbzip2/ffi/decompressor.rb:20:in `<class:Decompressor>'
        from C:/Ruby225/lib/ruby/gems/2.2.0/gems/rbzip2-0.3.0/lib/rbzip2/ffi/decompressor.rb:7:in `<top (required)>'
        from C:/my_script.rb:45:in `<main>'

gets method not implemented

I am switching from MRI to JRuby and as such, I was replacing bzip2-ruby with rbzip2. Unfortunately this didn't work out because I am passing the resulting IO object to fastest-csv, which uses gets. bzip2-ruby implements this but rbzip2 doesn't. It's possibly less than trivial to implement and I may not have time right now.

Calling #write more than once is ignored

When calling the write method more than once is ignoring new data:

def bz2_read_file(file_name)
  File.open(file_name) do |file|
    io   = RBzip2.default_adapter::Decompressor.new(file)
    data = io.read
    io.close
    data
  end
end

File.open("test3.bz2", "wb") do |file|
  writer  = RBzip2.default_adapter::Compressor.new(file)
  writer.write("line1\n")
  writer.write("line2\n")
  writer.write("line3\n")
  writer.close
end

bz2_read_file("test3.bz2")

Only the first line is returned from the output file:

"line1\n"

RBZip2 never finishes on large file

Even for a moderately large file, RBzip2::Decompressor.new never returns, because it seems to sit endlessly in get_and_move_to_front_decode.

Code snippet that reproduces the problem (on linux)

#!/usr/bin/env ruby

`dd if=/dev/urandom of=output.dat bs=1M count=10`
`tar cjvf bigTar.tar.bz2 output.dat`
require 'rbzip2'
dc = RBzip2::Decompressor.new(File.new('bigTar.tar.bz2'))

Examples in README are wrong

Examples appear to be out of date. Did you mean RBzip2.default_adapter::Decompressor?