janejl/semafor-semantic-parser

Automatically exported from code.google.com/p/semafor-semantic-parser

semafor-semantic-parser's Issues

Too many open files error

When using semafor 2.1 on a file with a large number of sentences (more than 
50000), at some point it will crash because of a (catched) "Too many open 
files" error, that will then lead to a NullPointerException when the file 
descriptor will be used.

Traceback:
Processing batch of size:50 starting from: 49600
candidate_file_not_in_use (Too many open files)
Loading data....
Reading alphabet...
/path/to/semafor/semafor-semantic-parser/release/temp/64173.input.events.bin 
(Too many open files)
.0
Exception in thread "main" java.lang.NullPointerException
    at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
    at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
    at java.io.FilterOutputStream.write(FilterOutputStream.java:97)
    at edu.cmu.cs.lti.ark.fn.utils.BitOps.writeInt(BitOps.java:74)
    at edu.cmu.cs.lti.ark.fn.parsing.CreateAlphabet.run(CreateAlphabet.java:102)
    at edu.cmu.cs.lti.ark.fn.parsing.ParserDriver.runParser(ParserDriver.java:345)
    at edu.cmu.cs.lti.ark.fn.parsing.ParserDriver.main(ParserDriver.java:117)

I checked in edu.cmu.cs.lti.ark.fn.parsing.CreateAlphabet.run, the stream is 
correctly closed, so I guess there is a missing call to close() somewhere else.

Original issue reported on code.google.com by [email protected] on 5 Apr 2013 at 8:45

Java serialVersionUID doesn't match

with the stackedParserServer package, I ran the following cmd:

java -classpath ".:lib/*" -Xmx3g mst.DependencyParser test 
model-name:models/wsj.model test-file:input.txt output-file:out.txt

Default temp directory:./tmp/
Separate labeling: false
        Loading model...Exception in thread "main" java.io.InvalidClassException: gnu.trove.TObjectHash; local class incompatible: stream classdesc serialVersionUID = -5747943412751518873, local class serialVersionUID = 876253628862239263
        at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:562)
        at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1582)
        at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1495)
        at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1582)
        at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1495)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1731)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1328)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:350)
        at mst.Alphabet.readObject(Alphabet.java:105)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:974)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1848)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1752)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1328)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:350)
        at mst.DependencyParser.loadModel(DependencyParser.java:245)
        at mst.DependencyParser.main(DependencyParser.java:469)

The same output with mst.DependencyEnglish2OProjParser:

java -classpath ".:lib/*" -Xmx6g mst.DependencyEnglish2OProjParser 
models/wsj.model tmp 80

Solutions please?

Original issue reported on code.google.com by yaoxuchen on 12 Nov 2012 at 6:19