java.lang.StringIndexOutOfBoundsException: String index out of range

[saurfang]

java.lang.StringIndexOutOfBoundsException: String index out of range

[8bit-pixies]

You might have better luck if you provide the file.sas7bdat which reproduces this so that people can have a look.

[buyology]

Sure it was this file with results from PISA: http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_STU_QQQ.zip

[niraj7848]

When I am trying to parse a 32MB file I am able to parse it and convert it into CSV file.

But when I am trying convert a 7GB file, I am getting ArrayIndexOutOfBoundException as below.

Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
at java.util.ArrayList.rangeCheck(ArrayList.java:653)
at java.util.ArrayList.get(ArrayList.java:429)
at com.ggasoftware.parso.SasFileParser.readSubheaderSignature(SasFileParser.java:493)
at com.ggasoftware.parso.SasFileParser.processPageMetadata(SasFileParser.java:460)
at com.ggasoftware.parso.SasFileParser.processNextPage(SasFileParser.java:937)
at com.ggasoftware.parso.SasFileParser.readNextPage(SasFileParser.java:919)
... 29 more

But When running with a 120MB file it is giving following exception
Caused by: java.nio.BufferUnderflowException
at java.nio.Buffer.nextGetIndex(Buffer.java:506)
at java.nio.HeapByteBuffer.getDouble(HeapByteBuffer.java:514)
at com.ggasoftware.parso.SasFileParser.bytesToDate(SasFileParser.java:1312)
at com.ggasoftware.parso.SasFileParser.processByteArrayWithData(SasFileParser.java:1106)
at com.ggasoftware.parso.SasFileParser.readNext(SasFileParser.java:887)
... 32 more

I am really not sure how to debug. Any help or guidance will be highly appreciated.
Thanks

[niraj7848]

BufferUnderflowException issue got resolved.
IndexOutOfBoundsException is coming because of wrong offset to read the subheader. readSubheaderSignature method is getting the index which is greater than the size of a Page and hence it is throwing IndexOutOfBoundsException.

Has anyone worked on this problem?

@niraj7848 Can you explain how you resolved the BufferUnderflowException? I'm using 1.1.5

[saurfang]

Please give the new version a try as we believe this might have been fixed.