apbendi/csvsuite

Basic utilities for handling csv's

csvsuite's Issues

Files w/ Excelified columns can't subsequently be opened

Produces the following error, coming from w/in the CSV class

/opt/local/lib/ruby1.9/1.9.1/csv.rb:1925:in block (2 levels) in shift': Illegal quoting in line 2. (CSV::MalformedCSVError) from /opt/local/lib/ruby1.9/1.9.1/csv.rb:1887:ineach'
from /opt/local/lib/ruby1.9/1.9.1/csv.rb:1887:in block in shift' from /opt/local/lib/ruby1.9/1.9.1/csv.rb:1849:inloop'
from /opt/local/lib/ruby1.9/1.9.1/csv.rb:1849:in shift' from /opt/local/lib/ruby1.9/1.9.1/csv.rb:2273:inparse_headers'
from /opt/local/lib/ruby1.9/1.9.1/csv.rb:1955:in block in shift' from /opt/local/lib/ruby1.9/1.9.1/csv.rb:1849:inloop'
from /opt/local/lib/ruby1.9/1.9.1/csv.rb:1849:in shift' from /opt/local/lib/ruby1.9/1.9.1/csv.rb:1791:ineach'
from /opt/local/lib/ruby1.9/1.9.1/csv.rb:1805:in to_a' from /opt/local/lib/ruby1.9/1.9.1/csv.rb:1805:inread'
from /Users/ben/scripts/csvsuite/lib/suitecsv.rb:16:in initialize' from dre_merge5.rb:4:innew'
from dre_merge5.rb:4:in `

'

Does not properly open header-only CSV file

Opening a CSV file that is only the header row does not produce the expected behavior. For example, if the complete CSV file called my_headers.csv is:

Header1,Header2,Header3

...then currently:

header_csv = SuiteCSV.new 'my_headers.csv'
header_csv.headers

....produces NO output. It should produce:

Header1
Header2
Header3

Testing for MergeCSV

Save Feature

Test Cases for ComboCSV

We need these!

Testing for JoinCSV

Merge 2 Test fails inexplicably

Says something is different when it doesn't appear to be:

<<#CSV io_type:File io_path:"sample1-full_merge_ans.csv" encoding:UTF-8 lineno:44 col_sep:"," row_sep:"\n" quote_char:""" headers:["Internal ID", "First Name", "Last Name", "Party", "Home State", "Zip"]>> expected but was
<<#CSV io_type:File io_path:"sample1-full_merge_mer.csv" encoding:UTF-8 lineno:44 col_sep:"," row_sep:"\n" quote_char:""" headers:["Internal ID", "First Name", "Last Name", "Party", "Home State", "Zip"]>>.

Headers must be manually kept in sync

The headers of a SuiteCSV are set at initialization, but not automatically updated. If a new column is implicitly added by adding it to any given row, this is not reflected in the headers unless you are careful to also add said column to the headers themselves.

NOTE: The headers of a CSV::Table are determined by the headers of the first CSV::Row in said Table.

Discreet test case for Join

Current testing of Join only tests for things being included which shouldn't be...we should also test for things not included that should have been. Consider doing a Join & Unjoin and comparing both files to each other?

Running combines one-after-another will cause cells to shift

This is really a symptom of #1. To be safe, you must first run a combine, then write to a file, load the file, and run subsequent combine.