trln/argot-ruby

A Ruby Gem for processing Argot, the shared TRLN ingest format

argot-ruby's Issues

Make command line tools work with stdin/stdout or files

It would be convenient to have the argot command line tool accept either stdin and stdout as outputs in addition to providing explicit filenames, in order to have it participate in standard UNIX pipeline processes.

Write validation checks

• Must have
  Id, title, author
• Can only have 1
  Id, title (245)

Ensure "locations" facet is correctly processed

With the move to putting items into opaque fields, location is no longer getting correctly mapped to facet-like thing in Argon.

Add Ruby 3.0 / 3.1 compatibility

Update CI builds to use newer rubies and ensure compatibility of codebase with them. Remove deprecations. Keep Ruby 2.5 as a minimum.

Consider adding continuous integration

e.g. Travis, unless somebody has another suggestion.

Remove XML handling bits

This gem is supposed to be for Argot-related utilities, so the whole XML handling part is an outlier. Tools for managing XML and ICE have already been moved to trln/trln-util repo.

add stored attribute to solr_fields_conf

Tests should not be failing

(creating issue so y'all know I know)

Add validation to command line tools

Create some command line tools for local testing. I'll be following traject's model, unless there are objections

Spaces in vernacular solr field names

After running the ingest process argot ingest ../unc.json -s http://127.0.0.1:8983/solr/trln my solr index has a few field names that have spaces in them. A bug?

authors_main_ u _v_a
authors_main_ u _v_t
imprint_ u _v_a
imprint_ u _v_t
statement_of_responsibility_ u _v_a
statement_of_responsibility_ u _v_t

finish example solr_fields and config for solr suffixer

Error building under jruby

kspurgin@L004904:~/trln/argot-ruby$ ruby -v
jruby 9.1.8.0-SNAPSHOT (2.3.1) 2017-01-20 152cf90 Java HotSpot(TM) 64-Bit Server VM 25.121-b13 on 1.8.0_121-b13 +jit [linux-x86_64]
kspurgin@L004904:~/trln/argot-ruby$ ls
argot.gemspec  CHANGELOG.md  Jarfile.lock  LICENSE   README.md   test
bin            Jarfile       lib           Rakefile  ROADMAP.md
kspurgin@L004904:~/trln/argot-ruby$ gem build argot.gemspec 
Invalid gemspec in [argot.gemspec]: missing class name (`org.noggit.JSONParser')
ERROR:  Error loading gemspec. Aborting.

Is there something else that needs to be installed first for JRuby? If so, can where to get/how to install this be documented?

(successfully installed argot-ruby gem under MRI 2.3.3)

TD-348: Store items as JSON blobs

Item hashes should not be flattened