harvard-library/aspace-import-excel

Import resources, archival objects, etc. into ArchivesSpace using Excel spreadsheet files

aspace-import-excel's Issues

Could not find gem 'rubyXL (= 3.3.29) java' with aspace-import-excel v2.1.17 on AS 2.6.0

Upgraded ArchivesSpace from 2.3.2 to 2.6.0 on a RHEL 6.8 machine. Current environment is:
openjdk version "1.8.0_111"
OpenJDK Runtime Environment (build 1.8.0_111-b15)
OpenJDK 64-Bit Server VM (build 25.111-b15, mixed mode)
$ ruby -v; gem -v
ruby 1.8.7 (2013-06-27 patchlevel 374) [x86_64-linux]
1.3.7

The aspace-import-excel plugin seems incompatible, due to a gem issue.

Initially AS would not start accepting connections. In the log file was:

[!] There was an error parsing Gemfile: You cannot specify the same gem twice with different version requirements.
You specified: pry (>= 0) and pry (~> 0.11.3). Bundler cannot continue.

I disabled the plugin, the https://github.com/harvard-library/aspace-import-excel spreadsheet importer, and it ArchivesSpace started.

Yesterday, I then downloaded the most recent version of aspace-import-excel-master, and received a slightly different message:

Jun 18, 2019 6:14:20 PM org.eclipse.jetty.server.handler.ContextHandler$Context log
WARNING: ERROR: initialization failed
org.jruby.rack.RackInitializationException: Could not find gem 'rubyXL (= 3.3.29) java' in any of the gem sources listed in your Gemfile.

$ more aspace-import-excel/Gemfile
ASpaceGems.setup if defined? ASpaceGems

source 'http://rubygems.org'

gem 'rubyXL', "3.3.29", :require => false

archivesspace@archivesspace:/archivesspace-v2.6.0/archivesspace/plugins$ more aspace-import-excel/VERSION
v2.1.17
archivesspace@archivesspace:/archivesspace-v2.6.0/archivesspace/plugins$

Is there anything I can do to get this plugin operational?

Thanks

Adds T00:00:00+00:00 after date in YYYY-MM-DD format

We're testing this plugin for use with a large spreadsheet and noticed that the Begin Date and End Date fields end up with T00:00:00+00:00 in ArchivesSpace after the date in YYYY-MM-DD format. This doesn't happen for YYYY or YYYY-MM date types.

Is there a workaround or something we're doing wrong that's causing this? I can clean it up in the EAD after export but would prefer to not have it in AS in the first place if possible.

Thank you!

404 Error accessing "/admin/resources/80/getfile" when clicking on "Load via Spreadsheet" button

Hello,

On an ArchivesSpace v2.2.2 instance, A 404 error is thrown when trying to populate a resource from spreadsheet.

The error from the log is:
ActionController::RoutingError (No route matches [POST] "/admin/resources/80/getfile"):

I've verified that the plugin is installed in plugins/, and viewing the resources_updates_controller.rb controller in plugins/aspace-import-excel/frontend/controllers, I can see that the getfile action is defined there, and the relevant routes are defined in plugins/aspace-import-excel/frontend/routes.rb.

I've also verified that the config/config.rb file has 'aspace-import-excel' specified in AppConfig[:plugins], and that the plugin has been initialized with scripts/initialize-plugin.sh.

It looks like the plugin is installed correctly, is there anything else that could be causing the plugin to not load correctly?

Thank you!

Problem with ASpace Service starting after Plugin install

            Good Afternoon,  I recently installed the aspace-import-excel plugin to my Test server.  Its running AS 2.4.1.  When attempting to restart the ASpace service to test the plugin I receive the below output in the achivessapce.out log:

You're seeing this error because you use JRuby::Rack::ErrorApp::ShowStatus.

). Retrying... Jul 25, 2018 3:44:09 PM org.eclipse.jetty.server.handler.ContextHandler$Context log INFO: DEBUG: due a previous initialization failure application instance can not be returned Jul 25, 2018 3:44:09 PM org.eclipse.jetty.server.handler.ContextHandler$Context log INFO: DEBUG: resetting rack response due exception E, [2018-07-25T15:44:09.659499 #15169] ERROR -- : Thread-2002: Connection to backend failed ( <title>Internal Server Error at /config/enumerations</title> <style type="text/css"> html * { padding:0; margin:0; } body * { padding:10px 20px; } body * * { padding:0; } body { font:small sans-serif; background:#eee; } body>div { border-bottom:1px solid #ddd; } h1 { font-weight:normal; margin-bottom:.4em; } h1 span { font-size:60%; color:#666; font-weight:normal; } table { border:none; border-collapse: collapse; width:100%; } td, th { vertical-align:top; padding:2px 3px; } th { width:12em; text-align:right; color:#666; padding-right:.5em; } #info { background:#f6f6f6; } #info ol { margin: 0.5em 4em; } #info ol li { font-family: monospace; } #summary { background: #ffc; } #explanation { background:#eee; border-bottom: 0px none; } </style>

Internal Server Error (500)

Request Method:	GET
Request URL:	http://localhost:8089/config/enumerations

[!] There was an error parsing `Gemfile`: You cannot specify the same gem twice with different version requirements. You specified: pry (>= 0) and pry (~> 0.11.3). Bundler cannot continue.

from /archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/Gemfile:58

-------------------------------------------

require 'asutils'

> ASUtils.load_plugin_gems(self)

-------------------------------------------

    from /archivesspace/gems/gems/bundler-1.16.1/lib/bundler/dsl.rb:110:in `gem'
    from (eval):6:in `<eval>'
    from org/jruby/RubyBasicObject.java:1693:in `instance_eval'
    from uri:classloader:/asutils.rb:245:in `block in load_plugin_gems'
    from org/jruby/RubyArray.java:1734:in `each'
    from uri:classloader:/asutils.rb:241:in `load_plugin_gems'
    from /archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/Gemfile:58:in `<eval>'
    from org/jruby/RubyBasicObject.java:1705:in `instance_eval'
    from /archivesspace/gems/gems/bundler-1.16.1/lib/bundler/dsl.rb:47:in `eval_gemfile'
    from /archivesspace/gems/gems/bundler-1.16.1/lib/bundler/dsl.rb:12:in `evaluate'
    from /archivesspace/gems/gems/bundler-1.16.1/lib/bundler/definition.rb:35:in `build'
    from /archivesspace/gems/gems/bundler-1.16.1/lib/bundler.rb:135:in `definition'
    from /archivesspace/gems/gems/bundler-1.16.1/lib/bundler.rb:101:in `setup'
    from /archivesspace/gems/gems/bundler-1.16.1/lib/bundler/setup.rb:20:in `<main>'
    from org/jruby/RubyKernel.java:961:in `require'
    from uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:133:in `require'
    from /archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/main.rb:1:in `<main>'
    from org/jruby/RubyKernel.java:961:in `require'
    from uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:55:in `require'
    from /archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/app/main.rb:1:in `block in (root)'
    from org/jruby/RubyBasicObject.java:1687:in `instance_eval'
    from /archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/config.ru:1:in `(root)'
    from /archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/config.ru:4:in `<main>'
    from launcher/launcher.rb:92:in `start_server'
    from launcher/launcher.rb:157:in `main'
    from launcher/launcher.rb:261:in `<main>'

That continues in an endless loop an the pages never come up. Assistance is greatly appreciated.

Regards,

Updating existing archival objects?

First - thank you so much for creating and continuing to expand the functionality of this importer! It's such a life saver.

Secondly, is it possible to use this importer to update existing archival objects, rather than create new instances of archival objects? I would like to append subject information to existing archival objects in bulk, and can't figure out a good way to do so. If not, is there any way to take existing archival objects, export the metadata fields required by the template, update the subject fields, then re-instantiate them after deleting the old archival objects?

Many thanks for your help!

12K-line spreadsheet breaks in v2.*

From #9 comments:

Hi Bobbi, I have a follow-up question about the plugin. We were able to load a spreadsheet of almost 12,000 rows once successfully but since then have kept bumping into what seems to be a time-out error of some sort as we test further. This doesn't happen with spreadsheets of 5000 rows or fewer. Are there any settings in any of the code or in AS that we might be able to manipulate to avoid that? We can break the spreadsheet into smaller chunks if need be, but I thought I'd check first since it did work once. When it worked our test instance was still on v1.5.4 but now is on v2.0. Systems is going to upgrade us to v2.1.2 soon to see if that has any impact. I appreciate any insight you might have. Amber

Errors in processing Digital Object load: missing IDs

When loading a spreadsheet for "Add Digital Objects to Archival Objects", a digital object id is not being created from the archival object ref id if it is left blank.

initialization broken under Aspace v2.4.0 ?

ArchivesSpace v2.4.0 fails to start for me with this plugin installed. ( Both with current master and with 2.1.4, which is what was initially installed. )
Initialization complains about duplicate versions of pry specified, but I can only find one version installed or referenced in Gemfiles. No pry in archivesspace/gems/gems/... .
I tried removing the '~> 0.11.3' from Gemfile and re-running initialize-plugin script, but then it complains about not finding slop gem.
( Duplicate version message said the versions were 'pry', '~> 0.11.3' and 'pry' )

The file you have chosen is not an Excel Spreadsheet

I'm testing this out on a local instance of ASpace (2.4.1 on Windows 10, using the embedded database), but cannot get past this error. This occurs with every xslx and xls I've thrown at it, and even when using an unedited copy of the provided Excel template.

BUG: Notes fields not marked "publish: true"

Even when the general Publish column is set as TRUE in the spreadsheet, any notes created are not assigned "publish: true"

Won't Close If You Miss The File First Try

Kind of a small bug I guess?

I am editing a resource and clicked load via spreadsheet and the form loaded to upload a file. I tried to click cancel and the x but neither will close it.

I clicked on Load via Spreadsheet>Import from Spreadsheet (I didn’t select a file first), got an message “You have not added a file”, I closed the message THEN, on the load spreadsheet form, I tried to cancel and click the x and it wouldn’t close.

Refreshing the page does make it go away.

appending time to all dates

When we upload a spreadsheet using the plug in the resulting records have the a time stamp added to the date: 1985-01-01T00:00:00+00:00. This is happening with all the records and for both start and end dates. We are running ArchivesSpace v2.0.0 and v1.0 of the plugin.

Restrictions flag is not being honored.

When set to true, the restrictions flag in the spread sheet is not being processed correctly. Attached is an example spreadsheet.
restrictions_flag_bug-Thomas-IIIB-43.xlsx

Language of materials note not importing into resource record

Hi, we tried importing archival records with language of materials notes and got the following error message: "undefined method `[]' for nil:NilClass" and no archival object was created as result. I'm wondering if this has anything to do with our recent upgrade to 2.7.0, which has the new Language Sub-record. Any feedback would be appreciated. Thank you! - Carolina Meneses

pry gem has incompatible dependency

pry is specified at '~> 0.10.4', which is dependent on method_source ~> 0.8.1, but AS frontend Gemfile specifies method_source 0.9.0.

Here is the error:

Bundler could not find compatible versions for gem "method_source": In snapshot (Gemfile.lock): method_source (= 0.9.0) In Gemfile: pry (~> 0.10.4) java was resolved to 0.10.4, which depends on method_source (~> 0.8.1) java rails (= 5.0.1) java was resolved to 5.0.1, which depends on railties (= 5.0.1) java was resolved to 5.0.1, which depends on method_source
...

AO import Digital Object thumbnail (second file version) not loading

I've been trying to load archival objects with associated digital objects using the template provided but for some reason the thumbnail link will not import. No errors appear when uploading. I didn't realize it was an issue until I had gone back to check the end product. I am attaching
brfa001_DAO_pt5.xlsx
one of the spreadsheets I used for your inspection.

Much appreciated! This is a great tool!

xlink namespace in extref causes scopecontent note import to fail

When uploading mixed content in a scopecontent notes that includes an extref with xlink namespaces, the importer skips the note and throws an error. For example:

This note includes a namespaced-link here: <extref xlink:type="simple" xlink:href="http://www.example.com">ExampleLink</extref>

We would like to be able to upload notes with properly-namespaced extrefs.

in pre AS 2.2.2 version, Digital Object publish status is not being set

When a digital object is created, and the publish status is true, the files have the correct publish status, but the digital object itself does not.

Error adding to v2.2.0

I just tried to install this on the recently released v2.2.0 running on Centos 6.9 and got the following error when I ran scripts/initialize-plugin.sh aspace-import-excel;

[root@archivesspace-dev archivesspace]# ./scripts/initialize-plugin.sh aspace-import-excel Fetching: bundler-1.12.5.gem (100%) NotImplementedError: flock unsupported or native support failed to load; see http://wiki.jruby.org/Native-Libraries flock at org/jruby/RubyFile.java:324 block in write_binary at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems.rb:871 open at org/jruby/RubyIO.java:1139 open at org/jruby/RubyKernel.java:306 write_binary at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems.rb:869 cache_update_path at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/remote_fetcher.rb:334 download at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/remote_fetcher.rb:188 download at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/source.rb:211 install at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/resolver/specification.rb:91 block in install at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/request_set.rb:166 each at org/jruby/RubyArray.java:1734 install at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/request_set.rb:156 install_gem at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/commands/install_command.rb:205 block in install_gems at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/commands/install_command.rb:255 each at org/jruby/RubyArray.java:1734 install_gems at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/commands/install_command.rb:251 execute at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/commands/install_command.rb:158 invoke_with_build_args at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/command.rb:310 process_args at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/command_manager.rb:169 run at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/command_manager.rb:139 run at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/gem_runner.rb:55 <main> at uri:classloader:/META-INF/jruby.home/bin/jgem:21 load at org/jruby/RubyKernel.java:979 <main> at uri:classloader:/META-INF/jruby.home/bin/gem:4 Gem::GemNotFoundException: can't find gem bundler (>= 0.a) find_spec_for_exe at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems.rb:271 activate_bin_path at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems.rb:298 <main> at ../../gems/bin/bundle:22

When I tried to start archivesspace it fails

i'm assuming this is just not compatible with v2.2.0 yet, but if there's anything other information I can provide here, or anything else else I should check or change please advise. Thanks. -Matt

Importing Language to Archival Object Basic Info Rather than Language Notes

Does anyone have a tweak to the code that would put an imported language into the Archival Object Basic Info Rather than Language Notes? I would like to specify language at the item level at the top of the record rather than having it buried in the notes. Anyone? Help? Thanks! VivianLea Solek, Archivist, Knights of Columbus Supreme Council Archives.

Scroll bar not re-appearing after closing pop-up

After closing the aspace-import-excel popup window, the screen "un-greys", but the browser's right scroll bar does not appear. This seems to occur when there are errors such that no Archival Objects are created.

Before running the plugin:

After running the plugin:

Could not find gem 'rubyXL (= 3.3.29) java' with aspace-import-excel v3.0.4 on AS 2.8.1

I saw another person had this issue with AS 2.6.0 and an earlier version of the plugin. I'm seeing it now with AS 2.8.1 and the latest stable release of the plugin. Anyone have a fix I can try? I did run scripts/initialize-plugin.sh aspace-import-excel (though the documentation says I shouldn't have to anymore) but it made no difference.

Unwanted conversion to date in child indicator column

(From A.H:)

Hi Bobbi,

Attached is the spreadsheet. Column AB “Child Indicator” is the column in question. I wanted to put that this was volumes 1-2, thus input “1-2” in the column. It then converted it to 2-Jan.
Pulp Fiction template_child_indicator.xlsx

Ref ID not importing into resource record

Hello. We have been testing import of both the Archival Object and Digital Object spreadsheets, so that we can get more information into the digital object records than we are able to just via the archival object spreadsheet. However, I'm finding that the Ref ID values that I'm inputting into the archival object spreadsheet are not being imported into the resource record. (This is the only content that is not being imported as input.) Are there requirements on the characters in that field that might be hindering import, other than that it should be a string? I know that the ref ID field is really important for pairing the digital object instances with their archival object components, so figuring out this gap in the workflow is key. Any feedback would be very welcome and appreciated.

Thanks so much -- Jasmine Jones

P.S. Hi Dave. Hope you are doing well!

Ref ID not found error

I keep getting the error that the Ref IDs can't be found when I try to import using the Digital Object import spreadsheet. This is weird, because I have verified that the Ref IDs that I have in the spreadsheet match the Ref IDs on the Archival Objects that I'm trying to attach to, and I have no trailing white space before or after the Ref IDs in the spreadsheet. Any ideas why I'd be getting this error? Please see attached for screenshot of error.

Uploading Multiple Digital Objects to Archival Objects as import

Hi!

Thank you so much for this tool - I am trying to connect up our Archival Objects to our DAM IDs as we are working on connecting everything up in a Linked Open Data set where (Archival and from our Art Collections Management System) resources are linked to representative iiif records. Most of our records have multiple Digital Objects associated (i.e. a 4 page letter). Is anyone working on an upload that allows one to bulk create multiple Digital Objects attached to associated Archive Object records.

The spreadsheet works like a dream (love the inherited title feature!)

Any ideas would be much appreciated!
Thanks,
Liz
Curator of Digital Experience
Georgia O'Keeffe Museum
Santa Fe, N.M.
[email protected]

Processing stopped at row 6 [Error(s) parsing Excel File No processible data rows found!]

I just tried the latest version with the latest template and I'm getting this error. I do have an EADID in that field. Am I doing something wrong or is there a bug here?

Processing stopped at row 6 [Error(s) parsing Excel File No processible data rows found!] Row 6 Row 6 will not be processed due to errors: This form's Resource is missing an EAD ID No Archival Object created

Enabling the plugin prevents archivesspace from starting with JRuby error

Error message from log
You're seeing this error because you use JRuby::Rack::ErrorApp::ShowStatus.
Configuration: RHEL 7.4, Apache 2.4.6, php 5.6.33, MySQL 5.6.39, archivesspace 2.3.1, header and style customizations in plugins/local/public

rubyzip gem version declaration causes problems with AS 2.2.2

Bundler fails when starting AS 2.2.2 because AS core declares this in backend/Gemfile:
gem "rubyzip", "~> 1.2.1" # because of rubyzip/rubyzip#315

And the plugin's Gemfile says:
gem 'rubyzip', "1.0.0", :require => false

This is the error:

[!] There was an error parsing `Gemfile`: You cannot specify the same gem twice with different version requirements.
You specified: rubyzip (~> 1.2.1) and rubyzip (= 1.0.0). Bundler cannot continue.

 #  from /opt/archivesspace-v2.2.2/archivesspace/data/tmp/jetty-0.0.0.0-8089-backend.war-_-any-/webapp/WEB-INF/Gemfile:51
 #  -------------------------------------------
 #  require 'asutils'
 >  ASUtils.load_plugin_gems(self)
 #  -------------------------------------------

Compatibility with AS v2.7.0?

Since upgrading ArchivesSpace to v2.7.0, I have noticed that when I trigger a spreadsheet import from a resource record, I receive a Bad Gateway error in the staff interface (after a considerable delay).

I also see the following "Calling a deprecated endpoint" error in my log file (logs/archivesspace.out):

The plugin was working as expected in v2.6.0, so I'm wondering if something has changed in v2.7.0 that makes the current plugin incompatible (and if it's an easy fix:)). Thanks for considering.

Link Subjects Error

When I Load a spreadsheet where I have attached subject ID for existing subject or from a Subject Term I get the error

NOT FOUND: 'injest' not found in list subject_source

No subject is added to the created archival object, which seems to be created but not complete, other information like top container is also omitted. I can create new subject via the spreadsheet with no error.

Duplicate Entries after Import and long import time

Hello,

We are running Archivesspace 2.5.2 with this plugin (v 2.1.20) installed. We recently tried importing with a spreadsheet with 4,415 lines, and while it worked well initially, it seemed like it stopped functioning correctly and started to import a number of records a second time. Almost like multiple import processes were running. I thought it might just need more time to run, but after almost 24 hours it was clear things weren't right. A parent record that should have had about 2,971 items had around 4,000 before I restarted Archivesspace.

Is there a recommend max limit for the number of rows in the spreadsheet? What could cause this scenario to happen?

In case it's helpful -- I would occasionally see "VALIDATION ERROR ON SECOND SAVE" error in the log (
https://github.com/harvard-library/aspace-import-excel/blob/master/frontend/controllers/resources_updates_controller.rb#L533) though I'm not sure what to do about it or what it means for the record. (and I lost the log file as I didn't realize that archives space would truncate it upon restart)

Not sure why this happened - any thoughts?

please help with install issue

Hi Bobbi,

I attempted to install your aspace-import-excel plugin on a windows platform, using version 2.1.1 ... I am operating with 2.5 version of ASpace. Unfortunately, after what I thought was a success in running the initialize-plugin.bat script and getting confirmation that 4 gems were installed, there still seems to be an obstacle in getting ASpace back online. The server message I received was:

Bundler could not find compatible versions for gem "bundler": In Gemfile: rails (= 5.0.1) java was resolved to 5.0.1, which depends on bundler (< 2.0, >= 1.3.0) java Current Bundler version: bundler (2.0.1) This Gemfile requires a different version of Bundler. Perhaps you need to update Bundler by running gem install bundler? Could not find gem 'bundler (< 2.0, >= 1.3.0)', which is required by gem 'rails (= 5.0.1)', in any of the sources. from C:/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/resolver.rb:56:in start' from C:/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/resolver.rb:22:in resolve' from C:/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/definition.rb:258:in resolve' from C:/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/definition.rb:170:in specs' from C:/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/definition.rb:237:in specs_for' from C:/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/definition.rb:226:in requested_specs' from C:/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/runtime.rb:108:in block in requested_specs' from C:/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/runtime.rb:20:in setup' from C:/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler.rb:107:in setup' from C:/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/setup.rb:20:in

' from org/jruby/RubyKernel.java:961:in require' from uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1:in (root)' from uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:133:in <main>' from org/jruby/RubyKernel.java:961:in require' from C:/archivesspace/data/tmp/jetty-0.0.0.0-8080-frontend.war-_-any-/webapp/WEB-INF/config/boot.rb:10:in (root)' from uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1:in (root)' from uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:55:in require' from uri:classloader:/jruby/rack/rails/environment3.rb:23:in ' from C:\archivesspace\launcher\launcher.rb:92:in start_server' from C:\archivesspace\launcher\launcher.rb:168:in main' from C:\archivesspace\launcher\launcher.rb:261:in `'

You're seeing this error because you use JRuby::Rack::ErrorApp::ShowStatus

Could you possibly help me get this issue resolved?

Many thanks in advance,
Greg

Gregory D. Farr

Archivist

Episcopal Church in Connecticut

The Commons

290 Pratt Street | Box 52 | Meriden CT 06450
p 203-639-3501 x135

f 203-235-1008
[email protected]

Thumbnail url's not getting picked up in Digital Object creation

Because of an uppercased field name ('Thumbnail'), the thumbnail's URL is not getting picked up when a digital object is created.

[Unknown child node [xr:revisionPtr] for element [workbook]]

I'm receiving this error message consistently, having checked my spreadsheet over to the best of my ability. I attach the spreadsheet.
PromptbooksImport2.xlsx

Apologies and thanks!

assertion failed errors

In AS v2.*, got ASSERTION FAILED errors when trying to load spreadsheet
Example:
ERROR: Unknown response: {"error":"ASSERTION FAILED: {:id=>71329, :repo_id=>4, :lock_version=>0, :json_schema_version=>1, :barcode=>nil,

assertion_failed_error.xlsx

Initial grepping suggests that maybe there are IDs being used for agents or subjects which aren't associated with the given repository...

Enhancements when importing archival objects with containers?

Thank you so much for this plug-in! It's going to make our lives so much easier here.

I have a couple of questions/possible enhancements.

1. Is it possible to use the spreadsheet to assign locations to the containers? I don't see a field for this.
2. Is it possible to use the spreadsheet to assign profiles to the containers? I don't see a field for this either.
3. Is it possible to create more than one container per created archival object using the spreadsheet? (Our use case is that a particular archival object may be located in a paper folder in a box, but also on microfilm in a completely different box).

Thanks again!

Carly Bogen
Manager, Digital Programs
NYC Department of Records & Information Services

Top container uniqueness?

@bobbi-SMR - Since people can load things in iteratively with your plugin, I'm wondering what, if any, checks you do for top container uniqueness. If a top container already exists, what happens?

I ask because it's been called to our attention that starting with the 2.1 version of ASpace (when the old container model code was removed) that EADs can be rejected if the top containers in them are already in the system. If presumably spreadsheets loaded in with your plugin do not get rejected for the same reason, I'm wondering if there's something we can learn from your code for the core. Thanks in advance for any insights!

install issues, Bundler could not find compatible versions for gem "bundler"

I am running archivesspace 2.5.1 on RHEL 7.3,
[dsprouse@tslac4avned ~]$ ruby -v; gem -v
ruby 2.5.3p105 (2018-10-18 revision 65156) [x86_64-linux]
3.0.2
[dsprouse@tslac4avned ~]$ gem info bundler

*** LOCAL GEMS ***

bundler (2.0.1, 1.17.3, 1.17.2, 1.16.1, 1.12.5)
Authors: André Arko, Samuel Giddins, Colby Swandale, Hiroshi
Shibata, David Rodríguez, Grey Baker, Stephanie Morillo, Chris
Morris, James Wen, Tim Moore, André Medeiros, Jessica Lynn Suttles,
Terence Lee, Carl Lerche, Yehuda Katz
Homepage: http://bundler.io
License: MIT
Installed at (2.0.1): /usr/local/lib/ruby/gems/2.5.0
(1.17.3, default): /usr/local/lib/ruby/gems/2.5.0
(1.17.2): /usr/local/lib/ruby/gems/2.5.0
(1.16.1): /usr/local/lib/ruby/gems/2.5.0
(1.12.5): /usr/local/lib/ruby/gems/2.5.0

The best way to manage your application's dependencies

[dsprouse@tslac4avned ~]$

and I have been having trouble for a while trying to get this plugin installed, but even when it has looked like it installed successfully, it resulted in archivesspace being unable to start.

originally I was getting this error:
ERROR: While executing gem ... (Gem::Requirement::BadRequirementError)
Illformed requirement ["1.12.5\n1.16.1"]
Gem::GemNotFoundException: can't find gem bundler (>= 0.a)
find_spec_for_exe at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems.rb:271
activate_bin_path at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems.rb:298

at ../../gems/bin/bundle:23

and after I installed the old bundler versions 1.12.5 and 1.16.1 it finally looked like it was installing, although with an error:
[dsprouse@tslac4avned scripts]$ sudo ./initialize-plugin.sh aspace-import-excel
ERROR: While executing gem ... (Gem::Requirement::BadRequirementError)
Illformed requirement ["1.12.5\n1.16.1"]
Don't run Bundler as root. Bundler can ask for sudo if it is needed, and
installing your bundle as root will break this application for all non-root
users on this machine.
Using bundler 2.0.1
Using nokogiri 1.10.0 (java)
Using rubyzip 1.2.2
Using rubyXL 3.3.31
Bundle complete! 1 Gemfile dependency, 4 gems now installed.
Use bundle info [gemname] to see where a bundled gem is installed.
[dsprouse@tslac4avned scripts]$

and the result of that is that archivesspace starts, but is non-functional and this is the webpage output:
Internal Server Error (500)
Request Method: GET
Request URL: http://aris.tsl.texas.gov/

Bundler could not find compatible versions for gem "bundler": In Gemfile: rails (= 5.0.1) java was resolved to 5.0.1, which depends on bundler (< 2.0, >= 1.3.0) java Current Bundler version: bundler (2.0.1) This Gemfile requires a different version of Bundler. Perhaps you need to update Bundler by running gem install bundler? Could not find gem 'bundler (< 2.0, >= 1.3.0)', which is required by gem 'rails (= 5.0.1)', in any of the sources. from /var/www/aris/html/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/resolver.rb:56:in start' from /var/www/aris/html/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/resolver.rb:22:in resolve' from /var/www/aris/html/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/definition.rb:258:in resolve' from /var/www/aris/html/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/definition.rb:170:in specs' from /var/www/aris/html/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/definition.rb:237:in specs_for' from /var/www/aris/html/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/definition.rb:226:in requested_specs' from /var/www/aris/html/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/runtime.rb:108:in block in requested_specs' from /var/www/aris/html/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/runtime.rb:20:in setup' from /var/www/aris/html/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler.rb:107:in setup' from /var/www/aris/html/archivesspace/plugins/aspace-import-excel/gems/gems/bundler-2.0.1/lib/bundler/setup.rb:20:in

' from org/jruby/RubyKernel.java:961:in require' from uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1:in (root)' from uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:133:in <main>' from org/jruby/RubyKernel.java:961:in require' from /var/www/aris/html/archivesspace/data/tmp/jetty-0.0.0.0-8080-frontend.war-_-any-/webapp/WEB-INF/config/boot.rb:10:in (root)' from uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1:in (root)' from uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:55:in require' from uri:classloader:/jruby/rack/rails/environment3.rb:23:in ' from launcher/launcher.rb:92:in start_server' from launcher/launcher.rb:168:in main' from launcher/launcher.rb:261:in `'

You're seeing this error because you use JRuby::Rack::ErrorApp::ShowStatus.

any help/hints/tips on how to get this moving forward?

Search/match for agents is too loose

I attempted to import an object with an agent that exists but it errored out as : [More than one match found in the database]. There was an exact match, and there was also a loose match further disambiguated by date. So say I tried to import with Smith, Bill, and our database has both Smith, Bill, and Smith, Bill, 1919-1962, with dates added to further distinguish him from the first guy (as used to be the cataloging standard). It seems to me it would be better to link to the exact match and ignore the inexact match rather than failing to link the agent.

In another instance, there was no exact match, and I would have expected a corporate agent to be created, but it wasn't, because of loose matchiness. For example, let's say I entered The Boston School as a corporate agent; there is no agent with that name, but the words "Boston" and "School" are in a lot of corporate names, so I again got a : [More than one match found in the database] error. Was this discussed during initial development? Was this a purposeful decision?

Problem when a top_container that belongs to another repo is linked to

Baker library (repo 11) tried to add items from a spreadsheet (attached), defining a top container. the code found a top container with the same name, but belonging to a different repository, and tried to associate the items with it, resulting in the following (badly defined) error:

ERROR: Unknown response: {"error":"ASSERTION FAILED: {:id=>74473, :repo_id=>4, :lock_version=>2, :json_schema_version=>1, :barcode=>nil, :ils_holding_id=>nil, :ils_item_id=>nil, :exported_to_ils=>nil, :indicator=>\"4\", :created_by=>\"huabowers\", :last_modified_by=>\"huabowers\", :create_time=>2017-07-14 16:21:31 UTC, :system_mtime=>2017-07-14 17:34:22 UTC, :user_mtime=>2017-07-14 16:21:31 UTC, :type_id=>23372} has a repo_id of 4 but the active repository is 11"} (code: 500)
(Where id 74473 turns out to be a top container belonging to repo 4):

mysql> select * from top_container where id = '74473'; +-------+---------+--------------+---------------------+---------+----------------+-------------+-----------------+-----------+------------+------------------+---------------------+---------------------+---------------------+---------+ | id | repo_id | lock_version | json_schema_version | barcode | ils_holding_id | ils_item_id | exported_to_ils | indicator | created_by | last_modified_by | create_time | system_mtime | user_mtime | type_id | +-------+---------+--------------+---------------------+---------+----------------+-------------+-----------------+-----------+------------+------------------+---------------------+---------------------+---------------------+---------+ | 74473 | 4 | 2 | 1 | NULL | NULL | NULL | NULL | 4 | huabowers | huabowers | 2017-07-14 16:21:31 | 2017-07-14 17:34:22 | 2017-07-14 16:21:31 | 23372 | +-------+---------+--------------+---------------------+---------+----------------+-------------+-----------------+-----------+------------+------------------+---------------------+---------------------+---------------------+---------+

Need to do better checking of top containers!
hunt_error.xlsx

Other Level of Description

We are using your plugin to import a large amount (16,000 records) of data from an old records management system, and use the "Other Level" for Description for most items as they were described at the box level. The plug in allows us to input "Other Level" in the Description Level column, without issue the "Other Level" field is blank. But without a column to input the text for the name of that level, when ever we need to edit a record we need to add it. And as the column is blank I can not use batch find replace to add the information.

I noticed that you have this as a question on the spreadsheet:
"Should there be a column for Other Level of Description in Basic Information? And/or can it default to "unspecified"?"

I wanted to know if there was a plan to add this to the plug in.

Authority IDs for Agents and subjects

From an email:
, we were wondering if it was possible via the importer to bring in authority IDs for agents and subjects?

Series of error upon import

Hi, when I try to import the sheet it pops up a dialog box "ERROR: error; Error detected," and then another: "Processing stopped at row 200 [Error(s) parsing Excel File No processible data rows found!]" Each row that I've tried to import shows an error message like this "Row 6 will not be processed due to errors: This form's Resource is missing an EAD ID."

I've followed the suggestion to make sure that the EAD ID is formatted at text and also tried formatting all the rows differently or not at all. Any suggestions?