tamulib/fw-registry

fw-registry's Issues

Create Statistical Code Type Reference Data

Diagnose and address the failure of certain marc records conversion to marcjson

ILS Workflow: Export to Rapid ILS for print journals monthly

Perl scripts that run on ringle.tamu.edu to extract print journal and print monograph data for submission to Rapid ILS website. Journals run monthly, monographs quarterly.

Candidate for cron task.

Look into Rapid ILS website for possible input.

Look into LDP data types.

May require MARC bibliographic and MARC holdings record.

Create Workflow for Item Records

Modify items extractor SQL to group item data by mfhd_id

The stream should be by mfhd_id and have a collection of the item data. This is required to support enhancement of item folio reference UUID using the external reference resolver streaming collect.

Inventory ReferenceLink Workflow

Combine bib, holding, and item reference link workflow into one.

Holdings

Create Holdings Extractor SQL Query

This will need to sort by bib id. This may be tricky since the bib id is a field of the marc holding blob.

Systems Workflow: Library e-resource flag SQL view creation task (Oracle to MSSQL)

SQL (ringle.tamu.edu:/export/home/voyager/sql/am/library_eresources/library_eresources.sql), runs against DivIT registry database, to create a list of users who are authorized to access electronic resources licensed by TAMU Libraries.

API to perform the query. On-Demand.

Acquisitions Workflow: ISBN report to GOBI

Perl script (ringle:/export/home/voyager/scripts/general/ybp_isbn.pl) that extracts isbns for records created in the previous month and sends list of isbns to GOBI contact. GOBI loads into their system to protect against TAMU ordering duplicates.

Create Item Record Extractor Queries

Add and maintain HRID settings

Migrate Bibliographic Instances

Create Location Reference Data

Inventory Reference Link SQL

Create Workflow for Holdings Records

Create new items-streaming workflow

Should use StreamingExtractTransformLoadTask similar to users, vendors, and reference link workflows. Should use efficient extractor making additional looks while streaming.

User Migration should include all missing properties

Phone number is currently missing, there may be others.

Add and maintain MARC mapping rules

Create Process for Converting MARC to JSON

There are three apparent options for doing this:

1. Java: using a new task and delegate to do a two step conversion marc->xml->json

2. A processor which does that same two step conversion in javascript. This will be done by bringing the java classes used in the two step mapping described above into the Nashhorn context.

3. There is a potential for building a perl processor for this, as there is a marc to json library in perl.

4. other...

Bibliographic Migration Workflow

Create Call Number Type Reference Data

Eresources/Cataloging Workflow: Create brief instance records for new Coral items

Perl script that runs on 128.194.86.30 (highsmith.library.tamu.edu) to extract data for titles in Coral database that are not already represented in LibCat, format a basic MARC record for those titles, and upload the new MARC record. Uses Voyager BatchCat API.

Cron task to make requests to Coral and create stub instances in FOLIO if not yet existing.

Investigate compatibility of Data Import sub-pub import with TAMU migration strategy

Data Import has a new mechanism for importing records and creating instances. It uses pub-sub messaging and file upload. The performance is not yet benchmarked but has been reported to be faster than the legacy import. FYI, the legacy import is not called the secret button.

Modify holdings extractor SQL to group holding data by bib_id

The stream should be by bib_id and have a collection of the holding data, including the holding marc record. This is required to support enhancement of holding folio reference UUID using the external reference resolver streaming collect.

Holding ReferenceLink Workflow

Create Bibliographic Extractor SQL Queries

This should utilize the getBibBlob SQL function and be sorted by bib id. Two queries will need to be written, one for referenceLinks and another for migration.

Create new bibs-streaming workflow

Should use StreamingExtractTransformLoadTask similar to users, vendors, and reference link workflows. Should use efficient extractor making additional looks while streaming.

Get Migration Scripts Running on Q 3.2

Investigate provision of the 999 in instance record creation

Create new holdings-streaming workflow

Should use StreamingExtractTransformLoadTask similar to users, vendors, and reference link workflows. Should use efficient extractor making additional looks while streaming.

Update bibs workflow to use latest TAMU customized versions or SRM and SRS

Blocked by https://github.com/TAMULib/data-import-raml-storage/issues/7, https://github.com/TAMULib/data-import-raml-storage/issues/8, https://github.com/TAMULib/mod-source-record-storage/issues/1, https://github.com/TAMULib/mod-source-record-storage/issues/2, https://github.com/TAMULib/mod-source-record-manager/issues/6, https://github.com/TAMULib/mod-source-record-manager/issues/7

Holdings Migration Workflow Tasks

Update to use multiple requests

Update bibs workflow to use performant extractor with additional lookup for MARC

Blocked by TAMULib/mod-data-extractor#27

Decompose and simplify bib workflow

Cataloging Workflow: Extract MARC bib/holdings records with embedded item info for upload to JLF catalog

Perl script run on Voyager production server (obrian) that uses oracle getBibBlob/getMfhdBlob function to extract and format bib & mfhd records and embed into mfhds the items that have been processed for JLF submission

Look into FOLIO inventory responses with MARC. Determine if it can be converted to MARC binary.

Item ReferenceLink Workflow

Items Migration Workflow Tasks

Update workflows to specify requires authenitcation

Holdings workflow following bibs pagination workflow approach

Use the existing incomplete holdings workflow. Should use efficient extractor making additional looks while streaming.

Vendor Migration Workflow Regression

Items

MODSOURMAN-233

MODSOURMAN-233 will allow us to provide a UUID in the 999 field

Should be able to pre-populate field tag 999 subfields i and s for bibliographic instance UUID and blibliographic source record storage UUID.

Bibliographic Migration Workflow Tasks

Create Loan Type Reference Data

Bibliographic ReferenceLink Workflow

To be created in the fm-cli

Items workflow following bibs pagination workflow approach

Use the existing incomplete items workflow. Should use efficient extractor making additional looks while streaming.

Create Statistical Code Reference Data

Create directory for and maintain mod-data-migration request JSON

Will be used by new CLI command TAMULib/fw-cli#16