discoverygarden/dgi_migrate

A module to facilitate bulk ingest and migrations into Islandora using the migrate module.

DGI Migrate

Introduction

A module to facilitate I7 to Modern Islandora migration.

Table of Contents

• Features
• Included Modules
• Requirements
• Installation
• Usage
• Resources
• Troubleshooting/Issues
• Maintainers and Sponsors
• Development/Contribution
• License

Features

An improved migration import command migrate:batch-import is included. An example FOXML migration that can be used as a starting point is provided. It illustrates the usage of migrate plugins that have been created to facilitate FOXML and large data processing.

• dgi_migrate.process.xml.xpath is limited to xpath 1.0.

Some migration helper scripts are also included. Refer to the readme for more details.

Included modules

DGI Migrate has a suite of submodules to assist in the migration process.

• devel
• dgi_migrate_big_set_overrides
• dgi_migrate_dspace
• dgi_migrate_edtf_validator
• dgi_migrate_foxml_standard_mods
• dgi_migrate_imagemagick_cleanup
• dgi_migrate_paragraphs
• dgi_migrate_regenerate_pathauto_aliases

Requirements

This module requires the following modules/libraries:

• migrate
• migrate_plus
• migrate_directory

  NOTE: For better performance and memory optimisation, it is advised to use the module with this patch

• islandora
• islandora_drush_utils
• foxml

Installation

Install as usual, see this for further information.

Usage

migrate:batch-import beer_node_revision --idlist=1:2,2:3,3:5 --user=islandora

dgi-migrate:rollback beer_user --idlist=5 --user=islandora

Troubleshooting/Issues

Having problems or solved a problem? Contact discoverygarden.

Known Issues:

• php://filter use can lead to large memory usage
  • we should probably look at rolling another stream wrapper to wrap up our usage of OpenSSL to Base64 decode
• There are some expensive assertions made in the code, particularly regarding binary datastream content with digests. Assertions should typically be disabled in production environments, so these shouldn't have any impact on execution there; however, in development environments, could potentially lead to issues, especially with larger datastreams, exacerbated by the php://filter usage to Base64-decode the contents
  • hesitant to remove the assertions without having any other mechanism to
  • could instead roll some unit tests?

Resources

DGI migrate enhances Drupal's core migration framework and provides plugins to facilitate migration of legacy Islandora data to Modern Islandora. For more details regarding Drupal's migrate API and workflow, refer to these documents:

• Migrate API Overview
• Drush Migrate Commands
• Drupal Migration Tutorial

Maintainers and Sponsors

Current maintainers:

• discoverygarden

Sponsors:

• FLVC

Development/Contribution

If you would like to contribute to this module, please check out github's helpful Contributing to projects documentation and Islandora community's Documention for developers to create an issue or pull request and/or contact discoverygarden.

License

GPLv3