johnjung/iiif_tools

Scripts to produce IIIF Collections and Manifest files.

iiif_tools's Issues

What is G4104-C6-1933-U5?

The following identifiers exist in the social scientist maps collection:
G4104-C6-1933-U5-a
G4104-C6-1933-U5-b
G4104-C6-1933-U5-c
G4104-C6-1933-U5-d
G4104-C6-1933-U5-e
G4104-C6-1933-U5-f
G4104-C6-1933-U5-g
G4104-C6-1933-U5-h
G4104-C6-1933-U5-i
G4104-C6-1933-U5-j
G4104-C6-1933-U5-k
G4104-C6-1933-U5-l
G4104-C6-1933-U5-m
G4104-C6-1933-U5-o
G4104-C6-1933-U5-p

IIIF_Manifests contains data for the following identifier: G4104-C6-1933-U5. What is this?

can't pip install some software on s4

If I try to install software on s4 with pip, I get error messages like the following:

pip install docopt

Collecting docopt (from -r requirements.txt (line 1))
Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.VerifiedHTTPSConnection object at 0x807cdb2e8>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/docopt/
...

Running pip install with the verbose flag shows me that I'm not able to download the following file: https://pypi.org/simple/docopt/

If I do "curl https://pypi.org/simple/docopt/" from s4, the command just hangs. But that same command from my local machine works fine. Can you tell what's going on here?

Move code from homedir into common space on s4

Need permissions to upgrade Loris

According to the issue loris-imageserver/loris#435,

I need to edit the following file:
/data/red/loris_fakeroot/var/www/loris2/loris2.wsgi

However, that file is currently owned by the user and group "loris". Is it possible for me to be able to edit these files, or should I request all edits through sys-admin?

upgrade lxml on wagtail to 4.4.2?

from 3.5.0?

MAX_IMAGE_PIXELS in loris?

Is this an intermittent bug? I increased the MAX_IMAGE_PIXELS in transforms.py and img_info.py like this:

Image.MAX_IMAGE_PIXELS = 1000000000

Doing this prevented a server error while building manifests for the social scientists maps. However, after removing the line from the python files, re-installing and restarting Apache, I'm not able to get the initial error to appear again.

I'll keep track of this by leaving it here.

shut down iiif-collection-browse.lib

Permissions issue on yellow.lib.

I'd like to rebuild the virtual environment that currently lives at /data/yellow/iiifcollectionbrowse/venv. Is it possible to give me permission to remove that directory and build a new one?

Your log-in attempt did not appear to be successful. Please try again.

iiif-viewer.lib currently displays this error message. See the following URL:

https://iiif-viewer.lib.uchicago.edu/uv/uv.html#?manifest=https://iiif-manifest.lib.uchicago.edu/maps/chisoc/G4104-C6-1933-U5-a/G4104-C6-1933-U5-a.json

Get an overview of IIIF

Look at the IIIF website. Digirati's An Introduction to IIIF includes a lot of the reasoning behind certain choices in IIIF, and is also useful.

We'll need collection files and manifest files for our first project. For some example files, go to Owncloud and see the IIIF_Collections folder and the IIIF_Manifests folder.

Following that we'll need to set up the Content Search API for searchable OCR.

trouble installing Pillow on s4

I'm not able to install Pillow on s4. Here's the command I'm using:

pip install --proxy http://[email protected]:8080 Pillow

And here is the error log that's generated:

error_log.txt

The error log contains the following line: "The headers or library files could not be found for jpeg, a required dependency when compiling Pillow from source."

Do we need to install jpeg onto this machine via pkg before installing Pillow?

Write a script to produce IIIF Manifest files

Write a script like mvol_manifest.py (e.g., "maps_manifest.py") that can create IIIF Manifest files for the Social Science Maps Collection.

Use the IIIF Manifests on s3.lib as a starting point, but be sure to only include entries that validate. Also, be sure to add any fields that are required for valid manifest files. Files should live in Marklogic and be accessible by their unique identifier.

My overall goal for this repository is for it to consolidate several of the library's repos into one. The following repos may have code you can borrow or build from:

• pyiiif
• marc2iiif
• add_images_to_iiif_record
• batch_generate.iiif.manifests
• iiif_tools

JSON schemas for validation

This project includes JSON schemas for IIIF Collection and Manifest files. See if these schemas can be loaded into Marklogic and used to validate our documents. See the xdml:json-validate() function and Validating JSON Documents against JSON Schemas.

Add a prototype front end to make requests from Marklogic

Users will interact with a web application written in Python (using the Django or Wagtail framework.) This application will make HTTP requests to the Marklogic server, which will return IIIF Manifest and Collection files. Set up a prototype web application: it can be written as a Python script, or as curl commands, or whatever is simple and quick to write.

On the Marklogic side, look at ways to serve up documents. The documents service is one possibility, but there could be other ways to do this too- please take a look to be sure we're serving documents in a way that makes sense.

yellow.lib post python upgrade issues

See Peggy's email. I see that the python in the virtual environment currently points to the previous python version...try rebuilding the virtual env to see if that helps.

Get the most current version of the mockups to implement this in Wagtail.

The graphic designer and web program director are coordinating on getting mockups up to date. This includes documenting where data on the mockup comes from, to answer questions about the flexibility of the system for ad hoc requests.

Validate manifests

https://iiif.io/api/presentation/validator/service/

Add manifests for all social scientist maps, and test.

Please install vim on yellow.lib.

It would be handy to use vim on this server. Please let me know if it's ok to install vim here.

Write a script to produce IIIF Collection files.

Write a script to produce IIIF Collection files for the maps project. Use maps-full-list.json a starting point. Be sure the file validates.

Use the data from the Social Science Maps Collection to produce this file.

Add metadata to individual IIIF item in wagtail.

where should code live on s4?

Where should the code to build manifests live on s4? This code is command-line only, and doesn't need to be plugged into Apache via WSGI. Should it still be analogous to the code on servers like motacilla and retina?

/data/voldemort/venv3.6/
/data/voldemort/iiif_tools/

Where is the TIFF for G4104-C6-2N3-1927-U5?

These aren't currently in IIIF_Files.

Get started with MarkLogic and XQuery.

Marklogic is our preferred noSQL database. It's useful for the kind of work we do in the library, because it's optimized for XML and JSON documents that are very document centric (as opposed to data centric, or spreadsheet-like XML or JSON.)

XQuery is the query language we'll be working with in MarkLogic- in an XML database XQuery fills a similar role to what SQL fills in a relational database. José has a copy of the O'Reilly XQuery book in his hex, it's also available online.

José can get you up to speed with the work he has been doing to create IIIF Collection and IIIF Manifest files. Please set up a development version of MarkLogic on your workstation, and familiarize yourself with XQuery using the physical book or an online copy.

in manifests, service/@id includes "info.json"

Example:
https://iiif-manifest.lib.uchicago.edu/maps/chisoc/G4104-C6-1933-U5-a/G4104-C6-1933-U5-a.json

Using pyiiif, the service/@id for the image in this manifest is:

https://iiif-server.lib.uchicago.edu/maps/chisoc/G4104-C6-1933-U5-a/tifs/G4104-C6-1933-U5-a.tif/info.json

The viewer is not able to display this image, see:

https://iiif-viewer.lib.uchicago.edu/uv/uv.html#?manifest=https://iiif-manifest.lib.uchicago.edu/maps/chisoc/G4104-C6-1933-U5-a/G4104-C6-1933-U5-a.json

However, if I manually remove the "info.json" the viewer is able to display the image without any trouble. pyiiif currently includes the "info.json"- e.g.,

from pyiiif.pres_api.twodotone.records import ImageResource
i = ImageResource(
'https',
'iiif-server.lib.uchicago.edu',
'',
'maps/chisoc/G4104-C6-1933-U5-a/tifs/G4104-C6-1933-U5-a.tif',
'image/tiff'
)
i.get_service().id = 'https://iiif-server.lib.uchicago.edu/maps/chisoc/G4104-C6-1933-U5-a/tifs/G4104-C6-1933-U5-a.tif/info.json'

What's going on here?

Need space in MarkLogic for triples.

Asked Charles via Slack.