johnjung / iiif_tools Goto Github PK
View Code? Open in Web Editor NEWScripts to produce IIIF Collections and Manifest files.
License: GNU General Public License v3.0
Scripts to produce IIIF Collections and Manifest files.
License: GNU General Public License v3.0
The following identifiers exist in the social scientist maps collection:
G4104-C6-1933-U5-a
G4104-C6-1933-U5-b
G4104-C6-1933-U5-c
G4104-C6-1933-U5-d
G4104-C6-1933-U5-e
G4104-C6-1933-U5-f
G4104-C6-1933-U5-g
G4104-C6-1933-U5-h
G4104-C6-1933-U5-i
G4104-C6-1933-U5-j
G4104-C6-1933-U5-k
G4104-C6-1933-U5-l
G4104-C6-1933-U5-m
G4104-C6-1933-U5-o
G4104-C6-1933-U5-p
IIIF_Manifests contains data for the following identifier: G4104-C6-1933-U5. What is this?
If I try to install software on s4 with pip, I get error messages like the following:
pip install docopt
Collecting docopt (from -r requirements.txt (line 1))
Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.VerifiedHTTPSConnection object at 0x807cdb2e8>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/docopt/
...
Running pip install with the verbose flag shows me that I'm not able to download the following file: https://pypi.org/simple/docopt/
If I do "curl https://pypi.org/simple/docopt/" from s4, the command just hangs. But that same command from my local machine works fine. Can you tell what's going on here?
According to the issue loris-imageserver/loris#435,
I need to edit the following file:
/data/red/loris_fakeroot/var/www/loris2/loris2.wsgi
However, that file is currently owned by the user and group "loris". Is it possible for me to be able to edit these files, or should I request all edits through sys-admin?
from 3.5.0?
Is this an intermittent bug? I increased the MAX_IMAGE_PIXELS in transforms.py and img_info.py like this:
Image.MAX_IMAGE_PIXELS = 1000000000
Doing this prevented a server error while building manifests for the social scientists maps. However, after removing the line from the python files, re-installing and restarting Apache, I'm not able to get the initial error to appear again.
I'll keep track of this by leaving it here.
I'd like to rebuild the virtual environment that currently lives at /data/yellow/iiifcollectionbrowse/venv. Is it possible to give me permission to remove that directory and build a new one?
iiif-viewer.lib currently displays this error message. See the following URL:
Look at the IIIF website. Digirati's An Introduction to IIIF includes a lot of the reasoning behind certain choices in IIIF, and is also useful.
We'll need collection files and manifest files for our first project. For some example files, go to Owncloud and see the IIIF_Collections folder and the IIIF_Manifests folder.
Following that we'll need to set up the Content Search API for searchable OCR.
I'm not able to install Pillow on s4. Here's the command I'm using:
pip install --proxy http://[email protected]:8080 Pillow
And here is the error log that's generated:
The error log contains the following line: "The headers or library files could not be found for jpeg, a required dependency when compiling Pillow from source."
Do we need to install jpeg onto this machine via pkg before installing Pillow?
Write a script like mvol_manifest.py (e.g., "maps_manifest.py") that can create IIIF Manifest files for the Social Science Maps Collection.
Use the IIIF Manifests on s3.lib as a starting point, but be sure to only include entries that validate. Also, be sure to add any fields that are required for valid manifest files. Files should live in Marklogic and be accessible by their unique identifier.
My overall goal for this repository is for it to consolidate several of the library's repos into one. The following repos may have code you can borrow or build from:
This project includes JSON schemas for IIIF Collection and Manifest files. See if these schemas can be loaded into Marklogic and used to validate our documents. See the xdml:json-validate() function and Validating JSON Documents against JSON Schemas.
Users will interact with a web application written in Python (using the Django or Wagtail framework.) This application will make HTTP requests to the Marklogic server, which will return IIIF Manifest and Collection files. Set up a prototype web application: it can be written as a Python script, or as curl commands, or whatever is simple and quick to write.
On the Marklogic side, look at ways to serve up documents. The documents service is one possibility, but there could be other ways to do this too- please take a look to be sure we're serving documents in a way that makes sense.
See Peggy's email. I see that the python in the virtual environment currently points to the previous python version...try rebuilding the virtual env to see if that helps.
The graphic designer and web program director are coordinating on getting mockups up to date. This includes documenting where data on the mockup comes from, to answer questions about the flexibility of the system for ad hoc requests.
It would be handy to use vim on this server. Please let me know if it's ok to install vim here.
Write a script to produce IIIF Collection files for the maps project. Use maps-full-list.json a starting point. Be sure the file validates.
Use the data from the Social Science Maps Collection to produce this file.
Where should the code to build manifests live on s4? This code is command-line only, and doesn't need to be plugged into Apache via WSGI. Should it still be analogous to the code on servers like motacilla and retina?
/data/voldemort/venv3.6/
/data/voldemort/iiif_tools/
These aren't currently in IIIF_Files.
Marklogic is our preferred noSQL database. It's useful for the kind of work we do in the library, because it's optimized for XML and JSON documents that are very document centric (as opposed to data centric, or spreadsheet-like XML or JSON.)
XQuery is the query language we'll be working with in MarkLogic- in an XML database XQuery fills a similar role to what SQL fills in a relational database. José has a copy of the O'Reilly XQuery book in his hex, it's also available online.
José can get you up to speed with the work he has been doing to create IIIF Collection and IIIF Manifest files. Please set up a development version of MarkLogic on your workstation, and familiarize yourself with XQuery using the physical book or an online copy.
Example:
https://iiif-manifest.lib.uchicago.edu/maps/chisoc/G4104-C6-1933-U5-a/G4104-C6-1933-U5-a.json
Using pyiiif, the service/@id for the image in this manifest is:
The viewer is not able to display this image, see:
However, if I manually remove the "info.json" the viewer is able to display the image without any trouble. pyiiif currently includes the "info.json"- e.g.,
from pyiiif.pres_api.twodotone.records import ImageResource
i = ImageResource(
'https',
'iiif-server.lib.uchicago.edu',
'',
'maps/chisoc/G4104-C6-1933-U5-a/tifs/G4104-C6-1933-U5-a.tif',
'image/tiff'
)
i.get_service().id = 'https://iiif-server.lib.uchicago.edu/maps/chisoc/G4104-C6-1933-U5-a/tifs/G4104-C6-1933-U5-a.tif/info.json'
What's going on here?
Asked Charles via Slack.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.