co-cddo/api-catalogue-analysis

API Catalogue Analysis

This is a small temporary application used to carry out some analysis of the API Catalogue's data

Data

• catalogue.csv comes from the api-catalogue app at /data
• JSON data in data/json comes from https://github.com/co-cddo/api-catalogue-data-source
• uk_cross_government_metadata_exchange_model.yaml and uk-gov-orgs.yaml define the metadate linkml structure. They come from the UK Cross-Government Metadata Exchange Model

Dependancy

Note that the gen-json-schema app is installed when you install the python utility linkml:

pip install linkml

linkml provides the validation tool used to validate the cross government metadata.

CSV file generation

To generate a set of CSV file that can be used to import API Catalogue data into the Data Marketplace MVP, use the rake task:

rake output:csv

The CSV files will be create at /tmp with file names of the format "csv_output_#{i}.csv". The content then needs to be copied into an ESDA template spreadsheet in the dataservice tab.