daniellecrobinson / data-rescue-pdx Goto Github PK

Volunteer guide, and other materials for DATA RESCUE PDX

data-rescue-pdx's Introduction

Hey! This is where I am playing around with Enoki to make a personal site. This site is based on Enoki / Jacinto.

I've moved away from panel.enoki and I'm just editing my files locally.

The first thing I wanted to do was remove the date stamps from the blog. It didn't make sense for me to have dated posts, but when I deleted them the website wasn't happy. I asked for help to figure out where dates were required and deleted a line from entry.js <li>${date}</li> I also needed to add a .datignore file as the earlier enoki I was playign with didnt have one.

From Enoki:

Includes Choo as a front-end framework, and Sheetify for css-in-js

Customization

If you created your site from the Enoki Panel, cd to the source directory and run npm install. Once the dependencies are installed, run npm start for development and npm run build for bundling.

To stay up to date, clone the repository and git pull origin master changes.

data-rescue-pdx's People

Contributors

Stargazers

Watchers

Forkers

nikeshbalami jwmeyerson rchampieux elinnyman tracyedinger tehsmith

data-rescue-pdx's Issues

https://www.nifc.gov/fireInfo/fireInfo_statistics.html

Climate Mirror dataset title:

Climate Mirror issue: climate-mirror/datasets#23

Link to datafile: e.g.

Agency: National Interagency Coordination Center

Agency Division: National Interagency Fire Center

Agency Subdivision:

Agency Sub-Subdivision:

Bulk Download Link: https://www.nifc.gov/fireInfo/fireInfo_statistics.html

Size Estimate:

Data Type: "Mission is to serve as a focal point for coordinating the national mobilization of resources for wildland fire and other incidents throughout the United States." - NIFC website

Other URLS: Most of this data seems to come from the Fire and Aviation Management Web Applications Program https://fam.nwcg.gov/fam-web/

JSON:

{
	"name": "",
	"title": "",
	"maintainer": "",
	"maintainer_email": "",
	"id": "",
	"metadata_created": "",
	"metadata_modified": "",
	"author": null,
	"author_email": null,
	"type": "dataset",
	"notes": "",
	"license_id": "",
	"organization": {
		"description": "",
		"created": "",
		"title": "National Interagency Coordination Center",
		"name": "",
		"is_organization": true,
		"image_url": "",
		"type": "organization",
		"id": ""
	},
	"resources": [{
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: SuppCosts.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "Suppression Costs",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_documents/SuppCosts.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: fireInfo_stats_histSigFires.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Historically significant wildland fires",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_stats_histSigFires.html"
	}, {
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: fireInfo_stats_lgFires.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "1997-2014 large fires",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_stats_lgFires.html"
	}, {
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: fireInfo_stats_human.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Human-caused fires and acres",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_stats_human.html"
	}, {
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: fireInfo_stats_lightng.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Lightning-caused fires and acres",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_stats_lightng.html"
	}, {
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: fireInfo_stats_prescribed.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Prescribed fires",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_stats_prescribed.html"
	}, {
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: fireInfo_stats_totalFires.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland fires and acres",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_stats_totalFires.html"
	}, {
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: fireInfo_stats_fireUse.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland fire use fires",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_stats_fireUse.html"
	}, {
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: SuppCosts.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "Suppression Costs",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_documents/SuppCosts.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: fireInfo_stats_histSigFires.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Historically significant wildland fires",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_stats_histSigFires.html"
	}, {
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: fireInfo_stats_lgFires.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "1997-2014 large fires",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_stats_lgFires.html"
	}, {
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: fireInfo_stats_human.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Human-caused fires and acres",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_stats_human.html"
	}, {
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: fireInfo_stats_lightng.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Lightning-caused fires and acres",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_stats_lightng.html"
	}, {
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: fireInfo_stats_prescribed.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Prescribed fires",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_stats_prescribed.html"
	}, {
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: fireInfo_stats_totalFires.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland fires and acres",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_stats_totalFires.html"
	}, {
		"created": "",
		"describedBy": "https://www.nifc.gov",
		"description": "Historical Wildland Fire Information: fireInfo_stats_fireUse.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland fire use fires",
		"url": "https://www.nifc.gov/fireInfo/fireInfo_stats_fireUse.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "fires_acres15.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "National Report of Wildland Fires and Acres Burned by State",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2015_Statssumm/fires_acres15.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "fires_acres14.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "National Report of Wildland Fires and Acres Burned by State",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2014_Statssumm/fires_acres14.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "fires_acres13.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "National Report of Wildland Fires and Acres Burned by State",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2013_Statssumm/fires_acres13.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "fires_acres.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "National Report of Wildland Fires and Acres Burned by State",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2012_statssumm/fires_acres.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "fires_acres.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "National Report of Wildland Fires and Acres Burned by State",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2011_statssumm/fires_acres.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "fires_acres.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "National Report of Wildland Fires and Acres Burned by State",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2010_statssumm/fires_acres.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "fires_acres.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "National Report of Wildland Fires and Acres Burned by State",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2009_statssumm/fires_acres.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "fires_acres.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "National Report of Wildland Fires and Acres Burned by State",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2008_statssumm/fires_acres.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "fires_acres.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "National Report of Wildland Fires and Acres Burned by State",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2007_statssumm/fires_acres.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "fires_acres.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "National Report of Wildland Fires and Acres Burned by State",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2006_statssumm/fires_acres.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "fires_acres.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "National Report of Wildland Fires and Acres Burned by State",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2005_statssumm/fires_acres.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "fires_acres.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "National Report of Wildland Fires and Acres Burned by State",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2004_statssumm/fires_acres.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "fires_acres.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "National Report of Wildland Fires and Acres Burned by State",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2003_statssumm/fires_acres.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "fires_acres.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "National Report of Wildland Fires and Acres Burned by State",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2002_statssumm/fires_acres.pdf"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2013Stats&Summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2013_Statssumm/2013Stats&Summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2015Stats&Summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2015_Statssumm/2015Stats&Summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2014Stats&Summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2014_Statssumm/2014Stats&Summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2013Stats&Summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2013_Statssumm/2013Stats&Summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2012Stats&Summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2012_statssumm/2012Stats&Summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2011Stats&Summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2011_statssumm/2011Stats&Summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2010Stats&Summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2010_statssumm/2010Stats&Summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2009Stats&Summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2009_statssumm/2009Stats&Summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2008Stats&Summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2008_statssumm/2008Stats&Summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2007Stats&Summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2007_statssumm/2007Stats&Summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2006Stats&Summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2006_statssumm/2006Stats&Summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2005Stats&Summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2005_statssumm/2005Stats&Summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2004Stats&Summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2004_statssumm/2004Stats&Summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2003Stats&Summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2003_statssumm/2003Stats&Summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2002stats&summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2002_statssumm/2002stats&summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "2001stats&summ.html",
		"format": "HTML",
		"hash": "",
		"mimetype": "text/html",
		"name": "Wildland Fire Summaries",
		"url": "http://www.predictiveservices.nifc.gov/intelligence/2001_stats_summ/2001stats&summ.html"
	}, {
		"created": "",
		"describedBy": "https://www.predictiveservices.nifc.gov",
		"description": "yearendreport2000.pdf",
		"format": "PDF",
		"hash": "",
		"mimetype": "application/pdf",
		"name": "National Report of Wildland Fires and Acres Burned by State",
		"url": "fireInfo_documents/yearendreport2000.pdf"
	}]
}

Issue #10 - CarbonTracker 2007

Climate Mirror dataset title:

CarbonTracker

Climate Mirror issue:

climate-mirror/datasets#10

Link to datafile:

ftp://ftp.cdc.noaa.gov/Datasets/CarbonTracker/

Agency:

National Oceanic & Atmospheric Administration (NOAA)

Agency Division:

NOAA Research

Agency Subdivision:

U.S. Department of Commerce

Agency Sub-Subdivision:

Earth System Research Laboratory (ESRL)

Bulk Download Link:

ftp://ftp.cdc.noaa.gov/Datasets/CarbonTracker/CT2007B.molefrac.nc

Size Estimate:

925 M

Data Type:
A Subset of the GMD Carbontracker Dataset. This is the CarbonTracker CT2007B release.
CarbonTracker is a CO2 measurement and modeling system developed by NOAA to keep track of sources (emissions to the atmosphere) and sinks (removal from the atmosphere) of carbon dioxide around the world. CarbonTracker uses atmospheric CO2 observations from a host of collaborators and simulated atmospheric transport to estimate these surface fluxes of CO2. The current release of CarbonTracker, CT2015, provides global estimates of surface-atmosphere fluxes of CO2 from January 2000 through December 2014.

Other URLS:
https://catalog.data.gov/dataset/carbontracker-ct2007b-release

JSON:

{
  "name": "carbontracker",
  "title": "Carbontracker",
  "maintainer": "",
  "maintainer_email": "",
  "id": "",
  "metadata_created": "2017-02-03",
  "metadata_modified": "2017-02-03",
  "author": "NOAA/ESRL GMD",
  "author_email": "[email protected]",
  "type": "dataset",
  "notes": "CarbonTracker is an open product of the NOAA Earth System Research Laboratory using data from the Global Monitoring Division greenhouse gas observational network and collaborating institutions. Results including data, figures and tabular material found on the CarbonTracker website may be used for non-commercial purposes without restriction but we request that the following acknowledgement text be included in documents or publications made using CarbonTracker results: CarbonTracker results provided by NOAA/ESRL",
  "license_id": "",
  "organization": {
    "description": "",
    "created": "2013-05-18T11:31:11.529883",
    "title": "NOAA Earth System Research Laboratory",
    "name": null,
    "is_organization": true,
    "image_url": "",
    "type": "organization",
    "id": "ff9ae098-eccc-41d8-bfcd-5e8ed047db05"
  },
  "resources": [
    {
      "url": "ftp://ftp.cdc.noaa.gov/Datasets/CarbonTracker/CT2007B.molefrac.nc",
      "describedBy": "https://www.esrl.noaa.gov/psd/data/gridded/data.carbontracker.html",
      "hash": "",
      "description": "CT2007B.molefrac.nc",
      "format": "NC",
      "mimetype": "application/netcdf",
      "name": "CO2 Mole Fraction",
      "created": "2016-04-16"
    }
  ]
}

https://www.northwestknowledge.net/metdata/data/

Climate Mirror dataset title: Historical METDATA/gridMET

Climate Mirror issue: http://climate.nkn.uidaho.edu/METDATA/

Link to datafile: https://www.northwestknowledge.net/metdata/data/

Agency: University of Idaho

Agency Division: Gridded Surface Meteorological Data

Agency Subdivision:

Agency Sub-Subdivision:

Bulk Download Link: https://www.northwestknowledge.net/metdata/data/

Size Estimate: 700 GB

Data Type: "a spatially and temporally complete, high-resolution (1/24th degree ~4-km) gridded dataset of surface meteorological variables required in modeling for the coterminous United States from 1979-present. " from http://climate.nkn.uidaho.edu/METDATA/

Other URLS:
https://catalog.data.gov/dataset/university-of-idaho-daily-meteorological-data-for-continental-us
xml metadata: https://catalog.data.gov/harvest/object/46bbf357-30a7-45ad-a460-71a6672423cc

JSON:

{
  "name": "UofI METDATA",
  "title": "UofI Gridded Surface Meteorological Dataset",
  "maintainer": "Dr. John Abatzoglou, University of Idaho",
  "maintainer_email": "[email protected]",
  "id": "",
  "metadata_created": "",
  "metadata_modified": "",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "notes": "Landscape-scale modeling has been hindered by suitable high-resolution surface meteorological datasets that include temperature, precipitation, downward shortwave radiation, humidity and winds. To overcome these limitations, desirable spatial attributes of gridded climate data from PRISM are combined with desirable temporal attributes of regional-scale reanalysis and daily gauge-based precipitation from NLDAS-2 to derive a spatially and temporally complete, high-resolution (1/24th degree ~4-km) gridded dataset of surface meteorological variables required in modeling for the coterminous United States from 1979-present.",
  "license_id": "",
  "organization": {
    "description": "",
    "created": "",
    "title": "University of Idaho",
    "name": "uidaho.edu",
    "is_organization": true,
    "image_url": "",
    "type": "organization",
    "id": ""
  },
  "resources": [
    {
      "url": "http://www.pbm.va.gov/PBM/nationalformulary/VA_National_Formulary_October_2016.xls",
      "describedBy": "http://www.pbm.va.gov/nationalformulary.asp",
      "hash": "",
      "description": "",
      "format": "netCDF",
      "mimetype": "application/x-netcdf",
      "name": "",
      "created": "UofI Gridded Surface Meteorological Dataset"
    }
  ]
}

GAGES-II: Geospatial Attributes of Gages for Evaluating Streamflow

{
	"title": "GAGES-II: Geospatial Attributes of Gages for Evaluating Streamflow",
	"maintainer": "null",
	"maintainer_email": "null",
	"author": "James Falcone",
	"author_email": "[email protected]",
	"notes": "The data posted here consist of the following items:- This point shapefile, with summary data for the 9,322 gages.- A zip file containing basin characteristics, variable definitions, and a more detailed report.- A zip file containing shapefiles of basin boundaries, organized by classification and aggregated ecoregion.- A zip file containing mainstem stream lines (Arc line coverages) for each gage. This dataset, termed GAGES II, an acronym for Geospatial Attributes of Gages for Evaluating Streamflow, version II, provides geospatial data and classifications for 9,322 stream gages maintained by the U.S. Geological Survey (USGS). It is an update to the original GAGES, which was published as a Data Paper on the journal Ecology's website (Falcone and others, 2010b) in 2010. The GAGES II dataset consists of gages which have had either 20+ complete years (not necessarily continuous) of discharge record since 1950, or are currently active, as of water year 2009, and whose watersheds lie within the United States, including Alaska, Hawaii, and Puerto Rico. Reference gages were identified based on indicators that they were the least-disturbed watersheds within the framework of broad regions, based on 12 major ecoregions across the United States. Of the 9,322 total sites, 2,057 are classified as reference, and 7,265 as non-reference. Of the 2,057 reference sites, 1,633 have (through 2009) 20+ years of record since 1950. Some sites have very long flow records: a number of gages have been in continuous service since 1900 (at least), and have 110 years of complete record (1900-2009) to date. The geospatial data include several hundred watershed characteristics compiled from national data sources, including environmental features (e.g. climate – including historical precipitation, geology, soils, topography) and anthropogenic influences (e.g. land use, road density, presence of dams, canals, or power plants). The dataset also includes comments from local USGS Water Science Centers, based on Annual Data Reports, pertinent to hydrologic modifications and influences. The data posted also include watershed boundaries in GIS format.For information links, see https://water.usgs.gov/GIS/metadata/usgswrd/XML/gagesII_Sept2011.xml#Metadata_Reference_Information",
	"landingPage": "https://water.usgs.gov/GIS/metadata/usgswrd/XML/gagesII_Sept2011.xml",
	"id": "5D891958-B437-4068-AFBB-34EC7B509635",
	"date": "2011-10-12",
	"isPartOf": "USGS Surface-Water Data for the Nation",
	"tags": "USGS",
	"organization": {
		"description": "",
		"title": "U.S. Geological Survey",
		"name": "water.usgs.gov",
		"is_organization": true,
		"image_url": "https://water.usgs.gov/GIS/browse/gagesII.jpg",
		"type": "organization"
	}
}

Metadata collection feedback

Would it be feasible to create an intake form that fills a google sheet or something like that to more quickly and easily get data in a normalized format? I think individual rows could be fairly easily piped out into JSON metadata files from there.

A05F7CEB-6CCE-4DC8-9D5F-4A29DFE053E0

Replace the information in this Issue Template with the information for the dataset you are working with, and add a JSON file at the end. Example values and an example JSON file are shown, leave blank spaces if you can not find the information for your dataset.
When adding your JSON file, leave the { } structure, as this denotes a block of code.

JSON:
(example)
If you don't know a value, leave it blank. Check your JSON for errors with JSONlint

{
	"title": "NEPAssist",
	"maintainer": "EPA",
	"maintainer_email": "[email protected]",
	"author": null,
	"author_email": null,
	"notes": "This URL contains information about two GIS tools that use underlying EPA datasets to provide maps with vast layers of information, anything from locations of schools, churches, and parks to soil types and superfund sites. The main subject of the webpage describes the NEPAssist tool. The other tool is called EJScreen. Both tools appear to use the same underlying data located here: ftp://newftp.epa.gov/EJSCREEN/. The web page also contains a user manual and a description of layers available.",
	"license_id": "",
	"landingPage": "https://www.epa.gov/nepa/nepassist",
	"id": "A05F7CEB-6CCE-4DC8-9D5F-4A29DFE053E0",
	"doi": "",
	"isPartOf": "",
	"tags": "EPA",
	"organization": {
		"description": "",
		"title": "Environmental Protection Agency",
		"name": "EPA",
		"is_organization": true,
		"image_url": "",
		"type": "organization",
		"id": ""
	}
}

nepassist.txt

https://www.nodc.noaa.gov/OC5/WOD/pr_wod.html (World Ocean Database)

Climate Mirror dataset title: NODC

Climate Mirror issue: climate-mirror/datasets#122

Link to datafile: https://archive.org/details/d34cf1ef-2cb7-4844-b98b-06203ced9cf8

Agency: National Oceanic & Atmospheric Administration (NOAA)

Agency Division: National Centers for Environmental Information (NCEI)

Agency Subdivision: Ocean Climate Laboratory

Agency Sub-Subdivision:

Bulk Download Link: ftp.nodc.noaa.gov

Size Estimate:

Data Type: dataset

Other URLS: https://www.nodc.noaa.gov/OC5/WOD/pr_wod.html
https://catalog.data.gov/dataset/world-ocean-database-2013-nodc-accession-0117075
https://www.nodc.noaa.gov/OC5/WOD/readwod.html

NOAA Buoy Station 01503 - Saul - 4801503

JSON:
(example)
If you don't know a value, leave it blank. Check your JSON for errors with JSONlint

{
   "title": "National Buoy Centre - Station 01503",
   "author": "Woods Hole Oceanographic Institute - Upper Ocean Processes Group",
   "author e-mail": "",
   "maintainer": "NOAA - National Buoy Centre",
   "maintainer e-mail": “[email protected]",
   "notes": "this is a collection of temperature and salinity readings at various depths
from a buoy off the coast of Martha’s Vineyard"
   "organization": {
      "description": ""
      }
   }

{
  "title": "VA National Formulary",
  "maintainer": "Don Lees",
  "maintainer_email": "[email protected]",
  "author": null,
  "author_email": null,
  "notes": "The VA National Formulary is a listing of products (drugs and supplies) that must be available for prescription at all VA facilities, and cannot be made non-formulary by a Veteran Integrated Service Network (VISN) or individual medical center. Regarding chemical or biological entities that by law must be submitted to the United States (U.S.) Food and Drug Administration (FDA) for pre-marketing approval, only those entities that actually have been approved by FDA using New Drug Application (NDA), Abbreviated New Drug Application (ANDA), or biologics license, may be added to the VA National Formulary.",
  "license_id": "cc-zero",
  "landingPage": "URL for landing page goes here ",
  "id": "ff9ae098-eccc-41d8-bfcd-5e8ed047db05",
  "doi":"publication or data doi",
  "isPartOf": "larger project?",
  "tags": "FDA",
  "organization": {
    "description": "",
    "title": "Department of Veterans Affairs",
    "name": "va-gov",
    "is_organization": true,
    "image_url": "https://raw.githubusercontent.com/GSA/logo/master/va.png",
    "type": "organization",
    "id": "",
    
  },
}

8B9437BC-1882-4C85-ACA6-96C9CC9F1583.json

{
	"name": "cafo_per_county2013",
	"title": "Concentrated Animal Feeding Operations (CAFOs) per County Downloadable Package",
	"maintainer": "Kimberly Chavez",
	"maintainer_email": "[email protected]",
	"id": "8B9437BC-1882-4C85-ACA6-96C9CC9F1583.json",
	"metadata_created": "2015-11-15",
	"metadata_modified": "2016-03-31",
	"author": "Kimberly Chavez",
	"author_email": "[email protected]",
	"type": "shp,xml",
	"notes": "Concentrated Animal Feeding Operations (CAFOs) by US county for 2013, collected by the EPA’s Office of Water. The dataset is a shapefile, Esri map, and related XML data.",
	"license_id": "",
	"landingPage": "https://catalog.data.gov/dataset concentrated-animal-feeding-operations-cafos-per-county-downloadable-package-us-2013-us-epa",
	"organization": {
		"description": "",
		"created": "2013-05-18T11:31:11.529883",
		"title": "Environmental Protection Agency",
		"name": "edg.epa.gov",
		"is_organization": true,
		"image_url": "https://edg.epa.gov/EPALogo.svg",
		"type": "organization",
		"id": ""
	}
}

NOAA ESRL GMD Radiation #311

Climate Mirror dataset title: e.g. NOAA ESRL GMD Radiation

Climate Mirror issue: e.g. climate-mirror/datasets#311

Link to datafile: e.g. ftp://aftp.cmdl.noaa.gov/data/radiation/

Agency: e.g. National Oceanic & Atmospheric Administration (NOAA)

Agency Division: e.g. Oceanic and Atmospheric Research (OAR)

Agency Subdivision: e.g. Earth System Research Laboratory (ESRL)

Agency Sub-Subdivision: e.g.Global Monitoring Division (GMD)

Bulk Download Link: e.g. ftp://aftp.cmdl.noaa.gov/data/radiation/

Size Estimate: e.g. 196G

Data Type: e.g. "G-Rad is involved in observational and theoretical research of the Earth's surface and atmospheric radiation budgets. The group specializes in the investigation of climatically significant variations in long-term radiation and meteorological measurements made at diverse globally-remote sites and continental US sites (SURFRAD)." - GMD Radiation website

Other URLS:

JSON:
(example)
If you don't know a value, leave it blank. Check your JSON for errors with JSONlint

{
	"name": "National Oceanic & Atmospheric Administration (NOAA)",
	"title": " National Oceanic & Atmospheric Administration (NOAA)",
	"metadata_created": "2017-02-03",
	"metadata_modified": "",
	"type": "dataset",
	"notes": "Agency Division Oceanic and Atmospheric Research (OAR)\n Agency Subdivision Earth System Research Laboratory(ESRL)\n Agency Sub - Subdivision Global Monitoring Division(GMD)\n\tBulk Download Link: ftp: //aftp.cmdl.noaa.gov/data/radiation/\n nine folders of data set\n Size Estimate: 196 G ",
	"organization": {
		"description": "",
		"created": "2017-02-03",
		"title": "NOAA",
		"name": "NOAA",
		"is_organization": true,
		"image_url": "ftp://aftp.cmdl.noaa.gov/data/radiation/",
		"type": "organization"

	},
	"resources": [{
		"url": "ftp://aftp.cmdl.noaa.gov/data/radiation/",
		"describedBy": "https://www.esrl.noaa.gov/gmd/grad/surfrad/pick.html",
		"hash": "",
		"description": "NOAA radation",
		"format": "XLS",
		"mimetype": "",
		"name": "NOAA",
		"created": "2017-02-03"
	}]
}

Issue #220 (subset): Aura Ozone data

Climate Mirror dataset title: NASA GSFC Ozone Monitoring Data #220

Climate Mirror issue: e.g. climate-mirror/datasets#220

Link to datafiles: ftp://toms.gsfc.nasa.gov/pub/omi/data/ozone/

Agency: NASA

Agency Division:

Agency Subdivision:

Agency Sub-Subdivision:

Bulk Download Link: e.g. ftp://toms.gsfc.nasa.gov/pub/omi/data/ozone/

Size Estimate:

Data Type: Daily gridded (L3), ASCII files from year yyyy, month MM and day DD.
The data in these ASCII files are in the format used for the Nimbus-7
and Earth Probe CD-ROM. Details of this format are explained in the
EarthProbe Data Products User's Guide, EARTHPROBE_USERGUIDE.PDF,
available in the parent directory (pub/eptoms).

 The values are in 3 digit groups 111222333444555
 Sample ozone value:    234 = 234 du             0 = fill value

Other URLS: https://mirrors.asun.co/climate-mirror/toms.gsfc.nasa.gov/pub/omi/data/ozone

JSON:

{
  "name": "Ozone Monitoring Instrument (OMI) / AURA level 3e Ozone data",
  "title": "Ozone Monitoring Instrument (OMI) / AURA",
  "maintainer": "Dr. Richard D. McPeters",
  "maintainer_email": "[email protected]",
  "id": "",
  "metadata_created": "2017-02-03T00:00:00.228971",
  "metadata_modified": "2017-02-03T00:00:00.228971",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "description": "\n     Daily gridded (L3), ASCII files from year yyyy, month MM and day DD.\n     The data in these ASCII files are in the format used for the Nimbus-7\n     and Earth Probe CD-ROM. Details of this format are explained in the\n     EarthProbe Data Products User's Guide, EARTHPROBE_USERGUIDE.PDF,\n     available in the parent directory (pub/eptoms).",
  "notes":  " data source is ftp://toms.gsfc.nasa.gov/pub/omi/data/Level3e/ozone/ The following was copied from some similar-looking metadata for a differentlfy formatted dataset from the same probe source URL https://catalog.data.gov/dataset/omi-aura-ozone-o3-total-column-1-orbit-l2-swath-13x24-km-v003-nrt \n\ncopypaste follows The OMI/Aura Level-2 Total Column Ozone Data Product OMTO3 Near Real Time data is made available from the OMI SIPS NASA  for the public access.  The Ozone Monitoring Instrument (OMI)was launched aboard the EOS-Aura satellite on July 15, 2004(1:38 pm equator crossing time, ascending mode). OMI with its 2600 km viewing swath width provides almost daily global coverage. OMI is a contribution of the Netherlands Agency for Aerospace Programs (NIVR)in collaboration with Finish Meterological Institute (FMI), to the US EOS-Aura Mission. The principal investigator's (Dr. Pieternel Levelt) institute is the KNMI (Royal Netherlands Meteorological Institute). OMI is designed to monitor stratospheric and tropospheric ozone, clouds, aerosols and smoke from biomass burning, SO2 from volcanic eruptions, and key tropospheric pollutants (HCHO, NO2) and ozone depleting gases (OClO and BrO). OMI sensor counts, calibrated and geolocated radiances, and all derived geophysical atmospheric products will be archived at the NASA Goddard DAAC. This level-2 global total column ozone product (OMTO3)is based on the enhanced TOMS version-8 algorithm that  essentially uses the ultraviolet radiance data at 317.5 and 331.2 nm. OMI additional hyper-spectral measurements help in the corrections for the factors that induce uncertainty in ozone retrieval (e.g., cloud and aerosol, sea-glint effects, profile shape sensitivity, SO2 and other trace gas contamination). In addition to the total ozone values this product also contains some auxiliary derived and ancillary input parameters including N-values, effective Lambertian scene-reflectivity, UV aerosol index, SO2 index, cloud fraction, cloud pressure, ozone below clouds, terrain height, geolocation, solar and satellite viewing angles, and extensive quality flags. The shortname for this Level-2 OMI total column ozone product is OMTO3 and the algorithm lead for this product is NASA OMI scientist  Dr. Pawan K. Bhartia ( [email protected]). OMTO3 files are stored in EOS Hierarchical Data Format (HDF-EOS5). Each file contains data from the day lit portion of an orbit (~53 minutes). There are approximately 14 orbits per day. The maximum file size for the OMTO3 data product is about 35 Mbytes. A list of tools for browsing and extracting data from these files can be found at: http://disc.gsfc.nasa.gov/Aura/tools.shtml For more information on Ozone Monitoring Instrument and atmospheric data products, please visit the OMI-Aura sites: http://aura.gsfc.nasa.gov/  http://www.knmi.nl/omi/research/documents/ .        Data Category Parameters: The OMTO3 data file contains one swath which consists of two groups: Data fields: OMI Total Ozone,Effective Reflectivity (331 - 360 nm), N-value, Cloud Fraction, Cloud Top Pressure, O3 below Cloud, UV Aerosol Index, SO2 index, Wavelength used in the algorithm, many Auxiliary Algorithm Parameter and Quality Flags Geolocation Fields: Latitude, Longitude, Time, Relative Azimuth, Solar Zenith and Azimuth, Viewing Zenith and Azimuth angles, Spacecraft Altitude, Latitude, Longitude, Terrain Height, Ground Pixel Quality Flags.For the full set of Aura data products available from the GES DISC, please see the link http://disc.sci.gsfc.nasa.gov/Aura/ .",
  "license": "http://www.usa.gov/publicdomain/label/1.0/",
  "modified": "2014-06-11T11:36:24Z",
  "programCode": [
    "026:001"
  ],
  "publisher": {
    "@type": "org:Organization",
    "name": "National Aeronautics and Space Administration"
  },
  "organization": {
    "description": "",
    "created": "",
    "title": "NASA",
    "name": "National Aeronautics and Space Administration",
    "is_organization": true,
    "image_url": "https://www.nasa.gov/sites/all/themes/custom/nasatwo/images/nasa-logo.svg",
    "type": "organization",
    "id": ""
  },
  "resources": []
}

NOAA ESRL GMD Global Greenhouse Gas Reference Network: FFCO2 ODIAC data 2000-2016

Climate Mirror dataset title: NOAA ESRL GMD Global Greenhouse Gas Reference Network

Climate Mirror issue: climate-mirror/datasets#305

Link to datafile: ftp://ftp.cmdl.noaa.gov/data/ccgg/ODIAC/2016/distrib/

Agency: National Oceanic & Atmospheric Administration (NOAA)

Agency Division: Oceanic and Atmospheric Research (OAR)

Agency Subdivision: Earth System Research Laboratory (ESRL)

Agency Sub-Subdivision: Global Monitoring Division (GMD)

Alternate name: Carbon Cycle Greenhouse Gas group

Bulk Download Link: ftp://ftp.cmdl.noaa.gov/data/ccgg/ODIAC/2016/distrib/

Size Estimate: TBA

Data Type: "The Global Greenhouse Gas Reference Network measures the atmospheric distribution and trends of the three main long-term drivers of climate change, carbon dioxide (CO2), methane (CH4), and nitrous oxide (N2O), as well as carbon monoxide (CO) which is an important indicator of air pollution" - GMD CCGG website. This data was generated by The Open Data Inventory for Anthropogenic Carbon dioxide (ODIAC)version 2016 (ODIAC2016: 2000-2015). Files are organized in the following format: ftp.cmdl.noaa.gov/data/ccgg/ODIAC/2016/distrib/YEAR/MONTH/fossil_fuel_1x1_YYYYMMDD.ch

JSON:

{
  "name": "esrl-global-monitoring-division-ffco2-odiac-2000-2016",
  "title": "ESRL Global Monitoring Division FFC02 Emission ODIAC data 2000-2016",
  "url": "ftp://ftp.cmdl.noaa.gov/data/ccgg/ODIAC/2016/distrib/",
  "maintainer": "Sourish Basu, Cooperative Institute for Research in Enivronmental Science/NOAA Earth System Research Laboratory",
  "maintainer_email": "[email protected]",
  "id": "",
  "metadata_created": "2017-02-03 T00:00:00:00",
  "metadata_modified": "2017-02-03 T00:00:00:00",
  "author": null,
  "author_email": null,
  "type": "",
  "notes": "FOSSIL FUEL CO2 EMISSIONS GENERATED FOR THE OCO-2 FLUX INVERSION INTERCOMPARISON. This data was generated by The Open Data Inventory for Anthropogenic Carbon dioxide (ODIAC)version 2016 (ODIAC2016: 2000-2015). Files are organized in the following format: ftp.cmdl.noaa.gov/data/ccgg/ODIAC/2016/distrib/YEAR/MONTH/fossil_fuel_1x1_YYYYMMDD.ch",
  "license_id": "",
  "organization": {
    "description": "NOAA",
    "created": "2016-10-12",
    "title": "National Oceanic and Atmospheric Administration",
    "name": "noaa-gov",
    "is_organization": true,
    "image_url": "",
    "type": "organization",
    "id": ""
  }

}

a89e1c3d-30f5-434b-bd2f-712446c68e15.json

{
"Title": "Surveys, report and a video from the 2013 Satellite Conference of National Oceanic and Atmospheric Administration",
"Individual source or seed URL": "http://satelliteconferences.noaa.gov/2013/",
"UUID": "a89e1c3d-30f5-434b-bd2f-712446c68e15",
"Institution facilitating the data capture creation and packaging": "DataRescueDavis",
"Date of capture": "2017-02-02",
"Federal agency data acquired from": "National Oceanic and Atmospheric Administration",
"Email adress": "[email protected]",
"Name of resource": "2013 Satellite Conference",
"File formats contained in package": ".pdf, .jpg, .html, .mp4",
"Types of content in package": "surveys, conference report, video",
"Notes": "Metadata was generated by viewing page, data was scraped with a custom script; the video was downloaded by hand",
"Name of package creator": "Rachel Baarda"
}

4C5E0572-8564-4C24-8F37-1D0B1E3D01D7

JSON:
(example)
If you don't know a value, leave it blank. Check your JSON for errors with JSONlint

{
  "title": "Employee Contact Information United States Geological Survey",
  "maintainer": "",
  "maintainer_email": "",
  "author": null,
  "author_email": null,
  "notes": "The US Department of the Interior US Geological Survey Employee Phonebook.Searchable by name, email, and username",
  "license_id": "",
  "landingPage": "https://www2.usgs.gov/phonebook/employee/",
  "id": "4C5E0572-8564-4C24-8F37-1D0B1E3D01D7",
  "doi":"",
  "isPartOf": "US Geological Survey Employee Info",
  "tags": "USGS",
  "organization": {
    "description": "Department of Interior US Geological Survey Employee Phonebook",
    "title": "Department of the Interior Geological Survey",
    "name": "USGS",
    "is_organization": true,
    "image_url": "",
    "type": "organization",
    "id": "DOI USGS"
  }
}

CDDIS Laser Ranging (SLR and LLR) Data Archive

Climate Mirror dataset title: Dataset at ftp:/cddis.gsfc.nasa.gov/slr/data

Climate Mirror issue: e.g. climate-mirror/datasets#150

Link to datafile: ftp:/cddis.gsfc.nasa.gov/slr/data

Agency: NASA

Agency Division: Crustal Dynamics Data Information System

Agency Subdivision:

Agency Sub-Subdivision:

Bulk Download Link: ftp:/cddis.gsfc.nasa.gov/slr/data

Size Estimate: 171 GB

Data Type: "In Satellite Laser Ranging (SLR), a short pulse of coherent light generated by a laser (Light Amplification by Stimulated Emission of Radiation) is transmitted in a narrow beam to illuminate corner cube retroreflectors on the satellite. The return signal, typically a few photons, is collected by a telescope and the time-of-flight is measured. Using information about the satellite's orbit, the time-of-flight, and the speed of light, the location of the ranging station can be determined. Similar data acquired by another station, many kilometers distant from the first, or on a different continent, can be used to determine the distance between stations to precisions of centimeters or better. Repetitive measurements over months and years yield the change in distance, or the motion of the Earth's crust." - NASA website

Other URLS: http://gcmd.nasa.gov/KeywordSearch/MetadataTransformation.do?Portal=daacs&KeywordPath=%5BProject%3A+Short_Name%3D'ILRS'%5D&EntryId=CDDIS_SLR_data&MetadataType=0&lbnode=mdlb3, https://catalog.data.gov/dataset/cddis-slr-data-6d48e

JSON:

From data.gov:

{"@type": "dcat:Dataset", "_id": {"$oid": "55942a5fc63a7fe59b4960a8"}, "accessLevel": "public", "accrualPeriodicity": "irregular", "bureauCode": ["026:00"], "contactPoint": {"@type": "vcard:Contact", "fn": "Carey Noll (Crustal Dynamics Data Information System)", "hasEmail": "mailto:[email protected]"}, "description": "In Satellite Laser Ranging (SLR), a short pulse of coherent light generated by a laser (Light Amplification by Stimulated Emission of Radiation) is transmitted in a narrow beam to illuminate corner cube retroreflectors on the satellite. The return signal, typically a few photons, is collected by a telescope and the time-of-flight is measured. Using information about the satellite's orbit, the time-of-flight, and the speed of light, the location of the ranging station can be determined. Similar data acquired by another station, many kilometers distant from the first, or on a different continent, can be used to determine the distance between stations to precisions of centimeters or better. Repetitive measurements over months and years yield the change in distance, or the motion of the Earth's crust.", "distribution": [{"@type": "dcat:Distribution", "downloadURL": "ftp://cddis.gsfc.nasa.gov/slr/data", "mediaType": "application/octet-stream"}], "identifier": "C1000000041-CDDIS__2", "isPartOf": "C1000000041-CDDIS", "issued": "1982-01-01T00:00:00", "keyword": ["EARTH SCIENCES"], "landingPage": "http://reverb.echo.nasa.gov/reverb?selected=C1000000041-CDDIS", "language": ["en-US"], "license": "http://www.usa.gov/publicdomain/label/1.0/", "modified": "2012-06-14T00:00:00", "programCode": ["026:001"], "publisher": {"@type": "org:Organization", "name": "National Aeronautics and Space Administration"}, "spatial": "-180.0, -90.0, 180.0, 90.0", "temporal": "R/1976-01-02T00:00:00Z/P1D", "theme": ["ILRS"], "title": "CDDIS_SLR_data"}

http://www.goes-r.gov/users/2014-01-27-PG-VFF.html

{
"title": "January 22, 2014 - PG Virtual Forecasters Forums",
"maintainer": "Michelle Smith",
"maintainer_email": null,
"author": "Michelle Smith",
"author_email": null,
"notes": "2014 GOES-R/JPSS PROVING GROUND website documents the Virtual Forcaster Forum that occurred on Wednesday January 22nd 2014 from 2:00 to 5:00pm EST. Saw on web that NOAA is open source.",
"license_id": "open source",
"landingPage": "http://www.goes-r.gov//users//2014-01-27-PG-VFF.html",
"id": "DF4BAA6E-A8BC-492E-9E1B-D41D06CEED62",
"doi": null,
"isPartOf": "GOESR",
"tags": "NOAA",
"organization": {
"description": "",
"title": "National Oceanic and Atmospheric Administration",
"name": "noaa-gov",
"is_organization": true,
"image_url": "https://commons.wikimedia.org/wiki/File:NOAA.png",
"type": "organization",
"id": ""

}

[WIP] ftp://data.ncdc.noaa.gov/cdr/nesdis-msu-amsu

🚨 Metadata on data.gov 404s, will find it another way a little later

Climate Mirror dataset title: e.g. NOAA ESRL GMD Radiation

Climate Mirror issue: climate-mirror/datasets#285

Link to datafile: ftp://data.ncdc.noaa.gov/cdr/nesdis-msu-amsu

Agency:

Agency Division:

Agency Subdivision:

Agency Sub-Subdivision:

Bulk Download Link: ftp://data.ncdc.noaa.gov/cdr/nesdis-msu-amsu

Size Estimate:

Data Type: e.g. "The dataset contains three channel-based, monthly gridded atmospheric layer temperature Climate Data Records generated by merging nine MSU NOAA polar orbiting satellites, TIROS-N and NOAA-6 through NOAA-14, and six AMSU-A polar orbiting satellites, NOAA-15 through NOAA-18, MetOp-A, and NASA AQUA. These are temperatures of middle-troposphere (TMT), upper-troposphere (TUT, also known as temperature troposphere stratosphere), and lower-stratosphere (TLS), corresponding to measurements from MSU/AMSU-A channels 2/5, 3/7, and 4/9, respectively. Adjustments of observations included limb-adjustment, diurnal drift corrections, warm target temperature effect, and residual inter-satellite bias removal. Data coverage is from November 1978 to present; It is monthly global gridded dataset with 2.5 latitude by 2.5 longitude resolution. The dataset is updated each month with full Period of Record (POR) files in order to monitor operationally the change of upper air temperature." - data.gov

Other URLS: https://catalog.data.gov/dataset/noaa-climate-data-record-of-microwave-sounding-unit-msu-and-advanced-microwave-sounding-unit-am

Sea Surface Temperatures : 1988-2016 - Issue 156

Climate Mirror dataset title:

Sea Surface Temperatures : 1988-2016

Climate Mirror issue:

climate-mirror/datasets#156

Link to datafile:

ftp://data.ncdc.noaa.gov/cdr/sea-surface-temp-whoi/files/

Agency:

NOAA

Agency Division:

National Oceanic and Atmospheric Administration

Agency Subdivision:

National Center for Environmental Information

Agency Sub-Subdivision:

Bulk Download Link:

ftp://data.ncdc.noaa.gov/cdr/sea-surface-temp-whoi/files

Size Estimate:

132G

Data Type:

NetCDF

Other URLS:

https://catalog.data.gov/dataset/noaa-climate-data-record-cdr-of-sea-surface-temperature-whoi-version-1-0

JSON:

{
  "name": "sea-surface-temp-whoi",
  "title": "Sea Surface Temperatures",
  "maintainer": "",
  "maintainer_email": "",
  "id": "",
  "metadata_created": "2017-02-03",
  "metadata_modified": "2017-02-03",
  "author": "",
  "author_email": "",
  "type": "dataset",
  "notes": "The NOAA Ocean Surface Bundle (OSB) Climate Data Record (CDR) consist of three parts: sea surface temperature, near-surface atmospheric properties, and heat fluxes. ",
  "license_id": "",
  "organization": {
    "description": "",
    "created": "",
    "title": "",
    "name": null,
    "is_organization": true,
    "image_url": "",
    "type": "organization",
    "id": ""
  },
  "resources": [
    {
      "url": "ftp://data.ncdc.noaa.gov/cdr/sea-surface-temp-whoi/files/",
      "describedBy": "https://catalog.data.gov/dataset/noaa-climate-data-record-cdr-of-sea-surface-temperature-whoi-version-1-0",
      "hash": "",
      "description": "",
      "format": "NC",
      "mimetype": "application/netcdf",
      "name": "",
      "created": ""
    }
  ]
}

Dataset at https://cida.usgs.gov/gdp/: A spatially comprehensive, meteorological data set for Mexico, the U.S., and southern Canada (NCEI Accession 0129374)

Climate Mirror dataset title: A spatially comprehensive, meteorological data set for Mexico, the U.S., and southern Canada (NCEI Accession 0129374)

Climate Mirror issue: climate-mirror/datasets#98

Link to datafile: "url": "ftp://gdo-dcp.ucllnl.org/pub/dcp/archive/OBS/livneh2014.1_16deg/"

Agency: e.g. National Oceanic & Atmospheric Administration (NOAA)

Agency Division:

Agency Subdivision:

Agency Sub-Subdivision:

Bulk Download Link: e.g. ftp://gdo-dcp.ucllnl.org/pub/dcp/archive/OBS/livneh2014.1_16deg/

Size Estimate:

Data Type: e.g. "

Other URLS:

JSON:
(example)
If you don't know a value, leave it blank. Check your JSON for errors with JSONlint

{
  "name": "a-spatially-comprehensive-meteorological-data-set-for-Mexico-the-U.S-and-southern-Canada-NCEI-Accession-0129374",
  "title": "A spatially comprehensive, meteorological data set for Mexico, the U.S., and southern Canada (NCEI Accession 0129374)",
  "url": "ftp://gdo-dcp.ucllnl.org/pub/dcp/archive/OBS/livneh2014.1_16deg/",
  "maintainer": "",
  "maintainer_email": "",
  "id": "{90B72203-33B0-47B3-BA28-BFFAF8E1DF74}",
  "metadata_created": "",
  "metadata_modified": "2017-00-29T20:18:38Z",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "notes": "A data set of observed daily and monthly averaged precipitation, maximum and minimum temperature, gridded to a 1\/16° (~6km) resolution that spans the entire country of Mexico, the conterminous U.S. (CONUS), and regions of Canada south of 53° N for the per...",
  "license_id": "cc-zero",
  "organization": {
    "description": "",
    "created": "",
    "title": "A spatially comprehensive, meteorological data set for Mexico, the U.S., and southern Canada (NCEI Accession 0129374)",
    "name": "a-spatially-comprehensive-meteorological-data-set-for-Mexico-the-U.S-and-southern-Canada-NCEI-Accession-0129374",
    "is_organization": true,
    "image_url": "",
    "type": "",
    "id": "90B72203-33B0-47B3-BA28-BFFAF8E1DF74"
  }
 
}```

http://www.goes-r.gov/users/2013-03-04-PG-AH.html

Landing page for a sub-group of a NOAA-NASA collaboration - Geostationary Operational Environmental Satellite - R Series

Series of talks from an "all hands" meeting - powerpoints and pdfs.

{
	"title": "2013 Proving Ground All Hands Teleconference",
	"maintainer": "GOES-R Series Program Office",
	"maintainer_email": "[email protected]",
	"author": null,
	"author_email": null,
	"notes": "The 2013 Teleconference is a collection of .ppt and .pdf files of various presentations regarding the Geostationary Operational Environmental Satellite-R Series",
	"license_id": null,
	"landingPage": "http://www.goes-r.gov/users/2013-03-04-PG-AH.html",
	"id": "ac5675c4-79a1-4403-8332-bdbcbb699ea5",
	"doi": "",
	"isPartOf": "",
	"organization": {
		"description": "Geostationary Operational Environmental Satellite - R Series",
		"title": "National Oceanic and Atmospheric Administration, National Aeronautics and Space Administration",
		"name": "noaa, nasa",
		"is_organization": true
	}
}

ACRIM III Level 2 Daily Mean V001

Climate Mirror dataset title: ACRIM III Level 2 Daily Mean

Climate Mirror issue: climate-mirror/datasets#175

Link to datafile: ftp://l5eil01.larc.nasa.gov/ACRIM_III/ACR3L2DM.001/ (contains multiple subfolders with hdf files)

Agency: NASA

Agency Division: Langley Research Center

Bulk Download Link: ftp://l5eil01.larc.nasa.gov/ACRIM_III/ACR3L2DM.001/

Size Estimate: 100M

Data Type: Solar Irradiation data from the ACRIM III (Active Cavity Radiometer Irradiance Monitor) satellite

Other URLS:
http://earthobservatory.nasa.gov/Features/ACRIMIII/
https://eosweb.larc.nasa.gov/project/acrimIII/acrimIII_table
https://catalog.data.gov/dataset/acrim-iii-level-2-daily-mean-data-v001

{
  "@type": "dcat:Dataset",
  "_id": {
    "$oid": "55942a58c63a7fe59b495ab2"
  },
  "accessLevel": "public",
  "accrualPeriodicity": "irregular",
  "bureauCode": [
    "026:00"
  ],
  "contactPoint": {
    "@type": "vcard:Contact",
    "fn": "Dr. Richard Willson (Langley DAAC User Services)",
    "hasEmail": "mailto:[email protected]"
  },
  "description": "This file contains Level 2 total solar irradiance in the form of daily means gathered by the ACRIM instrument on the ACRIMSAT satellite. (Suggested Usage: This collection is comprised of processed daily mean data collected by the ACRIMSAT spacecraft. This collection is ACRIM III results of total solar irradiance.)",
  "distribution": [
    {
      "@type": "dcat:Distribution",
      "downloadURL": "http:\/\/reverb.echo.nasa.gov\/reverb?selected=C179031504-LARC",
      "mediaType": "text\/html"
    }
  ],
  "identifier": "C179031504-LARC",
  "issued": "2000-10-04T07:58:07.346Z",
  "keyword": [
    "EARTH SCIENCE",
    "ATMOSPHERE",
    "ATMOSPHERIC RADIATION",
    "SUN-EARTH INTERACTIONS",
    "SOLAR ACTIVITY"
  ],
  "landingPage": "http:\/\/reverb.echo.nasa.gov\/reverb?selected=C179031504-LARC",
  "language": [
    "en-US"
  ],
  "license": "http:\/\/www.usa.gov\/publicdomain\/label\/1.0\/",
  "modified": "2013-11-05T15:14:08.500Z",
  "programCode": [
    "026:001"
  ],
  "publisher": {
    "@type": "org:Organization",
    "name": "National Aeronautics and Space Administration"
  },
  "temporal": "1999-12-20T00:00:00Z\/2014-12-20T00:00:00Z",
  "theme": [
    "ACRIM"
  ],
  "title": "ACRIM III Level 2 Daily Mean Data V001",

  "resources": [
    {
      "url": "ftp://l5eil01.larc.nasa.gov/ACRIM_III/ACR3L2DM.001/",
      "description": "Daily mean data collected by the ACRIMSAT spacecraft",
      "format": "HDF, XML",
      "name": "ACRIM III Level 2 Daily Mean Data V001",
      "created": "2015-12-01T00:00:00.000000"
    }
  ]
}

NASA PODAAC Sea Surface Temperatures Data

Climate Mirror dataset title: NASA PODAAC Sea Surface Temperatures Data

Climate Mirror issue: e.g. climate-mirror/datasets#242, climate-mirror/datasets#290

Link to datafile: ftp:/podaac-ftp.jpl.nasa.gov/allData/goes

Agency: e.g. NASA

Agency Division: e.g. JPL

Agency Subdivision: Physical Oceanography DAAC

Agency Sub-Subdivision: Geostationaary Operational Environmental Satellites (GOES)

Bulk Download Link: e.g. ftp:/podaac-ftp.jpl.nasa.gov/allData/goes

Size Estimate: e.g. 1TB+

Data Type: e.g. "This data set consists of Level 3 SSTs derived from GOES East and GOES West with a spatial resolution of approximately 6km. Data sets are available in one hour, three hour, and 24 hour gridded sea surface temperatures. The grid covers much of the Western Hemisphere bounded by 180W, 30W, 60N and 45S" - website

Other URLS: ftp://podaac-ftp.jpl.nasa.gov/allData/goes/L3/goes_6km_nrt/docs/goes_sst_doc.html, http://gcmd.nasa.gov/KeywordSearch/Metadata.do?Portal=NASA&KeywordPath=%5BProject%3A+Short_Name%3D%26%23039%3BGOES%26%23039%3B%5D&OrigMetadataNode=GCMD&EntryId=PODAAC-GOES3-3HOUR&MetadataView=Full&MetadataType=0&lbnode=mdlb3, http://gcmd.gsfc.nasa.gov/KeywordSearch/Metadata.do?Portal=GCMD&KeywordPath=%5BSource_Name%3A+Short_Name%3D'GOES-11'%5D&OrigMetadataNode=GCMD&EntryId=PODAAC-GOES3-24HOR&MetadataView=Full&MetadataType=0&lbnode=mdlb1, http://gcmdidn.gsfc.nasa.gov/KeywordSearch/Metadata.do?Portal=GCMD&KeywordPath=%5BSensor_Name%3A+Short_Name%3D'GOES+N-P+IMAGER'%5D&OrigMetadataNode=GCMD&EntryId=PODAAC-GOES3-3HOUR&MetadataView=Full&MetadataType=0&lbnode=mdlb4

JSON:
(example)
If you don't know a value, leave it blank. Check your JSON for errors with JSONlint

{
  "name": "goes_6km_rt",
  "title": "Geostationaary Operational Environmental Satellites (GOES) 6km Near Real-Time Sea Surface Temperature (SST) Documentation",
  "maintainer": "",
  "maintainer_email": "[email protected]",
  "id": "fa3650cd-a90d-4560-b641-26a71b57206d",
  "metadata_created": "",
  "metadata_modified": "",
  "author": "The GOES SST data was obtained from the JPL Physical Oceanography DAAC",
  "author_email": null,
  "type": "[email protected]",
  "notes": "This data set consists of Level 3 SSTs derived from GOES East and GOES West with a spatial resolution of approximately 6km. Data sets are available in one hour, three hour, and 24 hour gridded sea surface temperatures. The grid covers much of the Western Hemisphere bounded by 180W, 30W, 60N and 45S",
  "license_id": "",
  "organization": {
    "description": "",
    "created": "",
    "title": "National Aeronautics and Space Administration (NASA)",
    "name": "nasa",
    "is_organization": true,
    "image_url": "https://polargateways2008.gsfc.nasa.gov/images/LOGO_2in/NASA_2.jpg",
    "type": "organization",
    "id": ""
  },
  "resources": [
    {
      "url": "ftp://podaac.jpl.nasa.gov/allData/goes/L3/goes_6km_nrt/americas/yyyy/ddd",
      "describedBy": "",
      "hash": "",
      "description": "Where yyyy is the four-digit year and ddd is the Julian date or day of year",
      "format": "",
      "mimetype": "",
      "name": "",
      "created": ""
    }
  ]
}

ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/combined/SPHE-00698_SPHE-00517/

Climate Mirror dataset title: IMP-H/IMP-J Hourly Averaged Solar Plasma Data

Climate Mirror issue: climate-mirror/datasets#176

Link to datafile: ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/combined/

Agency: NASA

Agency Division: NASA Space Science Data Coordinated Archive (NSSDC)

Agency Subdivision:

Agency Sub-Subdivision:

Bulk Download Link: ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/combined/

Size Estimate: Unknown

Data Type: The data set consists of hourly averaged solar plasma data on BCD magnetic tape recorded on an IBM 360 computer. The data are in two files. The first file contains data for IMP-J and the second for IMP-H (72-073A-02A). Each physical record contains 100 logical records of 106 bytes. Each record contains spacecraft name; year; day of year; hour of day and average; and standard deviation and number of values averaged for speed, density, and thermal speed.

Other URLS:

JSON:

{
  "name": "SPHE-00698_SPHE-00517",
  "title": "IMP-H/IMP-J Hourly Averaged Solar Plasma Data",
  "maintainer": "Natalia Papitashvili",
  "maintainer_email": "[email protected]",
  "id": "SPHE-00698/SPHE-00517",
  "metadata_created": "2017-02-04T02:54:40.863Z",
  "metadata_modified": "2017-02-04T02:54:40.863Z",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "url": "ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/combined",
  "notes": "The data set consists of hourly averaged solar plasma data on BCD magnetic tape recorded on an IBM 360 computer. The data are in two files. The first file contains data for IMP-J and the second for IMP-H (72-073A-02A). Each physical record contains 100 logical records of 106 bytes. Each record contains spacecraft name; year; day of year; hour of day and average; and standard deviation and number of values averaged for speed, density, and thermal speed.",
  "license_id": null,
  "organization": {
    "title": "NASA",
    "name": "nasa",
    "is_organization": true
  }
}

moar links

i will describe these later

https://github.com/edgi-govdata-archiving
https://github.com/CDLUC3/datarescue/issues
https://catalog.data.gov/api/3/action/package_search?q=type%3Aharvest+AND+source_type%3Adatajson+AND+organization_type%3A%22Federal+Government%22
http://tracker.archiveteam.org/ftp-gov/

Scitech Connect Department of Energy Science, Technology and Engineering Research Information

JSON:
(example)
If you don't know a value, leave it blank. Check your JSON for errors with JSONlint

{
	"title": "science, technology, and engineering research information from the U.S. Department of Energy",
	"maintainer": null,
	"maintainer_email": "[email protected]",
	"author": null,
	"author_email": null,
	"notes": "From the link \u201cAbout SciTech Connect\u201d - https:\/\/www.osti.gov\/scitech\/about\n\n\u201cSciTech Connect includes technical reports, bibliographic citations, journal articles, conference papers, books, patents and patent applications, multimedia, software, and data information sponsored by DOE through a grant, contract, cooperative agreement, or similar type of funding mechanism from the 1940s to today. This collection continues to grow as new scientific and technical information resulting from DOE research becomes available.\nWith over 2.85 million citations, SciTech Connect includes citations to 1.5 million journal articles, one million of which have digital object identifiers (DOIs) linking to full-text articles on publishers' websites. Additionally, SciTech Connect holds over 440,000 full-text DOE sponsored STI reports. Most full-text reports are post-1991, although over 143,000 of the reports were published prior to 1991.\u201d\n\n\u201cLaunched in 2013, SciTech Connect consolidates two previous DOE search engines, Information Bridge and Energy Citations Database, creating a single search interface for all R&D information. Thus, SciTech Connect contains over seventy years of energy-related citations and full-text documents created and\/or collected by OSTI. Copyright varies by publication. When accessing OSTI websites, you may encounter documents, illustrations, photographs, or other information resources that are protected by U.S. or foreign copyright laws. Although you may legally access such works via OSTI, the copyright owners retain rights that govern the reproduction, redistribution, and re-use of copyrighted works. You are solely responsible for complying with applicable copyright law restrictions, including seeking the permission of the copyright owners when your intended activities fall outside the limited uses provided for by fair use and other legal principles.",
	"license_id": "restrictions",
	"landingPage": "https://www.osti.gov/scitech/",
	"id": "E268D952-3E8C-4F6E-8D07-86B1B7C35991",
	"doi": null,
	"isPartOf": "Department of Energy",
	"tags": "DOE",
	"organization": {
		"description": "",
		"title": "Department of Energy",
		"name": "energy.gov",
		"is_organization": true,
		"image_url": "",
		"type": "organization",
		"id": ""
	}
}

ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/aimp-2_imp-e/

Climate Mirror dataset title: Explorer 35 - 5.12 s Vector Magnetic Field Data

Climate Mirror issue: climate-mirror/datasets#176

Link to datafile: ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/aimp-2_imp-e/

Agency: NASA

Agency Division: NASA Space Science Data Coordinated Archive (NSSDC) / NASA Ames Research Center

Agency Subdivision:

Agency Sub-Subdivision:

Bulk Download Link: ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/aimp-2_imp-e/

Size Estimate: Unknown

Data Type: This data set consists of experimenter-supplied, 5.12-s-averaged vector magnetic field data on binary magnetic tapes created on an IBM 7094 computer. Each physical record contains 2760 characters, of which the first 12 constitute a DCS control word. Each logical record contains 132 characters (for the first vector of an 82 s sequence) or 138 characters, of which the first six constitute a DCS control word. Data given within each logical record relate to a single magnetic vector measurement and include field magnitude, Cartesian components, and latitude and longitude angles in solar equatorial, GSM, and GSE coordinates.

There are data for several weeks on each tape, with no ephemeris data on any of the tapes. Two intervals of several hours each (13 October and 27 November 1967) have been found when, because of apparent keypunch errors in the experimenter's data processing cycle, the sign of Bz (and, hence, of the field latitude angle) is opposite what it should be. These errors appeared when comparing these data to the experimenter's IMP-D data and to data from the other IMP-D magnetometer. It is not known what percentage of the data is affected by similar errors, although this percentage is expected to be small.

Other URLS: http://nssdc.gsfc.nasa.gov/nmc/datasetDisplay.do?id=SPHE-00616

JSON:

{
  "name": "aimp-2_imp-e",
  "title": "Explorer 35 - 5.12 s Vector Magnetic Field Data",
  "maintainer": "Natalia Papitashvili",
  "maintainer_email": "[email protected]",
  "id": "SPHE-00616",
  "metadata_created": "2017-02-04T02:54:40.863Z",
  "metadata_modified": "2017-02-04T02:54:40.863Z",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "url": "ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/aimp-2_imp-e/",
  "notes": "This data set consists of experimenter-supplied, 5.12-s-averaged vector magnetic field data on binary magnetic tapes created on an IBM 7094 computer. Each physical record contains 2760 characters, of which the first 12 constitute a DCS control word. Each logical record contains 132 characters (for the first vector of an 82 s sequence) or 138 characters, of which the first six constitute a DCS control word. Data given within each logical record relate to a single magnetic vector measurement and include field magnitude, Cartesian components, and latitude and longitude angles in solar equatorial, GSM, and GSE coordinates. There are data for several weeks on each tape, with no ephemeris data on any of the tapes. Two intervals of several hours each (13 October and 27 November 1967) have been found when, because of apparent keypunch errors in the experimenter's data processing cycle, the sign of Bz (and, hence, of the field latitude angle) is opposite what it should be. These errors appeared when comparing these data to the experimenter's IMP-D data and to data from the other IMP-D magnetometer. It is not known what percentage of the data is affected by similar errors, although this percentage is expected to be small.",
  "license_id": null,
  "organization": {
    "title": "NASA",
    "name": "nasa",
    "is_organization": true
  }
}

SAGE III Satellite Data

Climate Mirror dataset title: SAGE III Satellite Data

Climate Mirror issue: climate-mirror/datasets#177

Link to datafile: ftp://l5eil01.larc.nasa.gov/SAGE_III/ (ftp folder with multiple subfolders)

Agency: NASA

Agency Division: Langley Research Center

Bulk Download Link: ftp://l5eil01.larc.nasa.gov/SAGE_III/

Size Estimate: 40G

JSON:
(JSON data here contains only the IDs and data set names from data.gov. See data.gov for full metadata)

[
{"id": "55942a74c63a7fe59b49714e", "name": "SAGE III Meteor-3M L1B Solar Event Transmission Data (HDF-EOS) V003", "url": "https://catalog.data.gov/dataset/sage-iii-meteor-3m-l1b-solar-event-transmission-data-hdf-eos-v003"},
{"id": "55942a74c63a7fe59b49714f", "name": "SAGE III Meteor-3M L1B Solar Event Transmission Data (HDF-EOS) V004", "url": "https://catalog.data.gov/dataset/sage-iii-meteor-3m-l1b-solar-event-transmission-data-hdf-eos-v004"},
{"id": "55942a74c63a7fe59b497150", "name": "SAGE III Meteor-3M L1B Solar Event Transmission Data (Native) V003", "url": "https://catalog.data.gov/dataset/sage-iii-meteor-3m-l1b-solar-event-transmission-data-native-v003"},
{"id": "55942a74c63a7fe59b497151", "name": "SAGE III Meteor-3M L1B Solar Event Transmission Data (Native) V004", "url": "https://catalog.data.gov/dataset/sage-iii-meteor-3m-l1b-solar-event-transmission-data-native-v004"},
{"id": "55942a74c63a7fe59b497152", "name": "SAGE III Meteor-3M L2 Lunar Event Species Profiles (HDF-EOS) V003", "url": "https://catalog.data.gov/dataset/sage-iii-meteor-3m-l2-lunar-event-species-profiles-hdf-eos-v003"},
{"id": "55942a74c63a7fe59b497153", "name": "SAGE III Meteor-3M L2 Lunar Event Species Profiles (Native) V003", "url": "https://catalog.data.gov/dataset/sage-iii-meteor-3m-l2-lunar-event-species-profiles-native-v003"},
{"id": "55942a74c63a7fe59b497154", "name": "SAGE III Meteor-3M L2 Monthly Cloud Presence Data (HDF-EOS) V003", "url": "https://catalog.data.gov/dataset/sage-iii-meteor-3m-l2-monthly-cloud-presence-data-hdf-eos-v003"},
{"id": "55942a74c63a7fe59b497155", "name": "SAGE III Meteor-3M L2 Monthly Cloud Presence Data (Native) V003", "url": "https://catalog.data.gov/dataset/sage-iii-meteor-3m-l2-monthly-cloud-presence-data-native-v003"},
{"id": "55942a74c63a7fe59b497156", "name": "SAGE III Meteor-3M L2 Solar Event Species Profiles (HDF-EOS) V003", "url": "https://catalog.data.gov/dataset/sage-iii-meteor-3m-l2-solar-event-species-profiles-hdf-eos-v003"},
{"id": "55942a74c63a7fe59b497157", "name": "SAGE III Meteor-3M L2 Solar Event Species Profiles (HDF-EOS) V004", "url": "https://catalog.data.gov/dataset/sage-iii-meteor-3m-l2-solar-event-species-profiles-hdf-eos-v004"},
{"id": "55942a74c63a7fe59b497158", "name": "SAGE III Meteor-3M L2 Solar Event Species Profiles (Native) V003", "url": "https://catalog.data.gov/dataset/sage-iii-meteor-3m-l2-solar-event-species-profiles-native-v003"},
{"id": "55942a74c63a7fe59b497159", "name": "SAGE III Meteor-3M L2 Solar Event Species Profiles (Native) V004", "url": "https://catalog.data.gov/dataset/sage-iii-meteor-3m-l2-solar-event-species-profiles-native-v004"}
]

NASA Benefits on Earth

{
"title": "NASA Benefits on Earth",
"maintainer": "Brian Dunbar",
"maintainer_email": null,
"author": null,
"author_email": null,
"notes": "The NASA Benefits on Earth site is a listing of images, media, videos, and explanatory documents pertaining to the Earth. The items are arranged in categories: Air, Climate, Hazards, Water, Oceans and Ice, Land, and Benefits on Earth .",
"license_id": "public domain",
"landingPage": "https://www.nasa.gov/content/benefits-on-earth",
"id": "795D1B47-5941-4183-992B-BBF9A081B414",
"doi": null,
"isPartOf": "NASA",
"tags": "NASA, Earth Science",
"organization": {
"description": "We reach for new heights and reveal the unknown for the benefit of humankind.",
"title": "National Aeronautics and Space Administration",
"name": "NASA",
"is_organization": true,
"image_url": "https://www.nasa.gov/sites/all/themes/custom/nasatwo/images/nasa-logo.svg",
"type": "organization",
"id": ""

}
}

[WIP] NASA PODAAC JASON-2 Satellite Data

🚨 Metadata on data.gov 404s

Climate Mirror dataset title: NASA PODAAC JASON-2 Satellite Data

Climate Mirror issue: e.g. climate-mirror/datasets#252

Link to datafile: ftp://ftp.nodc.noaa.gov/pub/data.nodc/jason2

Agency: e.g. DOC/NOAA/NESDIS/NCEI > National Centers for Environmental Information, NESDIS, NOAA, U.S. Department of Commerce (Point of Contact)

Agency Division:

Agency Subdivision:

Agency Sub-Subdivision:

Bulk Download Link: ftp://ftp.nodc.noaa.gov/pub/data.nodc/jason2

Size Estimate: 6-7TB

Data Type: e.g. "The level-2 X-GDR are available as 3 datatypes: Operational Geophysical Data Records (OGDR), Interim Geophysical Data Records (IGDR) and final Geophysical Data Records (GDR). The OGDRs are near-real-time records and are generated every 3-5 hours. They are based on orbits from DORIS propagator and forecast meteorological fields for the geophysical corrections. The IGDRs are based on preliminary DORIS ephemeris, analyzed meteorological grids, and preliminary auxiliary data files. The IGDRs have a latency of 1 - 2 days. The S-IGDR is a superset of the IGDR, containing the original radar echo "waveform" data. The GDRs are based on final high-precision DORIS (perhaps combined with GPS) ephemeris, final meteorological grids, ancillary and auxiliary data files. The S-GDR is a superset of the GDR, containing the waveform data. The S-GDRs are generated every 10 days. Sea Surface Height Anomaly (SSHA) files are available for IGDR and GDR. All files are available in NetCDF format and the OGDRs are also available in BUFR format. Jason-2 level-2 X-GDR data are distributed through the NOAA/NESDIS Comprehensive Large Array-data Stewardship System (CLASS:http://www.class.noaa.gov)" - data.gov

Other URLS: https://catalog.data.gov/dataset/ocean-surface-topography-mission-ostm-jason-2-level-2-geophysical-data-records-gdr-nodc-accessi

https://www1.ncdc.noaa.gov/pub/data/annualreports/

Climate Mirror dataset title: https://www1.ncdc.noaa.gov/pub/data/

Climate Mirror issue: climate-mirror/datasets#298

Link to datafile: dataset links to many many folders and datasets this metadata focues on the "annualreports" folder at https://www1.ncdc.noaa.gov/pub/data/annualreports/

Agency: National Oceanic & Atmospheric Administration (NOAA)

Agency Division: National Climatic Data Center (NCDC)

Agency Subdivision:

Agency Sub-Subdivision:

**Bulk Download Link:**https://www1.ncdc.noaa.gov/pub/data/annualreports/

Size Estimate:

Other URLS:

JSON:
(example)
If you don't know a value, leave it blank. Check your JSON for errors with JSONlint

{
  "name": "Index of /pub/data/annualreports",
  "title": "Index of /pub/data/annualreports",
  "maintainer": "National Climatic Data Center - NOAA",
  "maintainer_email": "",
  "id": "",
  "metadata_created": "2017-02-03T14:53:00.000000",
  "metadata_modified": "",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "notes": "Annual reports 2001 through 2013, web directory of PDFs",
  "license_id": "",
  "organization": {
    "description": "",
    "created": "",
    "title": "National Climatic Data Center - NOAA",
    "name": "ncdc.noaa.gov",
    "is_organization": true,
    "image_url": "",
    "type": "organization",
    "id": ""
  },
  "resources": [
    {
      "url": "https://www1.ncdc.noaa.gov/pub/data/annualreports/",
      "describedBy": "https://www1.ncdc.noaa.gov/pub/data/",
      "hash": "",
      "description": "",
      "format": "PDFs",
      "mimetype": "",
      "name": "annual reports",
      "created": ""
    }
  ]
}

NASA PODAAC Absolute Dynamic Topography Data

Climate Mirror dataset title: e.g. NASA PODAAC Absolute Dynamic Topography Data

Climate Mirror issue: e.g. climate-mirror/datasets#260

Link to datafile: ftp://podaac.jpl.nasa.gov/allData/aviso/L4/dynamic_topo_1deg_1mo/zosNobs_AVISO_L4_199210-201012.nc

Agency: National Aeronautics and Space Administration (NASA)

Agency Division: Jet Propulsion Laboratory

Agency Subdivision: Physical Oceanography Distributed Active Archive Center (PO.DAAC)

Agency Sub-Subdivision:

Bulk Download Link: ftp://podaac.jpl.nasa.gov/allData/aviso/L4/dynamic_topo_1deg_1mo/zosNobs_AVISO_L4_199210-201012.nc

Size Estimate: 54.2 MB

Data Type: This sea level dataset contains the sea surface height above geoid derived from the
AVISO/DUACS altimeter climate data record [1]. DUACS (Data Unification and Altimeter
Combination System) is a system ensuring the processing of multi-mission altimeter data in
order to provide a consistent and homogeneous catalogue of products for varied applications,
both for near-real time applications and offline studies.

Other URLS: ftp://podaac.jpl.nasa.gov/allData/aviso/L4/dynamic_topo_1deg_1mo/docs/zosTechNote_AVISO_L4_199210-201012.pdf

JSON:
(example)
If you don't know a value, leave it blank. Check your JSON for errors with JSONlint

{
  "name": "aviso-sea-surface-height-above-geoid",
  "title": "AVISO Sea Surface Height above Geoid",
  "maintainer": "Gérald Dibarboure",
  "maintainer_email": "[email protected]",
  "id": "",
  "metadata_created": "2017-02-3T17:22:09.228971",
  "metadata_modified": "2017-02-3T17:22:09.228971",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "notes": "The folder containing this file had 3 varieties of data and md5 checksum.  Filenames starting with zos contains the gridded satellite data. Filenames containing Nobs is the number of observations used in calculating the data. Filenames containing Stderr is the standard error of the data. The md5 checksum ends with .md5. Documentation can be found in the docs folder found on this level (see Other Urls for pdf documentation link).",
  "license_id": "cc-zero",
  "organization": {
    "description": "",
    "created": "2011-10-04T12:00:00.000000",
    "title": "Physical Oceanography Distributed Active Archive Center (PO.DAAC)",
    "name": "Physical Oceanography Distributed Active Archive Center (PO.DAAC)",
    "is_organization": true,
    "image_url": "",
    "type": "organization",
    "id": ""
  },
  "resources": [
    {
      "url": "ftp://podaac.jpl.nasa.gov/allData/aviso/L4/dynamic_topo_1deg_1mo/zosNobs_AVISO_L4_199210-201012.nc",
      "describedBy": "ftp://podaac.jpl.nasa.gov/allData/aviso/L4/dynamic_topo_1deg_1mo/docs/zosTechNote_AVISO_L4_199210-201012.pdf",
      "hash": "",
      "description": "zosNobs_AVISO_L4_199210-201012.nc",
      "format": "nc",
      "mimetype": "application/x-netcdf",
      "name": "Sea Surface Height above Geoid",
      "created": "2011-10-04T12:00:00.000000"
    }
  ]
}

https://www.energy.gov/eere/amo/articles/sep-case-study-webinar-detroit-diesel

{
"Date of capture": "Sat Feb 18 2017 14:36:25 GMT-0500 (EST)",
"File formats contained in package": "Youtube Video, text",
"Individual source or seed URL": "https://www.energy.gov/eere/amo/articles/sep-case-study-webinar-detroit-diesel",
"Institution facilitating the data capture creation and packaging": {
"name": "U.S. Department of Energy"
},
"Name of package creator": "ashwang",
"Name of resource": "SEP Case Study Webinar: Detroit Diesel",
"Type(s) of content in package": "text, video",
"UUID": "573DB13D-DB37-4676-83A4-3763ADB1D349",
"Raw data": "https://www.energy.gov/sites/prod/files/2016/07/f33/Detroit%20Diesel%20MV%20Slides_Final_7-14-16.pdf",
"Webinar link": "https://youtu.be/Bwb5-rmsgZ0",
"recommended_approach": "",
"significance": "",
"title": "SEP Case Study Webinar: Detroit Diesel | Department of Energy",
"url": "https://www.energy.gov/eere/amo/articles/sep-case-study-webinar-detroit-diesel",
"Description": "Webinar to highlight U.S. manufacturing facilities that have achieved Superior Energy Performance (SEP) certification. "
}

ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/imp-a/

Climate Mirror dataset title: IMP-A: Hourly Averaged Values of Magnetospheric Magnetic Field Data

Climate Mirror issue: climate-mirror/datasets#184

Link to datafile: ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/imp-a/

Agency: NASA

Agency Division: NSSDC / NASA Goddard

Agency Subdivision:

Agency Sub-Subdivision:

Bulk Download Link: ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/imp-a/

Size Estimate: Unknown

Data Type: This magnetospheric magnetic B-field data set is contained on one 9-track, 800-bpi, EBCDIC magnetic tape provided by the experimenter. The data include spacecraft position and hourly averaged vector magnetic field data in both Cartesian and spherical polar GSM coordinates. Only hourly averages within the magnetosphere are included. A microfilmed listing of the contents of this data set is also available in data set 63-046A-02G.

Other URLS:
http://nssdc.gsfc.nasa.gov/nmc/datasetDisplay.do?id=SPMS-00056

JSON:

{
  "name": "SPMS-00056",
  "title": "IMP-A: Hourly Averaged Values of Magnetospheric Magnetic Field Data",
  "maintainer": "Franklin W. Ottens",
  "maintainer_email": "[email protected]",
  "id": "SPMS-00056",
  "metadata_created": "2017-02-04T02:54:40.863Z",
  "metadata_modified": "2017-02-04T02:54:40.863Z",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "url": "ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/imp-a/",
  "notes": "This magnetospheric magnetic B-field data set is contained on one 9-track, 800-bpi, EBCDIC magnetic tape provided by the experimenter. The data include spacecraft position and hourly averaged vector magnetic field data in both Cartesian and spherical polar GSM coordinates. Only hourly averages within the magnetosphere are included. A microfilmed listing of the contents of this data set is also available in data set 63-046A-02G.",
  "license_id": null,
  "organization": {
    "title": "NASA",
    "name": "nasa",
    "is_organization": true
  }
}

ACRIM III Level 2 Shutter Cycle Data V001

Climate Mirror dataset title: ACRIM III Level 2 Shutter Cycle Data V001

Climate Mirror issue: climate-mirror/datasets#176

Link to datafile: ftp://l5eil01.larc.nasa.gov/ACRIM_III/ACR3L2SC.001/ (ftp folder with multiple subfolders)

Agency: NASA

Agency Division: Langley Research Center

Bulk Download Link: ftp://l5eil01.larc.nasa.gov/ACRIM_III/ACR3L2SC.001/

Size Estimate: 704M

Data Type: Solar Irradiation data from the ACRIM III (Active Cavity Radiometer Irradiance Monitor) satellite

Other URLS:
https://catalog.data.gov/dataset/acrim-iii-level-2-shutter-cycle-data-v001

{
  "@type": "dcat:Dataset",
  "_id": {
    "$oid": "55942a58c63a7fe59b495ab3"
  },
  "accessLevel": "public",
  "accrualPeriodicity": "irregular",
  "bureauCode": [
    "026:00"
  ],
  "contactPoint": {
    "@type": "vcard:Contact",
    "fn": "Dr. Richard Willson (Langley DAAC User Services)",
    "hasEmail": "mailto:[email protected]"
  },
  "description": "This file contains Level 2 total solar irradiance in the form of shutter cycles gathered by the ACRIM instrument on the ACRIMSAT satellite. (Suggested Usage: This collection is comprised of processed shutter cycle data collected by the ACRIMSAT spacecraft. This collection is ACRIM III results of total solar irradiance.)",
  "distribution": [
    {
      "@type": "dcat:Distribution",
      "downloadURL": "http:\/\/reverb.echo.nasa.gov\/reverb?selected=C61787524-LARC",
      "mediaType": "text\/html"
    }
  ],
  "identifier": "C61787524-LARC",
  "issued": "2000-10-04T07:54:09.260Z",
  "keyword": [
    "EARTH SCIENCE",
    "ATMOSPHERE",
    "ATMOSPHERIC RADIATION",
    "SUN-EARTH INTERACTIONS",
    "SOLAR ACTIVITY"
  ],
  "landingPage": "http:\/\/reverb.echo.nasa.gov\/reverb?selected=C61787524-LARC",
  "language": [
    "en-US"
  ],
  "license": "http:\/\/www.usa.gov\/publicdomain\/label\/1.0\/",
  "modified": "2013-11-05T15:14:09.430Z",
  "programCode": [
    "026:001"
  ],
  "publisher": {
    "@type": "org:Organization",
    "name": "National Aeronautics and Space Administration"
  },
  "temporal": "1999-12-20T00:00:00Z\/2014-12-20T00:00:00Z",
  "theme": [
    "ACRIM"
  ],
  "title": "ACRIM III Level 2 Shutter Cycle Data V001"
}

NOAA Satellite conference 2013 metadata update, 83B7A19B-278E-411E-9996-0D997D09AF4C

{
"title": "NOAA Satellite Conference 2013 - Presentations",
"maintainer": null,
"maintainer_email": null,
"author": null,
"author_email": null,
"notes": "A NOAA Satellite Conference for Direct Readout, GOES/POES, and GOES-R/JPSS Users was held in April 2013. This was a joint conference for all users of environmental satellite data, information, and products.",
"license_id": null,
"landingPage": "http://satelliteconferences.noaa.gov/2013/adgen_list.htm",
"id": "83B7A19B-278E-411E-9996-0D997D09AF4C",
"doi":"publication or data doi",
"isPartOf": "larger project?",
"tags": "NOAA",
"organization": {
"description": "",
"title": "National Oceanic and Atmospheric Administration",
"name": "satelliteconferences-noaa-gov",
"is_organization": true,
"image_url": "http://satelliteconferences.noaa.gov/2013/assets/NSC-3.jpg",
"type": "organization",
"id": ""
},
"Individual source or seed URL": "http://satelliteconferences.noaa.gov/2013/adgen_list.htm",
"UUID": "83B7A19B-278E-411E-9996-0D997D09AF4C",
"Institution facilitating the data capture creation and packaging": "Penn Data Refuge",
"Date of capture": "2017-02-04",
"Federal agency data acquired from": "National Oceanic and Atmospheric Administration",
"Name of resource": "NOAA Satellite Conference 2013 - Presentations",
"File formats contained in package": ".mov, .ppt, .pptx, .pdf",
"Type(s) of content in package": "presentations, videos",
"Free text description of capture process": "wget mirror of the conference schedule, which contains links to individual presentations",
"Name of package creator": "Nick Gregory"
}

ECC2D41B-2024-49B7-B424-B6C7CED2B74E

{
"Individual source or seed URL": "http://www.ndbc.noaa.gov/station_history.php?station=58907",
"UUID": "ECC2D41B-2024-49B7-B424-B6C7CED2B74E",
"id_agency": 3,
"Owned and maintained by": "University of Washington - APL",
"Institution facilitating the data capture creation and packaging": "A2 Data Refuge",
"Date of capture": "2017-01-28",
"Federal agency data acquired from": "National Oceanic and Atmospheric Administration",
"Name of resource": "NDBC - Station 00923 Historical Data",
"File formats contained in package": ".png",
"Type(s) of content in package": "Images with salinity/depth/temperature data",
"Free text description of capture process": "Performed wget on URLs on PHP endpoint that dynamically return png data.",
"Name of package creator": "Suby Raman"
}

Dataset at ftp:/ghrc.nsstc.nasa.gov/pub/rasi #170

Climate Mirror dataset title: REGIONAL AIR-SEA INTERACTION (RASI) GAP WIND AND COASTAL UPWELLING EVENTS CLIMATOLOGY

Climate Mirror issue: climate-mirror/datasets#170

Mirror Data http://67.205.151.30/170 -Mirrored By: adinbied

Link to datafile: ftp://ghrc.nsstc.nasa.gov/pub/rasi

Agency: National Aeronautics and Space Administration (NASA)

Agency Division: Global Hydrology Resource Center (GHRC)

Agency Subdivision:

Agency Sub-Subdivision:

Bulk Download Link: ftp://ghrc.nsstc.nasa.gov/pub/rasi

Size Estimate: 2.5 MB

Data Type: "The Regional Air-Sea Interactions (RASI) Gap Wind and Coastal Upwelling Events Climatology datasets were created using an automated intelligent algorithm which identified gap wind and coastal ocean upwelling events using two satellite-based microwave datasets. The Cross-Calibrated Multi-Platform (CCMP) ocean surface wind data product was used for wind data while the Optimally Interpolated Sea Surface Temperatures (OISST) data product provided by Remote Sensing Systems was used for sea surface temperatures. Data is available from 1998-2011 for three regions in Central America: Tehuantepec, Papagayo, and Panama. The RASI datasets are products resulting from DISCOVER, a NASA MEaSUREs-funded project." - GMD Radiation website

Other URLS: https://catalog.data.gov/dataset/regional-air-sea-interaction-rasi-gap-wind-and-coastal-upwelling-events-climatology-gulf-o-bf055

JSON:

{
	"_id": {
		"$oid": "55942abec63a7fe59b49add4"
	},
	"accessLevel": "public",
	"bureauCode": ["026:00"],
	"contactPoint": {
		"fn": "undefined",
		"hasEmail": "mailto:[email protected]"
	},
	"description": "The Regional Air-Sea Interactions (RASI) Gap Wind and Coastal Upwelling Events Climatology datasets were created using an automated intelligent algorithm which identified gap wind and coastal ocean upwelling events using two satellite-based microwave datasets.  The Cross-Calibrated Multi-Platform (CCMP) ocean surface wind data product was used for wind data while the Optimally Interpolated Sea Surface Temperatures (OISST) data product provided by Remote Sensing Systems was used for sea surface temperatures.  Data is available from 1998-2011 for three regions in Central America: Tehuantepec, Papagayo, and Panama.  The RASI datasets are products resulting from DISCOVER, a NASA MEaSUREs-funded project.",
	"distribution": [{
		"downloadURL": "ftp://ghrc.nsstc.nasa.gov/pub/rasi/tehuantepec/data/",
		"mediaType": "application/octet-stream"
	}],
	"identifier": "C1958538-GHRC",
	"issued": "2014-12-09T15:09:09.000Z",
	"keyword": ["EARTH SCIENCE", "ATMOSPHERE", "ATMOSPHERIC WINDS", "CLIMATE INDICATORS", "ATMOSPHERIC/OCEAN INDICATORS", "OCEANS", "OCEAN TEMPERATURE", "OCEAN WINDS"],
	"landingPage": "http://ghrc.nsstc.nasa.gov/rasi/main.php",
	"language": ["en-US"],
	"license": "http://www.usa.gov/publicdomain/label/1.0/",
	"modified": "2014-12-09T14:55:20.000Z",
	"programCode": ["026:001"],
	"publisher": {
		"name": "GHRC",
		"subOrganizationOf": {
			"name": "National Aeronautics and Space Administration",
			"subOrganizationOf": {
				"name": "U.S. Government"
			}
		}
	},
	"spatial": "-105.0 5.0 -93.38 16.38",
	"temporal": "1998-01-01T00:00:00Z/2011-12-31T23:59:59Z",
	"theme": ["geospatial"],
	"title": "REGIONAL AIR-SEA INTERACTION (RASI) GAP WIND AND COASTAL UPWELLING EVENTS CLIMATOLOGY GULF OF TEHUANTEPEC, MEXICO V1"
}

CODE_OF_CONDUCT.md

Need to develop a code of conduct that addresses open source etiquette and in-person event conduct

Example Issue for 3/3/17 workshop

{
  "title": "Solar Data, 10-kilometer",
  "maintainer": "National Renewable Energy Lab (NREL)",
  "maintainer_email": "[email protected]",
  "author": "GIS at NREL",
  "author_email": "[email protected]",
  "notes": "This data provides monthly average and annual average daily total solar resource averaged over surface cells of 0.1 degrees in both latitude and longitude, or about 10 km in size. This data was developed using the State University of New York/Albany satellite radiation model. This model was developed by Dr. Richard Perez and collaborators at the National Renewable Energy Laboratory and other universities for the U.S. Department of Energy. See http://www.nrel.gov/disclaimer.html for reuse restrictions.",
  "license_id": "restricted",
  "landingPage": "http://www.nrel.gov/gis/data_solar.html",
  "id": "D82A9773-81AF-4AF2-BF01-52CA2CF3BA22",
  "doi":"10.2172/1007346",
  "isPartOf": "Dynamic Maps, Geographic Information System (GIS) Data and Analysis Tools",
  "keyword": "GIS",
  "organization": {
    "description": "NREL's Geospatial Data Science Team analyzes renewable energy resources and many other data sources to determine which energy technologies are viable solutions across the globe and inputs the data into a geographic information system.",
    "title": "National Renewable Energy Lab (NREL)",
    "name": "NREL",
    "is_organization": true,
    "image_url": "",
    "type": "organization",
    "id": "NREL GIS"
    }
}

Consider persistent IDs

Maybe phase II, but you might consider including persistent IDs where we have them, for example for organizations you can use GRID IDs from Digital Science.

Conversely, as these records get created, what will their persistent IDs be?

[WIP] NOAA ESRL GMD CarbonTracker Ch4 (Methane)

Climate Mirror dataset title: NOAA ESRL GMD CarbonTracker Ch4 (Methane)

Climate Mirror issue: climate-mirror/datasets#308

Link to datafile: e.g.

Agency: National Oceanic & Atmospheric Administration (NOAA)

Agency Division: Oceanic and Atmospheric Research (OAR)

Agency Subdivision: Earth System Research Laboratory (ESRL)

Agency Sub-Subdivision: Global Monitoring Division (GMD)

Bulk Download Link: ftp://aftp.cmdl.noaa.gov:/products/carbontracker/ch4

Size Estimate: 68G

Data Type: "the NOAA CarbonTracker-CH4 Data Assimilation Product. . . . has been developed as a companion product to NOAA's CarbonTracker for CO2, with the goal of producing quantitative estimates of methane emissions into the atmosphere from natural and anthropogenic sources for North America and the rest of the world. CarbonTracker-CH4 emission estimates are consistent with observed patterns of CH4 in the atmosphere." - GMD CT website

Other URLS:
Carbontracker-CH4 2012 Download website
Carbontracker-CH4 2012 Release Notes

JSON:

{
  "name": "carbontracker-ch4-2012-fluxes",
  "title": "CarbonTracker-CH4 2012 Fluxes",
  "maintainer": "",
  "maintainer_email": "",
  "id": "",
  "metadata_created": "",
  "metadata_modified": "",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "notes": "Monthly average global surface fluxes available in NetCDF format. CarbonTracker-CH4 2012 covers the period 2000 through 2010",
  "license_id": "",
  "organization": {
    "description": "",
    "created": "",
    "title": "National Oceanic and Atmospheric Administration Earth System Research Laboratory",
    "name": "noaa-esrl-gov",
    "is_organization": true,
    "image_url": "https://www.esrl.noaa.gov/gmd/images/noaalogo2.png",
    "type": "organization",
    "id": ""
  },
  "resources": [
    {
      "url": "",
      "describedBy": "",
      "hash": "",
      "description": "",
      "format": "NC",
      "mimetype": "application/x-netcdf",
      "name": "",
      "created": "2012-03-05T00:00:00"
    }
  ]
}

Metadata: Billion-Dollar Weather and Climate Disasters

Climate Mirror dataset title: Billion-Dollar Weather and Climate Disasters

Climate Mirror issue: climate-mirror/datasets#14

Link to datafile: https://www.ncdc.noaa.gov/billions

Agency: National Oceanic & Atmospheric Administration (NOAA)

Agency Division: (NESDIS)

Agency Subdivision: (NCEI)

Agency Sub-Subdivision: (NCDC)

Bulk Download Link: ???

Size Estimate: ???

Data Type: "Quantification of dollar costs of climate disasters. Includes tabular and time series data of climate disasters, geographic data of disasters by state, pdf reports of individual disaster events, and research papers published from this data."

Citation: NOAA National Centers for Environmental Information (NCEI) U.S. Billion-Dollar Weather and Climate Disasters (2017). https://www.ncdc.noaa.gov/billions/

Other URLS:

JSON:

{
  "name": "billion-dollar-weather-and-climate-disasters",
  "title": "Billion-Dollar Weather and Climate Disasters",
  "maintainer": "NOAA National Centers for Environmental Information (NCEI)",
  "maintainer_email": "",
  "id": "",
  "metadata_created": "",
  "metadata_modified": "",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "notes": "Quantification of dollar costs of climate disasters. Includes tabular and time series data of climate disasters, geographic data of disasters by state, pdf reports of individual disaster events, and research papers published from this data.",
  "license_id": "public domain",
  "organization": {
    "description": "",
    "created": "",
    "title": "NOAA",
    "name": "",
    "is_organization": true,
    "image_url": "",
    "type": "organization",
    "id": null
  },
  "resources": [
    {
      "url": "https://www.ncdc.noaa.gov/billions/time-series.csv",
      "describedBy": "https://www.ncdc.noaa.gov/billions/time-series",
      "hash": "",
      "format": "csv",
      "mimetype": "",
      "name": "Billion-Dollar Disasters by Event Type and Year (1980-2016)",
      "created": ""
    },
    {
      "url": "https://www.ncdc.noaa.gov/billions/state-frequency-data.csv",
      "describedBy": "https://www.ncdc.noaa.gov/billions/mapping",
      "hash": "",
      "format": "csv",
      "mimetype": "",
      "name": "1980-2016 Billion-Dollar Weather and Climate Disasters By State",
      "created": ""
    },
    {
      "url": "https://www.ncdc.noaa.gov/billions/events.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "hash": "",
      "format": "pdf",
      "mimetype": "",
      "name": "Weather and Climate Billion-Dollar Disasters to affect the U.S. from 1980-2016",
      "created": ""
    },
    {
      "url": "https://www.ncdc.noaa.gov/billions/events",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "hash": null,
      "format": "html",
      "mimetype": null,
      "name": "Weather and Climate Billion-Dollar Disasters to affect the U.S. from 1980-2016",
      "created" : null
    },
    {
      "url": "https://www.ncdc.noaa.gov/monitoring-content/billions/docs/smith-and-matthews-2015.pdf",
      "describedBy": "http://dx.doi.org/10.1007/s11069-015-1678-x",
      "hash": null,
      "format": "pdf",
      "mimetype": null,
      "name": "Smith, A., and J. Matthews, 2015: Quantifying Uncertainty and Variable Sensitivity within the U.S. Billion-dollar Weather and Climate Disaster Cost Estimates. Natural Hazards. DOI: 10.1007/s11069-015-1678-x",
      "created": null
    },
    {
      "url": "https://www.ncdc.noaa.gov/monitoring-content/billions/docs/smith-and-katz-2013.pdf",
      "describedBy": "http://dx.doi.org/10.1007/s11069-013-0566-5",
      "hash": null,
      "format": "pdf",
      "mimetype": null,
      "name": "Smith, A., and R. Katz, 2013: U.S. Billion-dollar Weather and Climate Disasters: Data Sources, Trends, Accuracy and Biases. Natural Hazards. DOI: 10.1007/s11069-013-0566-5",
      "created": null      
    },
    {
      "url": "https://www.ncdc.noaa.gov/monitoring-content/billions/docs/lott-and-ross-2006.pdf",
      "describedBy": null,
      "hash": null,
      "format": "pdf",
      "mimetype": null,
      "name": "Lott, N., and T. Ross, 2006: Tracking and evaluating U. S. billion dollar weather disasters, 1980-2005. Preprints. AMS Forum: Environmental Risk and Impacts on Society: Successes and Challenges, Atlanta, GA, Amer. Meteor. Soc., 1.2.",
      "created": null
    },
    {
      "url": "https://www.ncdc.noaa.gov/monitoring-content/billions/docs/lott-and-ross-2003.pdf",
      "describedBy": null,
      "hash": null,
      "format": "pdf",
      "mimetype": null,
      "name": "Lott, N., and T. Ross, 2003: A Climatology of 1980-2003 Extreme Weather and Climate Events, Technical Report.",
      "created": null
    },
    {
      "name": "Colorado Flooding September 10-16 2013",
      "url": "http://www.nws.noaa.gov/oh/hdsc/aep_storm_analysis/8_Colorado_2013.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Sandy October 2012",
      "url": "http://www.nhc.noaa.gov/data/tcr/AL182012_Sandy.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Isaac August 2012",
      "url": "http://www.nhc.noaa.gov/data/tcr/AL092012_Isaac.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Midwest Flooding Summer 2008",
      "url": "https://www1.ncdc.noaa.gov/pub/data/extremeevents/specialreports/2008-Midwestern-US-Floods.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Spring Freeze April 2007",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr200801/tech-report-200801.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Katrina August 2005",
      "url": "https://www.ncdc.noaa.gov/oa/reports/tech-report-200501z.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Lili October 2002",
      "url": "http://www.nhc.noaa.gov/data/tcr/AL132002_Lili.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Western/ Eastern Severe Weather and Flooding Winter-Spring 1998",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9802/tr9802.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "West Coast Flooding December 1996-January 1997",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9701/tr9701.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Pacific Northwest Severe Flooding February 1996",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9602/tr9602.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Blizzard/ Floods January 1996",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9602/tr9602.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Opal October 1995",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9502/tr9502.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "California Flooding January-March 1995",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9501/tr9501.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Tropical Storm Alberto July 1994",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9403/tr9403.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Southeast Ice Storm February 1994",
      "url": "https://www.ncdc.noaa.gov/oa/pub/data/special/iwais96.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Southeast Drought/ Heat Wave Summer 1993",
      "url": "https://www.ncdc.noaa.gov/oa/climate/research/papers/summer93/weather.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Midwest Flooding Summer 1993",
      "url": "https://www.ncdc.noaa.gov/oa/climate/research/papers/summer93/weather.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "East Coast Blizzard and Severe Weather March 1993",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9301/tr9301.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Colorado Flooding September 10-16 2013",
      "url": "http://www.nws.noaa.gov/oh/hdsc/aep_storm_analysis/8_Colorado_2013.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Sandy October 2012",
      "url": "http://www.nhc.noaa.gov/data/tcr/AL182012_Sandy.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Isaac August 2012",
      "url": "http://www.nhc.noaa.gov/data/tcr/AL092012_Isaac.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Midwest Flooding Summer 2008",
      "url": "https://www1.ncdc.noaa.gov/pub/data/extremeevents/specialreports/2008-Midwestern-US-Floods.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Spring Freeze April 2007",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr200801/tech-report-200801.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Katrina August 2005",
      "url": "https://www.ncdc.noaa.gov/oa/reports/tech-report-200501z.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Lili October 2002",
      "url": "http://www.nhc.noaa.gov/data/tcr/AL132002_Lili.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Western/ Eastern Severe Weather and Flooding Winter-Spring 1998",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9802/tr9802.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "West Coast Flooding December 1996-January 1997",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9701/tr9701.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Pacific Northwest Severe Flooding February 1996",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9602/tr9602.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Blizzard/ Floods January 1996",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9602/tr9602.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Opal October 1995",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9502/tr9502.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "California Flooding January-March 1995",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9501/tr9501.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Tropical Storm Alberto July 1994",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9403/tr9403.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Southeast Ice Storm February 1994",
      "url": "https://www.ncdc.noaa.gov/oa/pub/data/special/iwais96.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Southeast Drought/ Heat Wave Summer 1993",
      "url": "https://www.ncdc.noaa.gov/oa/climate/research/papers/summer93/weather.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Midwest Flooding Summer 1993",
      "url": "https://www.ncdc.noaa.gov/oa/climate/research/papers/summer93/weather.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "East Coast Blizzard and Severe Weather March 1993",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9301/tr9301.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    }
  ]
}

Issue #220(subset) NASA GSFC Reflectivity Monitoring Data

Climate Mirror dataset title: NASA GSFC Ozone Monitoring Data #220

Climate Mirror issue: climate-mirror/datasets#220

Link to datafiles: ftp://toms.gsfc.nasa.gov/pub/omi/data/reflectivity/

Agency: NASA

Agency Division:

Agency Subdivision:

Agency Sub-Subdivision:

Bulk Download Link: e.g. ftp://toms.gsfc.nasa.gov/pub/omi/data/reflectivity/

Size Estimate:

Data Type: data/reflectivity/Yyyyy/L3_reflc_omi_yyyyMMDD.txt
Daily reflectivity data. Format similar to that of ozone data.

 The vales are in 3 digit groups 111222333444555
 Sample reflectivity value: `_83 = 83%          999=fill value`

Other URLS: https://mirrors.asun.co/climate-mirror/toms.gsfc.nasa.gov/pub/omi/data/ozone

JSON:

{
  "name": "Ozone Monitoring Instrument (OMI) / AURA level 3e Ozone data",
  "title": "Ozone Monitoring Instrument (OMI) / AURA",
  "maintainer": "Dr. Richard D. McPeters",
  "maintainer_email": "[email protected]",
  "id": "",
  "metadata_created": "2017-02-03T00:00:00.228971",
  "metadata_modified": "2017-02-03T00:00:00.228971",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "description": "
data/reflectivity/Yyyyy/L3_reflc_omi_yyyyMMDD.txt
     Daily reflectivity data. Format similar to that of ozone data.
 
     The vales are in 3 digit groups 111222333444555
     Sample reflectivity value: `_83 = 83%          999=fill value`",
  "notes":  " data source is ftp://toms.gsfc.nasa.gov/pub/omi/data/Level3e/ozone/ The following was copied from some similar-looking metadata for a differentlfy formatted dataset from the same probe source, but apparently stored in a different format. That URL:\n https://catalog.data.gov/dataset/omi-aura-surface-reflectance-climatology-level-3-global-0-5deg-lat-lon-grid-v003-56908 \n\n copypaste follows {"@type": "dcat:Dataset", "_id": {"$oid": "55942ab5c63a7fe59b49a710"}, "accessLevel": "public", "accrualPeriodicity": "irregular", "bureauCode": ["026:00"], "contactPoint": {"fn": "JENNIFER WEI, PH. D", "hasEmail": "mailto:[email protected]"}, "description": "The OMI Earth Surface Reflectance Climatology product, OMLER (Global 0.5deg Lat/Lon grid) which is based on Version 003 Level-1B top of atmosphere upwelling radiance and incoming irradiance, is now available ( http://disc.gsfc.nasa.gov/Aura/OMI/omler_v003.shtml ) from the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). \n                        \nOMI calibrated and geolocated radiances from 159 channels in UV1(264-311 nm), 557 channels in UV2 (307-383 nm) and 751 channels in VIS (349-504) spectral  regions, spectral irradiances, calibration measurements, and all derived geophysical atmospheric products (Level-2 and 3) are archived at the NASA Goddard DAAC.\n                              \n(The shortname for this OMI Level-3 Product is OMLER) \nThe lead algorithm scientists for this product are KNMI scientists Dr. Quintus Kleipool and Dr. Marcel Dobber.      \n                              \nOMLER spectral surface reflectance product contains monthly and yearly climatology of the Earth's surface Lambert Equivalent Reflectance (LER) for 23 wavelengths in the spectral range 309 to 500 nm, at a spatial resolution of 0.5 by 0.5 degrees. This LER is defined as the required reflectance of an isotropic surface needed to match the observed top of the atmosphere (TOA) reflectance in a pure Rayleigh scattering atmosphere under cloud free conditions and no aerosols. The climatology is based on statistical analysis of the three years of OMI version 03 radiance data (Oct 2004-Oct 2007).  This product also provides minimum spectral surface reflectivity observed for each 0.5 deg Lat/Lon grid during the three years period. \n                         \nThe OMLER product file is produced in Hierarchical Data Format (HDF-EOS5). It is roughly 300 MB in size. For browsing and extracting data from Aura data files, some software and tools have been made available from the Aura GES DISC tools site:    http://disc.gsfc.nasa.gov/Aura/tools.shtml\n                        \nA Readme document containing brief algorithm description and file spec provided by the OMLER Algorithm lead is available from the GES DISC data product site  http://disc.gsfc.nasa.gov/Aura/OMI/omler_v003.shtml", "distribution": [{"accessURL": "http://aura.gsfc.nasa.gov/instruments/omi/", "mediaType": "application/octet-stream"}], "identifier": "C180129150-GSFCS4PA__5", "isPartOf": "C180129150-GSFCS4PA", "issued": "2008-09-08T00:00:00.000Z", "keyword": ["EARTH SCIENCE", "ATMOSPHERE", "ATMOSPHERIC RADIATION"], "landingPage": "http://reverb.echo.nasa.gov/reverb?selected=C180129150-GSFCS4PA", "language": ["en-US"], "license": "http://www.usa.gov/publicdomain/label/1.0/", "modified": "2015-06-04T00:00:00.000Z", "programCode": ["026:001"], "publisher": {"name": "GESDISC", "subOrganizationOf": {"name": "National Aeronautics and Space Administration", "subOrganizationOf": {"name": "U.S. Government"}}}, "spatial": "-180.0 -90.0 180.0 90.0", "temporal": "2005-01-01T00:00:00Z/2009-12-31T23:59:59Z", "theme": ["geospatial"], "title": "OMI/Aura Surface Reflectance Climatology Level 3 Global 0.5deg Lat/Lon Grid V003"}",
  "license": "http://www.usa.gov/publicdomain/label/1.0/",
  "modified": "2014-06-11T11:36:24Z",
  "programCode": [
    "026:001"
  ],
  "publisher": {
    "@type": "org:Organization",
    "name": "National Aeronautics and Space Administration"
  },
  "organization": {
    "description": "",
    "created": "",
    "title": "NASA",
    "name": "National Aeronautics and Space Administration",
    "is_organization": true,
    "image_url": "https://www.nasa.gov/sites/all/themes/custom/nasatwo/images/nasa-logo.svg",
    "type": "organization",
    "id": ""
  },
  "resources": []
}

CONTRIBUTING.md

Need to develop a contributor guide

ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/imp1/

Climate Mirror dataset title: IMP-1 Datasets

Climate Mirror issue: climate-mirror/datasets#184

Link to datafile: ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/imp1/

Agency: NASA

Agency Division: NSSDC

Agency Subdivision:

Agency Sub-Subdivision:

Bulk Download Link: ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/imp1/

Size Estimate: Unknown

Data Type:

Other URLS:

JSON:

{
  "name": "imp1",
  "title": "Datasets from the IMP-1 satellite",
  "maintainer": "Natalia Papitashvili",
  "maintainer_email": "[email protected]",
  "id": "imp1",
  "metadata_created": "2017-02-04T02:54:40.863Z",
  "metadata_modified": "2017-02-04T02:54:40.863Z",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "url": "ftp://nssdcftp.gsfc.nasa.gov/pub/data/imp/imp1/",
  "notes": "This is several datasets from the Explorer 18 (IMP-1) satellite.",
  "license_id": null,
  "organization": {
    "title": "NASA",
    "name": "nasa",
    "is_organization": true
  }
}

http://climate.nkn.uidaho.edu/MACA/data_catalogs.php

Climate Mirror dataset title: MACA Downscaled Climate Data for CONUS

Climate Mirror issue: climate-mirror/datasets#50

Link to datafile: http://climate.nkn.uidaho.edu/MACA/data_catalogs.php

Agency: Idaho EPSCoR Office and the University of Idaho

Agency Division: Applied Climate Science Lab

Agency Subdivision: MACA

Bulk Download Link:
Size Estimate: 10TB

Data Type: This data series contains 540 temporal datasets of Downscaled Climate Model Output, using the Multivariate Adapted Constructed Analogs method, in netCDF format.

Other URLS:
https://catalog.data.gov/dataset/downscaled-climate-model-output-for-the-western-united-states-from-ipcc-ar4-scenarios-multivari
http://maca.northwestknowledge.net/
xml metadata: https://catalog.data.gov/harvest/object/64dac15e-b401-4bc2-a877-e345a296d71b

{
  "name": "MACA",
  "title": "Downscaled Climate Model Output for the Western United States from IPCC AR4 Scenarios [Multivariate Adaptive Constructed Analog (MACA) Method]",
  "maintainer": "Dr. John Abatzoglou, University of Idaho",
  "maintainer_email": "[email protected]",
  "id": "",
  "metadata_created": "",
  "metadata_modified": "",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "notes": "This data series contains 540 temporal datasets. Wildfire adheres to meteorological enablers and drivers across a spectrum of timescales. However, a majority of downscaling methods are ill suited for wildfire application due the lack of daily timescales and variables such as humidity and winds that are important for fuel flammability and fire spread. Two statistical downscaling methods, the daily Bias-Corrected Spatial Downscaling (BCSD) and the Multivariate Adapted Constructed Analogs (MACA), that directly incorporate daily data were validated over the Western United States with reanalysis data. While both methods outperformed the null interpolation only method, MACA exhibited additional skill in temperature, humidity, wind and precipitation due to its ability to jointly downscale temperature and dew point temperature and its use of analog patterns rather than interpolation. Both downscaling methods exhibited value added information in tracking fire danger indices and periods of extreme fire danger; however, due to its ability to more accurately capture relative humidity and winds, MACA outperformed the daily BCSD.",
  "license_id": "",
  "organization": {
    "description": "",
    "created": "",
    "title": "Idaho EPSCoR Office",
    "name": "",
    "is_organization": true,
    "image_url": "",
    "type": "organization",
    "id": ""
  },
  "resources": [
    {
      "url": "http://climate.nkn.uidaho.edu/MACA/data_catalogs.php",
      "describedBy": "http://climate.nkn.uidaho.edu/MACA/index.php",
      "hash": "",
      "description": "",
      "format": "netCDF",
      "mimetype": "application/x-netcdf",
      "name": "",
      "created": ""
    }
  ]
}

NOAA ESRL GMD CarbonTracker Lagrange (climate-mirror #310)

Climate Mirror dataset title: NOAA ESRL GMD CarbonTracker Lagrange

Climate Mirror issue: climate-mirror/datasets#310

Link to datafile:

Agency: National Oceanic & Atmospheric Administration (NOAA)

Agency Division: Oceanic and Atmospheric Research (OAR)

Agency Subdivision: Earth System Research Laboratory (ESRL)

Agency Sub-Subdivision: Global Monitoring Division (GMD)

Bulk Download Link: ftp://aftp.cmdl.noaa.gov/products/carbontracker/lagrange

Size Estimate: 1.3 T

Data Type: "CarbonTracker-Lagrange (CT-L) is a new regional inverse modeling framework currently under development and designed for estimating North American greenhouse gas emissions and uptake fluxes. CT-L uses surface sensitivity footprints from Lagrangian Particle Dispersion Models driven by high-resolution meteorological simulations. Surface fluxes are optimized for a consistency with a variety of in situ and remote sensing observations of CO2 using Bayesian and geostatistical inverse modeling techniques." - GMD CT L website

Other URLS:

Download CarbonTracker Lagrange Footprints (330 files): ftp://aftp.cmdl.noaa.gov/products/carbontracker/lagrange/footprints/ctl-na-v1.1
Inversion Software Documentation and Download: https://om.cmdl.noaa.gov/lpdm/doc/index.html

JSON:

{
  "name": "carbontracker-lagrange-footprints",
  "title": "CarbonTracker Lagrange Footprints",
  "url": "ftp://aftp.cmdl.noaa.gov/products/carbontracker/lagrange/footprints/ctl-na-v1.1/",
  "maintainer": "Arlyn Andrews",
  "maintainer_email": "[email protected]",
  "id": "",
  "metadata_created": "",
  "metadata_modified": "",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "notes": "This directory contains WRF-STILT footprints for North American CO2 and CH4 monitoring locations from June - August 2010. The footprints were produced as part of the CarbonTracker - Lagrange project with support from NOAA 's Climate Program Office via the Atmospheric Chemistry, Carbon Cycle, and Climate(AC4) Program and from NASA 's Carbon Monitoring System. Additional footprints are  available upon request for the period 2007 - 2010, including for GOSAT and TCCON measurement locations.",
  "license_id": "",
  "organization": {
    "description": "National Oceanic and Atmospheric Administration",
    "created": "",
    "title": "NOAA",
    "name": "noaa-gov",
    "is_organization": true,
    "image_url": "",
    "type": "organization",
    "id": ""
  }
}

C835FC18-219D-441A-9FD7-8F2F8649D4F8

{
    "Date_of_capture": "Sat Feb 11 2017 16:08:27 GMT-0800 (PST)",
    "Resource_title": "Toxic Substances Control Act (TSCA) Chemical Substance Inventory",
    "url": "https://epa.gov/tsca-inventory/how-access-tsca-inventory",
    "Source_of_funding": "Federal",
    "Branch_of_government": "Executive",
    "Maintaining_body": "Environmental Protection Agency",
    "Maintaining_body_textual_site": "http://www.usa.gov/federal-agencies/environmental-protection-agency",
    "Maintenance_of_confidential_info": "EPA Office of Pollution Prevention and Toxics",
    "Update_Frequency": "Biannual",
    "Access_level": "Public",
    "File_formats_in_package": "ZIP, CSV, MS Access",
    "Individual_source_or_seed_URL": "https://epa.gov/tsca-inventory/how-access-tsca-inventory",
    "Institution_facilitating_the_data_capture_creation_and_packaging": "University of California, Berkeley",
    "Name_of_package_creator": "akokai",
    "Github_scraping_repo": "https://github.com/akokai/chemex",
    "Package_content_description": "Public reports from manufacturers, processors and importers of chemical substances manufactured, processed, imported into the US. Excludes confidential chemical identities.",
    "Purpose_of_database": "To ensure that chemicals manufactured, imported, processed, or distributed in commerce, or used or disposed of in the United States do not pose any unreasonable risks to human health or to the environment",
    "Written_standards": "TSCA Inventory Reporting Rule a.k.a. Chemical Data Reporting Rule",
    "Location_of_written_standards_info": "https://www.epa.gov/chemical-data-reporting",
    "Contains_confidential_info": "FALSE",
    "Confidentiality_note": "Confidential information contained in continuously updated TSCA Master Inventory File",
    "UUID": "C835FC18-219D-441A-9FD7-8F2F8649D4F8",
    "recommended_approach": "There are links to Microsoft Access and CSV versions of the files from the latest inventory.",
    "Free_text_description_of_capture_process": "Download files individually",
    "Copyright_or_license": "17 U.S.C. § 105",
    "Copyright_or_license_url": "https://edg.epa.gov/EPA_Data_License.html",
    "Date_of_creation": "December_23_1977",
    "Number_of_documented_chemical_substances": "83000"
}

http://www.ndbc.noaa.gov/

{
"title":"National Data Buoy Center - Center of Excellence in Marine Technology"
"landingPage": "http://www.ndbc.noaa.gov/station_history.php?station=58907",
"author": "University of Washington - APL,
"author_email": null,
"id": "ff9ae098-eccc-41d8-bfcd-5e8ed047db05",
"tags": "NWS",
"Name of resource": "National Data Buoy Center",
"organization": {
"description": "
NDBC Virtual Tour
Our Mission and Staff
Welcome to the National Oceanic and Atmospheric Administration (NOAA) National Data Buoy Center (NDBC), a part of the National Weather Service (NWS). NDBC designs, develops, operates, and maintains a network of data collecting buoys and coastal stations. NDBC's virtual tour will give you an overview of what NDBC does, the facilities, the atmospheric and oceanographic variables measured, and the use of these data.",
"title": "National Weather Service",
"name": "National Data Buoy Center",
"is_organization": true,
"type": "organization"
}
}

Dataset at ftp:/podaac.jpl.nasa.gov/allData/jason1 #205

This FTP site actually consists of multiple datasets that are already in data.gov: https://catalog.data.gov/dataset?q=GHRSST - I've already responded to the issue on climate-mirror

daniellecrobinson / data-rescue-pdx Goto Github PK

data-rescue-pdx's Introduction

From Enoki:

Customization

data-rescue-pdx's People

Contributors

Stargazers

Watchers

Forkers

data-rescue-pdx's Issues

Recommend Projects

Recommend Topics

Recommend Org