Global Monitor requirements on Global Discovery Catalogue

[tomkralidis]

Global Monitor requirements on Global Discovery Catalogue

[kaiwirt]

@tomkralidis You can add your proposed metrics here
https://github.com/wmo-im/wis2-metric-hierarchy/tree/main/metric-hierarchy

I think the KPI's would be valuable as well as the number of metadata and maybe the update frequency.

[tomkralidis]

TT-WISMD 2023-09-13:

• GDC reports (monthly)
  • metadata
    • pass/fail by centre
    • KPI results by centre
      • overall number by centre
      • score/grade per document per centre
      • documents per centre/country
      • documents per Earth system discipline
  • API
    • most popular search terms
    • number of core / recommended datasets
    • number of requests

[tomkralidis]

cc @antje-s

[antje-s]

Added a first proposal
https://github.com/wmo-im/wis2-metric-hierarchy/blob/main/metric-hierarchy/gdc.csv
Currently used:

• percentage instead of grade/score (easy to understand and compare)
• no total number, since this corresponds to the sum of core + recommended or passed + failed
  Not yet included:
• KPI - documents per Earth system discipline
  Perhaps more relevant total number of metadata records per Earth system discipline instead of KPI value?

[tomkralidis]

TT-WISMD 2023-10-06:

• @antje-s to provide example OpenMetrics payload (open new issue RE: metrics requirements for GDCs)

[antje-s]

• Some general information about openmetrics can be found at https://github.com/OpenObservability/OpenMetrics/blob/main/specification/OpenMetrics.md
• Our GC metrics are one regular example, which can be accessed at https://opendata.dwd.de/test/wis2/cache/metrics/globalcache/gc_metrics.txt

Example:
# HELP wmo_wis2_gc_downloaded Amount of downloaded file
# TYPE wmo_wis2_gc_downloaded gauge
wmo_wis2_gc_downloaded{centre_id="all",country="all",report_by="dwd"} 546701.0
wmo_wis2_gc_downloaded{centre_id="gts_to_wis2_dwd",country="xxg",report_by="dwd"} 0.0
wmo_wis2_gc_downloaded{centre_id="dwd",country="deu",report_by="dwd"} 357.0
wmo_wis2_gc_downloaded{centre_id="swic",country="xxg",report_by="dwd"} 38377.0
...

Short description of the structure:
# HELP my_description
# TYPE metric_type
my_metric_name{my_label1=label1_value,my_label2=label2_value} metric_value
(Comment: Our values provided online also contain the timestamp of the metric value at the end of the line)

[tomkralidis]

@antje-s thanks; can you add a minimal example based on the proposed GDC metrics?

[antje-s]

e.g.

# HELP wmo_wis2_gdc_passed_total Number of metadata records passed validation
# TYPE wmo_wis2_gdc_passed_total gauge
wmo_wis2_gdc_passed_total{centre_id="dwd",report_by="ca-eccc-msc"} 4
wmo_wis2_gdc_passed_total{centre_id="eumetsat",report_by="ca-eccc-msc"} 5
...
# HELP wmo_wis2_gdc_failed_total Number of metadata records failed validation
# TYPE wmo_wis2_gdc_failed_total gauge
wmo_wis2_gdc_failed_total{centre_id="dwd",report_by="ca-eccc-msc"} 2
wmo_wis2_gdc_failed_total{centre_id="eumetsat",report_by="ca-eccc-msc"} 2
...

(one label for each center)