1. Delivering Digital Services US Weather Standards and Codes Presented By: Matt Peroutka Aaron Braeckel Steve Olson Date:August 28, 2014

2. Concise History July 2011: WMO’s Commission for Basic Systems authorized a task team to create “XML representation of weather data” November 2013: AvXML version 1.0 posted to http://schemas.wmo.int http://schemas.wmo.int January 2014: IWXXM-US version 1.0 posted to http://nws.weather.gov/schemas/http://nws.weather.gov/schemas/ 2 2

3. Motivation Unique regional requirements in US Requirements fulfilled and documented in Traditional Alphanumeric Codes (TAC) via filed differences 3 3

4. Guiding Principles for IWXXM-US Support all filed differences maintained by the US for METAR, SPECI, TAF, and SIGMET Enable the development of straightforward techniques that convert products from US- specific formats to formats that comply with international standards 4 4

5. Implementation of IWXXM-US Extensions to IWXXM Regional namespace http://nws.weather.gov/schemas/IWXXM-US/1.0/Release http://nws.weather.gov/schemas/IWXXM-US/1.0/Release Three data models/schemas – usMetarSpeci.xsd – usSigmet.xsd – usTaf.xsd 5 5

6. IWXXM-US Schemas and Code Tables http://nws.weather.gov/schemas/IWXXM-US/1.0/Release/ http://nws.weather.gov/codes/ 6 6

7. IWXXM-US Re-use of IWXXM constructs and style, where possible Use of appinfo and quantity attribute, as in IWXXM Use of code lists and vocabulary attribute, as in IWXXM 7 7

8. Sea Level Pressure in usMetar.xsd 8 8 http://codes.wmo.int/common/c-15/me/pressureReducedToMeanSeaLevel

9. Pressure Tendency Characteristic in usMetar.xsd 9 9 http://codes.wmo.int/bufr4/codeflag/0-10-063 none

10. Sea Level Pressure in Example US METAR 10 1008.3 6.2

11. US Codes 11 US Codes needed for IWXXM-US and other US products (MDCRS, PIREP, etc.) Codes so far taken from: Federal Meteorological Handbook National Weather Service Instruction (NWSI) publications

12. WMO Codes Registry 12 Authoritative, publicly-accessible definitions Relationships between concepts (links, sub-types, etc.) Semantics (Skos - TTL, RDF) Code management policies (defined lifecycle, deprecated concepts, etc.) Allows for distributed management and/or authorities

13. Status 13 Textual codes available at http://nws.weather.gov/codes/http://nws.weather.gov/codes/ Registry prototyping also underway

14. Codes Encoding 14 US Codes populated on an as-needed basis so far Analyze documentsDistill specific list of codesReview with US weather agenciesEncode in some technical form (e.g., semantic triples)Make available through web pages or a codes registry A single sustained effort to fully encode each document would probably save effort

15. Guiding Principles for creating Metadata records for NOAA wx Data Strong Governance – NAO 212-15 and procedural directives Adherence to ISO and OGC standards – Best way to ensure compatibility between difference types of web services supporting metadata records – Enables flexibility in data discovery methodologies (CSW, Reg/Rep, CKAN, etc.) Providing the proper set of tools and training resources – Enable creation, maintenance, conformance, and transformation of records. 15

16. Strong Governance The role of NOAA Administrative Order (NAO) 212-15 NOAA Administrative Order (NAO) 212-15, Management of Environment Data and Information, states environmental data be managed based upon a lifecycle that includes a data management plan. It also helped establish the Department of Commerce (DOC) National Oceanic and Atmospheric Administration (NOAA) Environmental Data Management Policy. NOAA has approved procedural directives for: – Data Documentation (https://www.nosc.noaa.gov/EDMC/PD.DD.php) – Data Management (https://www.nosc.noaa.gov/EDMC/PD.DMP.php) – Data Sharing for NOAA Grants (https://www.nosc.noaa.gov/EDMC/PD.DSP.php) – Data Archival (https://www.nosc.noaa.gov/EDMC/documents/NOAA_Procedure_document_final_ 12-16-1.pdf) – Data Access and Data Citation are in development 16

17. Strong Governance (Cont’d) NOAA Data Documentation Procedural Directive established the ISO 19115 parts 1 and 2 and 19139 as the recommended standards for data and information Approved by NOAA’s Environmental Data Management Committee in Oct 2011 Recommends development of common metadata management tools including mechanisms for evaluating the completeness and quality of data documentation Weekly and monthly collaboration activities across the various NOAA line offices 17

18. Adherence to standards ISO Technical Committee 211 Geographic information/Geomatics (TC211) is responsible for the ISO geographic information series of standards.TC211 18 StandardTopic ISO 19115Geographic information – metadata ISO 19115-2Geographic information — Metadata - Part 2: Extensions for imagery and gridded data ISO 19119Metadata for services ISO 19139Metadata - XML schema implementation

19. Upcoming changes to standards ISO 19115-* XML Schema/Transform Status 19115-3 XML schemas implementation of 19115 -1, 19115-2 and related standards. ISO 19115-1 and 19115-2 will be the conceptual models Transform – 19115/19115-2 / 19139 to 19115-3 is done and validates against schema. It’s available on public github. Future revised version of ISO 19139 will contain only encoding rules, no UML Expected to be a International Standard by May 2015 19157-2 Data Quality XML encoding Transform done – included in 19115/19115-2 / 19139 to 19115-3 One Key to transition is XSLT stylesheet transforms19

20. NOAA Metadata Training and Tool Resources Training – NCDDC Metadata Training Webinars – (http://www.ncddc.noaa.gov/metadata-standards/metadata-training/) Tools – EMMA webpage – (http://www.ngdc.noaa.gov/metadata/emma/index.html) Has links to all metadata tools (guidance, authorship, component management, translation, validation, and metrics and reporting) – EDM Dashboard -- (https://sites.google.com/a/noaa.gov/edm- dashboard/home) Show the status and progress of activities guided by the National Oceanic and Atmospheric Administration (NOAA) Environmental Data Management Committee (EDMC). – NGDC Metadata Wiki webpage Goto guide for metadata management – ISO Explorer Goto guide for ISO Metadata – Rubric Scoring for metadata completeness and compliance 20

21. Questions 21

22. Contact Information Matt Peroutka National Weather Service Office of Science and Technology Matthew.Peroutka@noaa.gov +1 301-713-1768 x144 Aaron Braeckel National Center for Atmospheric Research braeckel@ucar.edu +1 303-497-2806 Steve Olson National Weather Service Office of Science and Technology Steve.R.Olson@noaa.gov +1 301-713-0056 x190 22