Convergence And Trust in Earth and Space Science Data Systems Ted Habermann, NOAA National Geophysical Data Center Documentation: It’s not just discovery... 50% change in global average Why?

O&M 1.0 WXXM 1.0 CSML 1.0 Unidata CDM CSML 2.X Unidata CDM Aligned with Unidata CDM Aligned with O&M 2.0 WXXM Builds on CSML 3.X (XML encoding) (Binary encoding) O&M 1.0 WXXM 1.1 WXXM 2.X O&M 2.0 CSML 3.X Convergence: Data

The Open Geospatial Consortium (OGC®) membership has approved the OGC Network Common Data Form(netCDF) Core Encoding Standard, and netCDF Binary Encoding Extension Standard - netCDF Classic and 64-bit Offset Format as official OGC standards.

Data and Information: End-to-End Process Data ProducersConsumersCommunity InformationKnowledgeWisdom Variables and Properties Multiple Dialects Persistence vs. Transport Standards and Conventions Spiral Development Spatial/Temporal Data Systems Data to Information Concept Mapping Hierarchical Organizations Training Evolution Many concepts have been well developed and successfully implemented to achieve (or at least improve) data interoperability. Can the same concepts facilitate interoperable information?

Documentation Repository ISO 19115, , and extensions Documentation Repository ISO 19115, , and extensions THREDDS netCDF DIF, FGDC, Data.Gov DIF, FGDC, Data.Gov SensorML WCS, WMS, WFS, SOS ISO KML Documentation in Multiple Dialects Convergence

Multiple Dialects: THREDDS Data Server THREDDS Catalog THREDDS Catalog file1.nc file2.nc file3.nc file4.nc file1.nc file.nc file2.nc file.nc THREDDS Catalog THREDDS Catalog THREDDS Catalog THREDDS Catalog Extract Data OPeNDAP WMS WCS NcML ISO ACDD and Metadata Server

Documentation in Three Dialects ISO ACDD NcML wiki/index.php?title=NcISO group/ncisometadata

TIME Disruption Convergence: Community Era of Ferment: high risks, uncertainty, considerable waste and no interoperability Selection The community grows. The rate of progress increases because community energy is focused. Developments are supportive and cumulative. PROGRESSPROGRESS

TIME netCDF 1988 NetCDF - COARDS - CF Climate-Forecast Conventions PROGRESSPROGRESS The CF Conventions are very well supported by the community and by tools. They make it easy for new groups to use netCDF effectively. COARDS 1995

TIME ISO Adoption by US Agencies PROGRESSPROGRESS We are at a critical point. The ISO Metadata Standards are being adopted by many U.S. Agencies, but no conventions have been developed. The future is uncertain. ?

Convergence: Community GOES-R: NOAA and NASA Federal Coordinator for Meteorology Metadata Joint Action Committee The Joint Action Group recommends that the Federal departments and agencies adopt ISO and SensorML as weather observation metadata standards and participate in the process of implementing those standards across the national weather enterprise. Federal Coordinator for Meteorology Metadata Joint Action Committee The Joint Action Group recommends that the Federal departments and agencies adopt ISO and SensorML as weather observation metadata standards and participate in the process of implementing those standards across the national weather enterprise. Chapter VI - Other Post Award Requirements and Considerations 4. Dissemination and Sharing of Research Results b. Investigators are expected to share with other researchers, at no more than incremental cost and within a reasonable time, the primary data, samples, physical collections and other supporting materials created or gathered in the course of work under NSF grants. Grantees are expected to encourage and facilitate such sharing. AMS Metadata Policy Working Group Recommendations: The AMS should adopt ISO and SensorML as the metadata standards for the Nationwide Network of Networks. In coordination with other organizations within the broader atmospheric and oceanic sciences community, the AMS should provide opportunities for its members to become better educated on the nomenclature, structure, and implementation of metadata and the standards recommended above. The AMS should establish a permanent committee to serve as a body of experts … to provide advice to organizations working to implement a Nationwide Network of Networks and to coordinate with the Federal Committee for Integrated Observing Systems (CIOS). AMS Metadata Policy Working Group Recommendations: The AMS should adopt ISO and SensorML as the metadata standards for the Nationwide Network of Networks. In coordination with other organizations within the broader atmospheric and oceanic sciences community, the AMS should provide opportunities for its members to become better educated on the nomenclature, structure, and implementation of metadata and the standards recommended above. The AMS should establish a permanent committee to serve as a body of experts … to provide advice to organizations working to implement a Nationwide Network of Networks and to coordinate with the Federal Committee for Integrated Observing Systems (CIOS).

A Documentation Consortium DOC NSF NASA USGS DOE A consortium is an association of two or more organizations to participate in a common activity or pooling their resources for achieving a common goal: to enhance the exchange, understanding and use of Earth-systems data across disciplinary and international boundaries. Initially to coordinate and facilitate the transition to effective use of ISO Documentation Standards. A consortium is an association of two or more organizations to participate in a common activity or pooling their resources for achieving a common goal: to enhance the exchange, understanding and use of Earth-systems data across disciplinary and international boundaries. Initially to coordinate and facilitate the transition to effective use of ISO Documentation Standards. Standards Training Tool Adoption & Development

Designated Communities - Users Data preservation is communicating with the future

What Makes Data Trustworthy?

Questions?