Sharing Metadata Recommendations Ted Habermann, John Kozimor Earth Science The HDF Group 1 John Farley Raytheon.

Slides:



Advertisements
Similar presentations
GEOSS ADC Architecture Workshop Break-out summary: Clearinghouse, Catalogs, and Registries Doug Nebert U.S. Geological Survey February.
Advertisements

NASA Earth Science Data Preservation Content Specification H. K. (Rama) Ramapriyan John Moses 10 th ESDSWG Meeting – November 2, 2011 Newport News, VA.
FGDC & ISO: What is the Current Status and Considerations when Moving Forward? Viv Hutchison USGS Core Science Systems November 10, 2010 Salem, OR.
Matthew Cechini Raytheon - EED ID: IN31C-07.  ECHO Metadata Overview  Introduction  Problem Space  Solutions ISO Lessons Learned – Perceived.
The HDF Group ESIP Summer Meeting HDF-Java Overview Joel Plutchak The HDF Group 1 July 8 – 11, 2014.
The HDF Group HDF4 Mapping Status and Proposal Mike Folk, Ruth Aydt The HDF Group Oct. 17, 2012 Apr , 2012HDF/HDF-EOS Workshop XV.
Connecting HDF And ISO Metadata Ted Habermann, NASA/ESDIS Hook Hua, Barry Weiss, NASA/Jet Propulsion Lab Mike Folk, Gerd Heber, Elena Pourmal, The HDF.
NASA Agency Report Ken McDonald NASA May 2002
TC3 Meeting in Montreal (Montreal/Secretariat)6 page 1 of 10 Structure and purpose of IEC ISO - IEC Specifications for Document Management.
1 ISO – Metadata Next Generation International consensus being built on structured metadata within a broader Geomatics Standard under ISO Technical.
Discovering Earth Science Tools, Software, and Models through the CEOS IDN Tyler Stevens IDN GIS/Services Coordinator
NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.
Introduction to Geospatial Metadata – FGDC CSDGM National Coastal Data Development Center A division of the National Oceanographic Data Center Please .
Documentation Developments Ted Habermann, NOAA/NESDIS/NGDC Adoption of ISO Metadata Standards - Crossing the Chasm Facilitating the Transition Documentation.
The HDF Group July 8, 2014HDF 2014 ESIP Summer Meeting HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann The.
05 December, 2002HDF & HDF-EOS Workshop VI1 SEEDS Standards Process Richard Ullman SEEDS Standards Formulation Team Lead
EOSDIS User survey follow-up Mike Folk, Kent Yang, Elena Pourmal The HDF Group Oct. 17, 2012 Annual HDF Briefing to ESDIS1.
Creating Documentation and Metadata: Metadata for Discovery Lola Olsen 1, Tyler Stevens 2, 1 National Aeronautics and Space Administration (NASA) 2 Wyle.
DM_PPT_NP_v01 SESIP_0715_AJ HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann Gerd Heber, John Readey, Joel Plutchak The HDF Group HDF.
North American Profile: Partnership across borders. Sharon Shin, Metadata Coordinator, Federal Geographic Data Committee Raphael Sussman; Manager, Lands.
Creating Documentation and Metadata: Metadata for Discovery Lola Olsen 1, Tyler Stevens 2, 1 National Aeronautics and Space Administration (NASA) 2 Wyle.
ATMOSPHERIC SCIENCE DATA CENTER ‘Best’ Practices for Aggregating Subset Results from Archived Datasets Walter E. Baskin 1, Jennifer Perez 2 (1) Science.
Metadata and Geographical Information Systems Adrian Moss KINDS project, Manchester Metropolitan University, UK
1/14/200925th IIPS Conference 1 Challenges to Archive and Access NASA HDF-EOS Data in the long Term MuQun Yang (The HDF Group) Choonghwan Lee (The HDF.
GLOBAL BIODIVERSITY INFORMATION FACILITY Éamonn Ó Tuama Senior Programme Officer, IDA 21 June Metadata publishing with the IPT.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California Leveraging Metadata.
Archival Information Packages for NASA HDF-EOS Data R. Duerr, Kent Yang, Azhar Sikander.
Metadata Implementation Ted Habermann NOAA National Geophysical Data Center Documentation: It’s not just discovery... 50% change in global average Why?
Documentation from NcML to ISO Ted Habermann, NOAA NESDIS NGDC.
EOSDIS Status 9/29/2010 Dan Marinelli, NASA GSFC
Consolidated Metadata Repository (CMR) Status and Look Ahead CWIC 2015 Annual Meeting, February 18-19, 2015 This work was supported by NASA/GSFC under.
What is CWIC? Authors: Doug Newman Andrew Mitchell
Using the Global Change Master Directory (GCMD) to Promote and Discover ESIP Data, Services, and Climate Visualizations Presented by GCMD Staff January.
- 1 - HDF5, HDF-EOS and Geospatial Data Archives HDF and HDF-EOS Workshop VII September 24, 2003.
Using Portals and Registries: Publishing Metadata to GCMD Lola Olsen 1, Tyler Stevens 2, 1 National Aeronautics and Space Administration (NASA) 2 Wyle.
ESDIS METADATA ARCHITECTURE STUDY DISCUSSION Presented by Kevin Murphy and the Metadata Architecture Study Team Members 2013 ESIP Summer Meeting | Chapel.
Canadian IDN Status Report Brian McLeod, Martine Rocheleau Cameron Wilson and Christine Therriault CCRS, Natural Resources Canada CEOS WGISS Plenary and.
Laura Russell Programmer VertNet Buenos Aires (Argentina) 28 September 2011 Training course on biodiversity data publishing and.
Documenting UAF Data Ted Habermann NOAA/NESDIS/National Geophysical Data Center.
GeoTIFF – An OGC and NASA Standard John Kozimor, Ted Habermann The HDF Group Earth Science 1.
ARMAP, AOV, ISO Metadata, and RESTful Architectures for Data Sharing and Interoperability IASC/SAON Arctic Data Committee meeting 26 October, 2015.
, GCMD: DIF to ISO Translation and CSW Support Scott Ritz WYLE Information Systems NASA Global Change Master Directory Science Team Leader
ECS Metadata Considerations for Preservation SiriJodha S. Khalsa National Snow and Ice Data Center.
Metadata Training for SEFSC Science Staff Part Two.
More Information Working Group Composition End Users Data Modelers Data Analysts Airborne Measurement Scientists Airborne Instrument Scientists Data Management.
The HDF Group November 3-5, 2009HDF/HDF-EOS Workshop XIII1 The New HDF-EOS Web Site - How it can help you Kent Yang, Joe Lee The HDF Group.
The Proliferation of Metadata Standards and the Evolution of NASA’s Global Change Master Directory (GCMD) Standard for Uses in Earth Science Data Discovery.
Convergence And Trust in Earth and Space Science Data Systems Ted Habermann, NOAA National Geophysical Data Center Documentation: It’s not just discovery...
Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.
What is ECHO? ECHO Open Search ECHO Facts NASA’s Earth Observing System ClearingHOuse (ECHO) acts as the core metadata.
Advertising your data Alecia Aleman 1, Ruth Duerr 2 1 National Aeronautics and Space Administration (NASA) 2 National Snow and Ice Data Center, University.
ESO and the CMR Life Cycle Process Winter ESIP, Jan 2015 ESDIS Standards Office (ESO) Yonsook Enloe Allan Doyle Helen Conover.
New Dog You Met Conventions Ted Habermann NOAA EDMC May 2012 Data needs to be in tools Document.
The Earth Information Exchange. Portal Structure Portal Functions/Capabilities Portal Content ESIP Portal and Geospatial One-Stop ESIP Portal and NOAA.
1 Raytheon EED Program | ECHO Technical Interchange 2013.
ECHO AND ISO ECHO Technical Interchange Meeting April 30 & May 1, 2013 Raytheon EED Program | ECHO Technical Interchange 2013.
CEOS Working Group on Information System and Services (WGISS) Data Access Infrastructure and Interoperability Standards Andrew Mitchell - NASA Goddard.
ESDIS Standards Office Yonsook Enloe, CTSI 3/2/ FGDC Meeting1.
10 th GHRSST Science Team Meeting Santa Rosa, CA 3 June 2009.
Can Data be Organized for Science and Reuse?
Session 3A: Catalog Services and Metadata Models
CAP-378 and “Conhecer para não ignorar”
Big Earth Data Initiative (BEDI) Metadata Improvement: Case Studies
Common Framework for Earth Observation Data
Identifiers Answer Questions
HDF Support for NASA Data Producers
Incorporating ISO Metadata Using HDF Product Designer
A Case Study for Synergistically Implementing the Management of Open Data Robert R. Downs NASA Socioeconomic Data and Applications.
HDF5 Tools Updates and Discussions
This material is based upon work supported by the National Science Foundation under Grant #XXXXXX. Any opinions, findings, and conclusions or recommendations.
Presentation transcript:

Sharing Metadata Recommendations Ted Habermann, John Kozimor Earth Science The HDF Group 1 John Farley Raytheon

Metadata Recommendations 2 There are many published lists of metadata fields that are required or suggested for addressing a particular documentation need (e.g. discovery, access, use). We call these recommendations. Recommendations generally come from organizations and are many times associated with a specific metadata dialect.

Directory Interchange Format 3 Required Recommended Suggested

Recommendation Pages 4 CONCEPTSCONCEPTS CONCEPTSCONCEPTS Implementation (dialects) Recommendation References Recommendation References Data Discovery – 8 recommendations Data Accessibility/Usability (Services) – 3 recommendations Data Understanding – 6 recommendations

Recommendations / Capabilities Data Discovery ACDD - Highly Recommended, Recommended, Suggested CSW - Core Queryables, Core Returnables, Additional Queryables ISO Resource Discovery Mandatory, Optional, Conditional (Annex F) DCAT Mandatory EOS Core System (HDF-EOS Core) DIF – Required, Highly Recommended ECHO – Mandatory, Recommended FGDC – Mandatory Recommendations Capabilities Accessibility / Usability SERF – Required, Highly Recommended ISO Service Discovery ACDD – Variable Attributes EOS Core System (HDF-EOS Structural) Understanding Data Quality (ISO 19157) Provenance (ISO ) FGDC – Mandatory if Applicable External References ( ) User Feedback EOS Core System (Archive Metadata)

Terminology Spiral – A collection of concepts required to support a particular documentation need or use case. Name Location Description Type

Recommendations, Concepts and Spirals 7 Different users will want to create/examine guidance based on different sets of recommendations. Spiral Concept Spiral Concept Attribute Convention for Data Discovery (ACDD) Catalog Services for the Web (CSW) Recommendations

Recommendations, Concepts and Spirals 8 Spiral Concept Spiral Concept Attribute Convention for Data Discovery (ACDD) Catalog Services for the Web (CSW) Directory Interchange Format (DIF) Recommendations Different users will want to create/examine guidance based on different sets of recommendations. Concept Scores depend on the selected recommendations – the selection scenarios.

Dialects 9 NASA Directory Interchange Format (DIF) EOSDIS Clearinghouse (ECHO) EOS Core System (ECS) Service Entry Resource Format (SERF) Other Data Catalog Vocabulary (DCAT) FGDC Content Standard for Geospatial Metadata (CSDGM) ISO and ISO / ISO and ISO (ISO) ISO / ISO (ISO-1) Our report will include results from eight dialects: Each concept in a recommendation could be represented in any number of dialects.

10 ItemScoreRec 1Rec 2Rec 3 Concept 12xx Concept 21x Concept 32xx Concept 43xxx Union of concepts from all recommendations Concepts in each recommendation Concept score for recommendation set Recommendation Comparison How do Mandatory DIF and FGDC Concepts compare?

Dialect Comparison 11 ItemDialect 1Dialect 2Dialect 3 Concept 1xx Concept 2x Concept 3xx Concept 4xx Union of concepts from all dialects Concepts in each dialect How do DIF and ISO-1 capabilities compare?

Dialect / Recommendation Comparison 12 RecommendationDialect 1Dialect 2Dialect 3 Concept 1xx Concept 2x Concept 3xx Concept 4xx Maximum Possible Score 232 All concepts in a recommendation Concepts in each dialect How do FGDC, ISO, and ECHO compare to DCAT recommendation?

13 Questions?

Acknowledgements 14 This work was partially supported by contract number NNG10HP02C from NASA. Any opinions, findings, conclusions, or recommendations expressed in this material are those of the author and do not necessarily reflect the views of NASA or The HDF Group.