Adoption of RDA-DFT Terminology and Data Model to the Description and Structuring of Atmospheric Data Aaron Addison, Rudolf Husar, Cynthia Hudson-Vitale.

Slides:



Advertisements
Similar presentations
Geoscience Information Network Stephen M Richard Arizona Geological Survey National Geothermal Data System.
Advertisements

REASoN REASoN Project to link NASA's data, modeling and systems to users in research, education and applications Application of NASA ESE Data and Tools.
IRS XML Standards & Tax Return Data Strategy For External Discussion June 30, 2010.
1 Metadata Data Foundation and Terminology RDA-P5 San Diego - Keith Jeffery.
NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.
RDA Data Foundation and Terminology (DFT) IG: Introduction Prepared for RDA Plenary San Diego, March 9, 2015 Gary Berg-Cross, Raphael Ritz, Co-Chairs DFT.
OCLC Online Computer Library Center A Global OpenURL Resolver Registry Phil Norman OCLC Dlsr4lib Workshop March 23 rd, 2006 Arlington VA.
Introduction to Geospatial Metadata – FGDC CSDGM National Coastal Data Development Center A division of the National Oceanographic Data Center Please .
RDA Wheat Data Interoperability Working Group Outcomes RDA Outputs P5 9 th March 2015, San Diego.
Metadata (for the data users downstream) RFC GIS Workshop July 2007 NOAA/NESDIS/NGDC Documentation.
DATA FOUNDATION TERMINOLOGY WG 4 th Plenary Update THE PLUM GOALS This model together with the derived terminology can be used Across communities and stakeholders.
RDA Data Foundation and Terminology (DFT) IG: Introduction Prepared for RDA Plenary San Diego, March 9, 2015 Gary Berg-Cross, Raphael Ritz, Co-Chairs DFT.
RDA Data Foundation and Terminology (DFT) IG: Introduction Prepared for RDA 6 th Plenary Paris, Sept. 25, 2015 Gary Berg-Cross, Raphael Ritz Co-Chairs.
GCMD/IDN STATUS AND PLANS Stephen Wharton CWIC Meeting February19, 2015.
References: [1] [2] [3] Acknowledgments:
Data Fabric IG Introduction. 2  about 50 interviews & about 75 community interactions  Data Management and Processing is too time consuming and costly.
ET-ADRS-1, April ISO 191xx series of geographic information standards.
TWC Adoption of RDA DTR and PID in Deep Carbon Observatory Data Portal Stephan Zednik, Xiaogang Ma, John Erickson, Patrick West, Peter Fox, & DCO-Data.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
Linking Tasks, Data, and Architecture Doug Nebert AR-09-01A May 2010.
FEA DRM Management Strategy Presented by : Mary McCaffery, US EPA.
Adoption of RDA-DFT Terminology and Data Model to the Description and Structuring of Atmospheric Data Aaron Addison, Rudolf Husar, Cynthia Hudson-Vitale.
Using the Global Change Master Directory (GCMD) to Promote and Discover ESIP Data, Services, and Climate Visualizations Presented by GCMD Staff January.
TWC Adoption of RDA DTR and PID in Deep Carbon Observatory Data Portal Stephan Zednik, Xiaogang Ma, John Erickson, Patrick West, Peter Fox, & DCO-Data.
Adoption of RDA-DFT Terminology and Data Model to the Description and Structuring of Atmospheric Data Aaron Addison, Rudolf Husar, Cynthia Hudson-Vitale.
Hydro DWG at the RDA Plenary: BoF and Aligning HDWG work with WMO expectations and timeline Sylvain, Tony, Silvano, Ilya.
GEOSS Air Quality Community Infrastructure ESIP, 23 July 2010 Knoxville, TN E.M. Robinson, R.B. Husar, S.R. Falke, E.T. Habermann, A. Warnock, M. Hogeweg,
Summary of RDA Outputs so far dr. Ir. Herman Stehouwer 22 September 2015.
1 Using the GEOSS Common Infrastructure in the Air Quality & Health SBA: Wildfire & Smoke Assessment Prepared by the GEOSS AIP-2 Air Quality & Health Working.
Documenting UAF Data Ted Habermann NOAA/NESDIS/National Geophysical Data Center.
1 Understanding Cataloging with DLESE Metadata Karon Kelly Katy Ginger Holly Devaul
Information Modeling and Semantic Web Application For National Climate Assessment Jin Guang Zheng 1 Curt Tilmes 2
Adoption of RDA-DFT Terminology and Data Model to the Description and Structuring of Atmospheric Data Aaron Addison, Rudolf Husar, Cynthia Hudson-Vitale.
Registering Earth Science Data and Data Related Services Using NASA’s Global Change Master Directory (GCMD) Tyler Stevens (GIS/Services Coordinator) ESIP.
Federated Space-Time Query for Earth Science Data Using OpenSearch Conventions ESIP Federated Search Cluster Chris Lynnes Bruce Beaumont Ruth Duerr Hook.
Hydro DWG at the RDA Plenary BoF - Improve sharing of water resource data globally 24 September BREAKOUT :30-15:00.
Fire Emissions Network Sept. 4, 2002 A white paper for the development of a NSF Digital Government Program proposal Stefan Falke Washington University.
The Research Data Archive at NCAR: A System Designed to Handle Diverse Datasets Bob Dattore and Steven Worley National Center for Atmospheric Research.
The Proliferation of Metadata Standards and the Evolution of NASA’s Global Change Master Directory (GCMD) Standard for Uses in Earth Science Data Discovery.
Discussion of Data Fabric Terms & Preparation for RDA P7 Virtual Meeting Monday, January 25, 2016 Organized by Gary Berg-Cross (DFT-IG) and Peter Wittenburg.
Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.
Advertising your data Alecia Aleman 1, Ruth Duerr 2 1 National Aeronautics and Space Administration (NASA) 2 National Snow and Ice Data Center, University.
ESO and the CMR Life Cycle Process Winter ESIP, Jan 2015 ESDIS Standards Office (ESO) Yonsook Enloe Allan Doyle Helen Conover.
The Federated Data System DataFed R. Husar, K. Hoijarvi, S. Falke, DaFed Community EPA Data Summit, Feb. 12, 2008, RTP Non-intrusive data integration infrastructure.
Adoption of RDA-DFT Terminology and Data Model to the Description and Structuring of Atmospheric Data Aaron Addison, Rudolf Husar, Cynthia Hudson-Vitale.
TWC Adoption* of RDA DTR and PIT in the Deep Carbon Observatory Data Portal Xiaogang Ma, John Erickson, Patrick West, Stephan Zednik, Peter Fox, & the.
Metadata Schema Registries: background and context MEG Registry Workshop, Bath, 21 January 2003 Rachel Heery UKOLN, University of Bath Bath, BA2 7AY UKOLN.
Rule-Based Approach for Earth Science Metadata Quality Assurance (QA) Tyler Stevens and Ellen Neff NASA’s Global Change Master Directory (GCMD) WYLE Information.
NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Reuse Working Group Earth Science Data Systems Reuse Working Group Case Study: SHAirED Services for.
IPDA Registry Definitions Project Dan Crichton Pedro Osuna Alain Sarkissian.
1 This slide indicated the continuous cycle of creating raw data or derived data based on collections of existing data. Identify components that could.
Intentions and Goals Comparison of core documents from DFIG and Publishing Workflow IG show that there is much overlap despite different starting points.
Overview of WGs, IGs and BoFs
Current and Upcoming RDA Recommendations Dr. ir. Herman Stehouwer
Overview of DLESE Metadata & Catalog System
Data Type Registries #2 12 Month Status Larry Lannom, Tobias Weigel Date Location TBD? CC BY-SA 4.0.
Data Type Registries Breakout
Common Framework for Earth Observation Data
Xiaogang Ma, John Erickson, Patrick West, Stephan Zednik, Peter Fox,
GEOSS Air Quality Community Infrastructure
Data Type Registries (DTR)
Wsdl.
Unified Metadata Model- WIGOS/CGMS Mapping
Prepared by: Jennifer Saleem Arrigo, Program Manager
From Observational Data to Information (OD2I IG )
WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe
A Case Study for Synergistically Implementing the Management of Open Data Robert R. Downs NASA Socioeconomic Data and Applications.
School of Information Studies, Syracuse University, Syracuse, NY, USA
4/5 May 2009 The Palazzo dei Congressi di Stresa Stresa, Italy
Geoscience Australia Service Metadata
Presentation transcript:

Adoption of RDA-DFT Terminology and Data Model to the Description and Structuring of Atmospheric Data Aaron Addison, Rudolf Husar, Cynthia Hudson-Vitale

Background DataFed & the Air Quality Community Catalog Problem Addressed Facilitate data interoperability Extend data discovery to non-domain researchers

RDA Data Foundation and Terminology (DFT) Data Foundation & Terminology WG

RDA Data Foundation and Terminology (DFT) Adoption plan ●Map DFT model to DataFed/AQ Com Cat data model ●Assess potential RDA/DFT compliance ●Real-world evaluation of outcome

RDA Data Foundation and Terminology (DFT) Adoption Activities & Timeline: TrainingOngoing Draft DataFed data model and inventory terms and evaluate existence of PID’sMarch Virtual ServerMarch Mirror site of AQComCatMarch User testingMarch Compare DFT model to DataFed data modelMarch/April Create/assign PID’s to AQComCatApril Reboot AQCom CatMay Add new datasource to AQComCat - test understandability of terms with data suppliers.June Conduct post-DFT implementation usability of AQComCatJuly Publish paper/report on findingsAugust

RDA Data Foundation and Terminology (DFT) Adoption Outcomes ●Report on usability of RDA DFT model ●Assess fit of the RDA DFT model to DataFed data model ●Evaluate improved discoverability/reuse ●Engage with Data Foundation and Terminology Working Group

Thank you!

RDU - Project RDU- Compliant Catalog Current Catalog DTR Adopt, Refine RDU products

Interaction with RDU Groups DTR Data Type Registries WG (Register Types) PID Information Types WG (Get PID ??) DFT Data Foundation and Terminology WG (Data Model…?) DFData Fabric IG (DataFed Use Case?)

Data Type Registry for Sharing and Reuse We will use the RDA Type registry (L. Lannom) Registry needs to be federated… e.g. with GCMD registry

What is Data Typing? Data ‘typing’ is the characterization of data structure, contexts, assumptions and other info needed to describe and understand the data. The ‘types’ need to be: Defined and understood by data producers and consumers Types should have multiple levels/granularity –single observation to data sets..(how??) Each type is to have a PID Permanently associated with the data they describe Standardized (OGC, ISO), unique (PID), and discoverable (TypeRegistry?) Data typing should aid the discovery, understanding, sharing and reuse of data.. across domains Automated processing of large data collections is a necessity Which requires a machine readable types, i.e. a clear data model for typing (clarify ???) ‘Composability’: lower level/base types can form more complex composite types (how???)

Global Change Master Directory (GCMD) Extensive collection of keywords and UUID’s; Possible use for ‘Types’ Do we combine it with AQ ComCat Types? Any other registries to federate?GCMD The GCMD/IDN release Version 8.1 of the GCMD/IDN Science Keywords. RESTFul service (API), is also available. Keyword List:GCMD/IDN Science Keywordsservice (API),Keyword List Science and Services Keywords: Category, Topic, Term, Variable, Level, Detailed, Variable, UUID Other ‘Types’ (Some are useful – to be defined formally, ID-d, in RDU Type registry : Data Centers, Projects, Instruments, Platforms, Locations, Horizontal Resolution, Vertical Resolution, Temporal Resolution, URL Content Types

Project Outputs and Outcomes, Next Steps Outputs: Develop a data model for suitable for describing atmospheric data Identify basic and composite types for atmospheric data Register these types in DTR Attach ‘types’ to data in DataFed Type-based search interface to DataFed data. Outcomes Real-world testing of Typing concepts and Registry Understanding of domain-specific issues and approaches, lessons learned Interaction with multiple RDU Groups … contribution to Data Fabric Recommendations for next phase Next steps outlined ???

ToDo’ s Combine AQComCat, GCMD, Other ‘keywords’/facets/ Formally define ‘RDU Types – Names, descriptions’, Get PIDs Check, reconcile types with concepts of DTR, PID, DFT WGs – is it OK? Register Types in Type Registry Incorporate Type-based metadata into AQComCat Test catalog usability before, after

Climate & Forecast Conventions GCMD Instruments GCMD Platform GCMD Temporal Resolutions GCMD Science & Services

ToDo’s See what facets are available on RDA DTR Space/time domains Map a few GCMD and CF Standard Names to RDA DTR – see how it would work Understand where/how the DTR fits into the XML schema It is schema based? How are people linking the DTR and the data type in the metadata? Validator for DTR? How is the DTR machine readable?