Presentation is loading. Please wait.

Presentation is loading. Please wait.

Documenting UAF Data Ted Habermann NOAA/NESDIS/National Geophysical Data Center.

Similar presentations


Presentation on theme: "Documenting UAF Data Ted Habermann NOAA/NESDIS/National Geophysical Data Center."— Presentation transcript:

1 Documenting UAF Data Ted Habermann NOAA/NESDIS/National Geophysical Data Center

2 Metadata Types and Sharing Discovery Use / Mashup Understanding Discovery Portal Community Metadata Collections User

3 Documentation Repository ISO 19115, 19115-2, 19119 and extensions Documentation Repository ISO 19115, 19115-2, 19119 and extensions THREDDS netCDF DIF, FGDC, Data.Gov DIF, FGDC, Data.Gov SensorML WCS, WMS, WFS, SOS ISO KML Multiple Dialects

4 Designated Communities - Users Data preservation is communicating with the future

5 Custom Documentation Custom Documentation FGDC Mandatory Identification Metadata FGDC Mandatory Identification Metadata FGDC Discovery Distributor FGDC Discovery Distributor FGDC Complete Entity and Attribute Data Quality Lineage Spatial Organization Spatial Reference FGDC Complete Entity and Attribute Data Quality Lineage Spatial Organization Spatial Reference FGDC RSE Identifier Documentation Mission Platform Instrument Aggregation Algorithm Processing FGDC RSE Identifier Documentation Mission Platform Instrument Aggregation Algorithm Processing ISO 19115 Code Lists Many Identifiers OnLine Resources Responsible Parties Data Quality Reports Spatial/Temporal Extents Metadata Levels / Scope ISO 19115 Code Lists Many Identifiers OnLine Resources Responsible Parties Data Quality Reports Spatial/Temporal Extents Metadata Levels / Scope ISO 19115-2 Quality Coverage Usability Platform Instrument Processing Algorithm ISO 19115-2 Quality Coverage Usability Platform Instrument Processing Algorithm FGDC to ISO 19115 International Standard Unified Modeling Language FGDC to ISO 19115 International Standard Unified Modeling Language Basic Content Extended Content ISO 19119 Services ISO 19110 Features ISO 19119 Services ISO 19110 Features Standards Evolution

6 Spiral 1: Initial Content Spiral 1: Initial Content Metadata Content Independent of standard Metadata Content Independent of standard Standard Guidance / Implementation Standard Guidance / Implementation Check Back With Users Check Back With Users Spiral 2-N: Scientific Questions New Requirements New Use Cases Check Back With Data Collectors/ Providers Check Back With Data Collectors/ Providers

7 Identification Id Title Abstract Resource Date Topic Category Theme Keyword Metadata Contact Science Contact Identification Id Title Abstract Resource Date Topic Category Theme Keyword Metadata Contact Science Contact Extent Geospatial Bounding Box Temporal Start/End Vertical Min/Max Place Keywords Extent Geospatial Bounding Box Temporal Start/End Vertical Min/Max Place Keywords Distribution Distributor Contact Online Resource Distribution Format Data Center Keywords Browse Graphic Distribution Distributor Contact Online Resource Distribution Format Data Center Keywords Browse Graphic Text Searches Purpose Extent Description Lineage Statement Project Keywords Text Searches Purpose Extent Description Lineage Statement Project Keywords Quality/Lineage Sources Process Steps Quality Reports / Coverages Quality/Lineage Sources Process Steps Quality Reports / Coverages Acquisition Information Instrument Platform Instrument Keywords Platform Keywords Acquisition Information Instrument Platform Instrument Keywords Platform Keywords Content Information Attribute Type Attribute Names Attribute Definitions Attribute Units Content Information Attribute Type Attribute Names Attribute Definitions Attribute Units Discovery Understanding Connection OnlineResource: Linkage (URL) Name Description Function Connection OnlineResource: Linkage (URL) Name Description Function Spiral Development / Training: Potential Spirals

8 SpiralNone0-33%34-66%67-99%All Identification Connection Extent Distribution Description Content Lineage Acquisition Information Metadata Evaluation for Dataset X Date: 2010/10/24 Spirals and Rubrics

9 NcML vs. ISO Satellite HIOOS CoastWatch NESDIS SST

10 ISO Scores (Initial) ISO Rubric Score FGDC - CoRISFGDC - NOSUAF

11 This attribute exists in the NcML files extracted from data files on TDS. It was not considered in the initial translation, but can be combined with publisher information to form either distribution information or a service operation connectPoint netcdf/@location = distribution | service

12 ISO Rubric Score FGDC - CoRISFGDC - NOSUAF netcdf/@location = distribution | service

13 netcdf/attribute/@name=project/@value This attribute provides information about the project that is responsible for the dataset. Initially this information was translated into an MD_AggregationInformation object with MD_InitiativeTypeCode=project. As an alternative this attribute could be treated as a keyword with MD_KeywordTypeCode=project (19115-2012). ISO keywords are associated with shared vocabularies (thesauri). If the project keywords come from a shared vocabularies, like the CF_Standard_Names, this convention would be a significant step towards increased interoperability. The NASA Global Change Master Directory has an existing shared vocabulary for dataCenters.

14 netcdf/attribute/@name=project/@value ISO Rubric Score FGDC - CoRISFGDC - NOSUAF

15 netcdf/attribute/@name=publisher/@value This attribute provides information about the publisher of the dataset. Initially this information was translated into a CI_ResponsibleParty with CI_RoleCode = publisher. As an alternative this attribute could be treated as a keyword with MD_KeywordTypeCode = dataCenter (19115-2012). ISO keywords are associated with shared vocabularies (thesauri). If the dataCenter keywords come from a shared vocabularies, like the CF_Standard_Names, this convention would be a significant step towards increased interoperability. The NASA Global Change Master Directory has an existing shared vocabulary for dataCenters.

16 netcdf/@name=publisher/@value =dataCenter keyword ISO Rubric Score FGDC - CoRISFGDC - NOSUAF

17 NcML vs. ISO Satellite HIOOS CoastWatch

18 Improvement Plan 1.Improve standard (add new keyword types) 2.Create and encourage adoption of shared vocabularies for discovery 3.Improve translation from NcML to ISO 4.Integrate ncISO into TDS 5.Create good xsl stylesheets for documentation display 6.Encourage existing and new data providers to support data discovery conventions 7.Find partners for further improvement in NcML and ISO

19 NGDC Ionosonde Group is starting to write time series data for many Ionosonde Stations. The NGDC Metadata Team has been working with them to help them understand use and discovery conventions for netCDF. StationNcMLISO Initial313 Intermediate2017 Final4021 New Data Providers

20 Positive deviance says that if you want to create change, you must scale it down to the lowest level of granularity and look for people within the social system who are already manifesting the desired future state. Take only the arrows that are already pointing toward the way you want to go, and ignore the others. Identify and differentiate those people who are headed in the right direction. Give them visibility and resources. Bring them together. Aggregate them. Barbara Waugh Leadership Model: Positive Deviance


Download ppt "Documenting UAF Data Ted Habermann NOAA/NESDIS/National Geophysical Data Center."

Similar presentations


Ads by Google