1. NOAA Documentation Improvement Ted Habermann How do we measure and visualize improvements in NOAA Documentation? Record Count Completeness (Rubric Scores) Less MetadataMore Metadata More Complete Less Complete Good Not So Good

2. NGDC Solar Metadata History Late in 2011 Bill Denig, the Chief of the Solar and Terrestrial Physics Division at NGDC, decided that, in order to understand this “metadata thing “ he had to actually work on some metadata. He started working with one record on his desktop using Oxygen (the dreaded XML editor) and the NGDC rubric. He got a very high score and was able to extend his experience to several other records. He achieved high scores with a small number of records. Bill’s experience and confidence increased and two months later he extended his collection to include records translated from FGDC to ISO. This increased the number of records and decreased the scores (FGDC translations generally yield scores between 16 and 20). Since then Bill has improved existing records and added new, high-quality records to steadily increase his average score.

3. Geophysics Components Components are re-useable pieces of documentation that allow “normalization” of information in metadata collections. One Month

4. Accessibility % Records with Data Access Service Link Historic Trend T % NOAA Documentation Dashboard Metadata Completeness Scores Data Access Service Types Offered # WMSNoneWCSDAPEsriWFS Documentation Metadata Dialects Used % of Records Free Text ISOFGDCOBISDC None Managers Scientists and Data Managers

5. Documentation Metric Services Collector Web Accessible Folders Scores Database Calculate Metrics Validation Bad Links Bad xLinks Rubric Scores Bad XML Unique Contacts Component Report

6. Collection Characteristics FGDC LegacyRecent CompletenessCompleteness CompletenessCompleteness Most Metadata Are Old Sporadic Work Periods Metadata Revision Date Discovery Understanding Goal: Improve metadata when you revise it:

7. 2. Assess 3. Create and Improve 4. Publish/Preserve Standards Experts Data Collectors/Providers Data Users Data Stewards Discovery Use Understanding Collections Datasets Services Data Stewardship Teams Line Office / Program Process 1. Identify Expertise Initial Evaluation On-Going Evaluation Spirals Rubrics On-Going Input Wiki CatalogsWAFs Consultation / GuidanceUse Cases / Needs

8. Documentation Capabilities WAF Unified access to metadata with multiple views Automated custom processing and metadata quality checks Translation from many dialects to consistent international standard Harvest targets for Geospatial One Stop and data.gov Spiral Tracker Consistent rubric score calculation Score distributions help identify improvement steps Database provides history and access to scores / records Supports stewardship teams and managers Wiki Provides community guidance, examples, successes Information available and shared with national and international partners

9. Required NOAA-Wide Support NOAA Line/Staff Offices and Programs must build on a strong foundation of support across all of NOAA 1.Develop and implement common metadata management tools 2.Use rubrics to establish a baseline and monitor progress 3.Promote and highlight good examples 4.Support training specifically targeted at improving NOAA’s data documentation 5.Initiate teams to work on “special documentation problems” that cross Line and Staff Offices 6.Encourage and support participation in the ISO and Open Geospatial Consortium (OGC)

10. Questions?

11. Other Potential Dashboard Views Minimum, Average and Maximum Scores vs. Time Portion of Scores vs. Time Low High Calculate Metrics Validation Bad Links Bad xLinks Rubric Scores Bad XML Unique Contacts Component Report

12. NOAA Documentation Improvement Components Directive Vision and goals, identify standards, describe common nomenclature, identify responsibilities Efficiently provide consistent guidance implementations, evaluations, and metadata management capabilities for all Line Offices and Programs Tools Plans Community guidance, training, examples, best practices, broad input, Line Office and Program plans Heterogeneous Homogeneous

13. Metric Calculation System FGDC Record Scores Existing XSLT (NCDDC)Rubric XSLT (TBD) ISO Collector Web Accessible Folders Record Scores Rubric XSLT (TBD) THREDDS Desktop Editors METAVIST, CatMDEdit, ArcCatalog, XMLSpy, Oxygen Desktop Editors METAVIST, CatMDEdit, ArcCatalog, XMLSpy, Oxygen Web Tools MERMaid, inPort, NMMR, Geonetwork Web Tools MERMaid, inPort, NMMR, Geonetwork

14. Current Test Cases Collector CoRIS 1642 Records CoRIS 1642 Records NOS 737 Records NOS 737 Records NESDIS/ OAR 1521 Records NESDIS/ OAR 1521 Records UAF 552 Records UAF 552 Records FGDC GOSIC ~400 Records GOSIC ~400 Records ISO NcMLDIF NMFS ~400 Records NMFS ~400 Records inPort

15. Spiral 1: Initial Content Spiral 1: Initial Content Metadata Content Independent of standard Metadata Content Independent of standard Standard Guidance / Implementation Standard Guidance / Implementation Check Back With Users Check Back With Users Spiral 2-N: Scientific Questions New Requirements New Use Cases Check Back With Data Collectors/ Providers Check Back With Data Collectors/ Providers Spiral Development / Training

16. Identification Id Title Abstract Resource Date Topic Category Theme Keyword Metadata Contact Science Contact Identification Id Title Abstract Resource Date Topic Category Theme Keyword Metadata Contact Science Contact Extent Geospatial Bounding Box Temporal Start/End Vertical Min/Max Place Keywords Extent Geospatial Bounding Box Temporal Start/End Vertical Min/Max Place Keywords Distribution Distributor Contact Online Resource Distribution Format Data Center Keywords Browse Graphic Distribution Distributor Contact Online Resource Distribution Format Data Center Keywords Browse Graphic Text Searches Purpose Extent Description Lineage Statement Project Keywords Text Searches Purpose Extent Description Lineage Statement Project Keywords Quality/Lineage Sources Process Steps Quality Reports / Coverages Quality/Lineage Sources Process Steps Quality Reports / Coverages Acquisition Information Instrument Platform Instrument Keywords Platform Keywords Acquisition Information Instrument Platform Instrument Keywords Platform Keywords Content Information Attribute Type Attribute Names Attribute Definitions Attribute Units Content Information Attribute Type Attribute Names Attribute Definitions Attribute Units Discovery Understanding Connection OnlineResource: Linkage (URL) Name Description Function Connection OnlineResource: Linkage (URL) Name Description Function Spiral Development / Training: Potential Spirals

17. Spiral Development / Training: Rubrics

18. Spiral Tracker WAF Score History Score Distribution Specific Records http://www.ngdc.noaa.gov/idb/struts/results?t=103068&s=20&d=25