Technical Workshops | Esri International User Conference San Diego, California Leveraging Metadata Standards in ArcGIS for Interoperability David Danko Aleta Vienneau July 26, 2012

Leveraging Metadata Standards in ArcGIS for Interoperability Metadata standards: why, what, and when - Why metadata and metadata standards - Status of metadata standards and profiles Creating standards-compliant metadata in ArcGIS - ArcGIS notes for all standards and profiles - FGDC CSDGM metadata - ISO metadata - North American Profile (NAP) - INSPIRE Metadata Directive - ANZLIC and other ISO profiles - Customizing the metadata editor

Metadata standards: why, what, and when

Usefulness and utility of released data rating system Data is released (PDF of scanned paper) Data is structured, in machine-readable format (Excel file) Data is in an open file format (CSV file) Data uses consistent format, discoverability methods and metadata associations Data uses URLs to identify things Data is linked to other linked data

Why is geospatial metadata important? Geospatial data is an imperfect abstraction of the real world - A model, a “point of view” - Assumptions, limitations, approximations, simplifications Ensures we understand the geographic information - The producer is not usually the user - Supports good information management Geospatial resources are valuable - Reuse Oh yeah—it helps us find the right information for the right purpose

Why use metadata standards? Provide resource producers an idea of the metadata they should collect Provide consistent terminology for global search Provide an common understanding of data – around the Globe and across information communities

Regional and national standards from the mid 1990s Content Standard for Digital Geospatial Metadata (FGDC 1992) Directory Information Describing Digital Geo-referenced Data Sets, CAN/CGSB Australia & New Zealand: Core metadata elements for land and geographic directories in Australia and New Zealand CEN TC287: Geographic Information - Data description – Metadata (1996) All except FGDC have moved to ISO standards - FGDC now starting to transition to ISO standards

ISO Metadata standards ISO 19110:2005/Amd 1:2011 Methodology for feature cataloguing ISO 19111:2007 Spatial referencing by coordinates ISO 19112:2003 Spatial referencing by geographic identifiers ISO 19113:2002 Quality principles ISO 19114:2003 Quality evaluation procedures ISO 19115:2003/Cor 1:2006 Geospatial metadata ISO :2009 Extensions for imagery and gridded data ISO 19119:2005 Services ISO 19130:2010 Imagery sensor models for geopositioning ISO 19138:2006 Data quality measures ISO 19139:2007 Metadata XML Schema implementation ISO 15836:2003 The Dublin Core metadata element set

ISO 19115/19139 Profiles A metadata profile for precision agriculture based on ISO standard. WMO Core Profile of the ISO Metadata Standard Transformation of HDF-EOS metadata from the ECS model to ISO based XML Draft African metadata profile of ISO19115 Samoan profile NOKIS – an ISO Based Metadata System The UDK and ISO Standard Latin American Profile Núcleo Español de Metadatos (NEM) UK GEMINI Biological profile Coastal zone profile S100 Metadata profile (IHO) Australia-New Zealand Profile North American Profile of ISO 19115:2003 (NAP) - CAN/CGSB INCITS INSPIRE Metadata Directive ISO19115/ISO19119 Application Profile for CSW 2.0 C3Grid ISO Metadata Profile Marine Community Metadata Profile of ISO Energy Industry Profile of ISO USGIN ISO Profile DISDI Geospatial Metadata Profile (DGMP) National System for Geospatial Intelligence Metadata Foundation (NMF)

Changes coming to ISO and ISO Today - ISO defines content - ISO defines encoding rules and the encoding (XML schema) - Encoding rules define how to create XML Schema from UML Future - ISO defines improved content - ISO defines encoding (XML schema) - Revise ISO to define encoding rules only

Schedule of standards work in progress ISO XML schema for imagery and gridded data - Technical Specification (TS) ISO (revision) - Draft International Standard (DIS) Final Draft International Standard (FDIS) International Standard (IS) ISO XML schema implementation of metadata fundamentals Committee Draft (CD) DIS FDIS IS ISO Data Quality - FDIS IS ISO Methodology for feature cataloguing (revision) - CD FDIS IS

What’s new in ISO Incorporating services metadata from ISO Data Quality content managed under ISO Feature catalog (entity/attribute) included from ISO Physically or by link Many individual elements added or improved - Metadata identifier improved - MD_Scope and MD_KeywordClass classes added - Online linkage in Citation - Reference system type code attribute added - ~75 changes in all

ISO/TS XML schema implementation of Metadata fundamentals First meeting in Toulouse in June Project leader is Ted Habermann, NOAA XML Schema XSLT to convert from ISO 19115/19139 format to the ISO / format - And back Schematron

Future planned standards work ISO revision to contain encoding rules only ISO XML encoding for data quality Renumber ISO Metadata XML encoding for imagery and gridded data: becomes ISO

North American Profile of ISO (NAP) NAP is a profile of ISO Metadata - Remains stable as-is U.S. will focus on transition to using NAP as a guide - After gaining experience with , will work with Canada to update NAP as a profile of

Creating standards- compliant metadata in ArcGIS

ArcGIS notes for all standards and profiles Upgrade existing metadata to the ArcGIS metadata format Let ArcGIS automatically update metadata Important Help topics - The ArcGIS metadata format The ArcGIS metadata format - Creating standard-compliant metadata Creating standard-compliant metadata Let 10.1 validation rules in the editor guide you - Validation rule updates coming with 10.1 SP1

FGDC CSDGM metadata Creating FGDC CSDGM metadata is fully supported with ArcGIS 10.0 SP4 - All FGDC metadata content upgraded to ArcGIS metadata - Continue to apply service packs as they are available Create metadata in the Description tab

FGDC CSDGM metadata Set CSDGM style, and check options in Options dialog box

FGDC CSDGM metadata View FGDC CSDGM-format metadata - Popup warns you an upgrade is needed - Yes: upgrade right away - No: do it later with Upgrade button or Upgrade Metadata tool FGDC CSDGM-format content appears at the bottom of display - Click FGDC Metadata (read-only) heading - Content is read-only in the context of the Description tab

FGDC CSDGM metadata Important Help topics specific to FGDC CSDGM content - Creating and managing FGDC metadata Creating and managing FGDC metadata - Illustrated guide to complete FGDC metadata Illustrated guide to complete FGDC metadata - Differences between ArcGIS metadata and FGDC metadata Differences between ArcGIS metadata and FGDC metadata - New topic in 10.1 online Help

FGDC CSDGM metadata Locate specific elements with the illustrated guide

FGDC CSDGM metadata Let ArcGIS automatically update metadata - Required to include spatial reference in exported metadata Some content controlled by the metadata style Don’t type “None”—added on export Process steps ordered by date on export

FGDC CSDGM metadata Export button creates a CSDGM-formatted XML file Use exported XML and USGS MP Metadata Translator tool to produce additional file formats Import button converts a CSDGM-formatted XML file to the ArcGIS metadata format Transform a CSDGM-format text file to XML format with mp using a Python script, then import XML

FGDC CSDGM metadata 10.1 editor validates ArcGIS metadata content against CSDGM rules as you type - Improvements to the rules coming with 10.1 service pack 1 Validate button creates a CSDGM-formatted XML file and validates it with the FGDC DTD Export metadata to a CSDGM XML file, then validate it with mp using USGS MP Metadata Translator tool

FGDC CSDGM metadata Can remove FGDC CSDGM-format metadata using geoprocessing model and provided XSLT - remove pre94 metadata elements.xslt

ISO metadata Set ISO style and check options in Options dialog box

ISO metadata Use ArcGIS 10.0 SP4 or later Creating ISO metadata incorporates both ISO content and ISO content

ISO metadata If you created metadata using ISO wizard only, metadata is upgraded automatically when you edit it and save changes in the Description tab If you created metadata using both the ISO and FGDC editors, choose if you want to upgrade FGDC or ISO Make definitive choice by running Upgrade Metadata tool

ISO metadata Export button in the Description tab creates an ISO formatted XML file Import button in the Description tab converts an ISO XML file to the ArcGIS metadata format

ISO metadata Validate ArcGIS metadata according to ISO rules as you type in the editor - The rules as defined in the ISO and ISO standard documents Validate button in the Description tab creates an ISO formatted XML file and validates with online XSDs - URL we use for online XSDs will be changing in the future

ISO metadata Can remove formatted metadata using geoprocessing model and provided XSLT - remove pre94 metadata elements.xslt

North American Profile (NAP) Set NAP style and check options in Options dialog box

North American Profile (NAP) Essentially the same as creating ISO metadata Additional codelist values available in the editor NAP-specific rules in the editor Content not included in NAP is not available in the editor unless it is considered part of a complete ArcGIS metadata document

North American Profile (NAP) Export button in the Description tab creates an ISO formatted XML file If edits were saved using the NAP style, exporter ensures codelist values and content are appropriate for NAP Import button in the Description tab converts an ISO XML file to the ArcGIS metadata format - ISO importer that supports NAP-specific content will be available in a future 10.1 service pack

North American Profile (NAP) Validate ArcGIS metadata as you type according to NAP rules Validate button in the Description tab creates an ISO formatted XML file and validates with online XSDs - No NAP-specific XSDs

INSPIRE Metadata Directive Set INSPIRE style and check options in Options dialog box

INSPIRE Metadata Directive Provide the ability to create ISO metadata that conforms to the INSPIRE Metadata Directive Essentially the same as creating ISO metadata Limited codelist values in the editor as appropriate INSPIRE-specific rules in the editor

INSPIRE Metadata Directive Export button in the Description tab creates an ISO formatted XML file If edits were saved using INSPIRE style, exporter ensures codelist values and content are appropriate for INSPIRE Import button in the Description tab converts an INSPIRE-compliant ISO XML file to the ArcGIS metadata format

ANZLIC and other ISO profiles Complete ISO content is supported with the ISO metadata style As long as you know the rules for your profile, you can create metadata conforming to that profile in ArcGIS Can use the ArcGIS Metadata Toolkit to customize the ArcGIS metadata editor for your profile Can run Schematrons based on XSLT 1.0 in ArcGIS as an XSLT

Customizing the metadata editor Create a custom metadata style for a specific profile Download the ArcGIS Metadata Toolkit from support.esri.com - Documents the ArcGIS metadata format - Instructions for creating a custom metadata style - Code for all pages in the metadata editor - A WPF application with XAML forms written in C# - Sample project for adding a custom page - Instructions for customizing export transformations

Multilingual metadata ArcGIS lets you work with one language at a time Two methods are described in ISO standard documents for creating multilingual metadata Recommend creating a second XML document containing written content in a second language - Devise and stick with a naming convention Indicate in metadata that information is available for another locale Cross-reference the additional XML file in the item’s metadata

Steps to evaluate UC sessions My UC Homepage > “Evaluate Sessions” Choose session from planner OR Search for session

Thank you for attending Have fun at UC2012 Open for Questions Please fill out the evaluation: Offering ID: 1663