Geographic Information Systems and Geospatial Metadata CSCI 373: Advanced Database UNC Asheville April 27, 2006 Lynda Wayne US Federal Geographic Data Committee / GeoMaxim

CSCI 373GIS and Geospatial Metadata What so special about spatial? Geospatial Data Components: entities and attributes

CSCI 373GIS and Geospatial Metadata What so special about spatial? Geospatial Data Components: location

CSCI 373GIS and Geospatial Metadata What so special about spatial? Geospatial Data Components: extent or ‘geographic footprint’ most data IS geospatial….

CSCI 373GIS and Geospatial Metadata How does GIS enable geospatial data? Geographic Information Systems: capture display analyze manage geospatial data esri.com

CSCI 373GIS and Geospatial Metadata GIS Functions Geospatial data capture and display: entities/attributes via a database location via a coordinate/referencing system extent via graphic objects arcs nodes/points polygons grids esri.com

CSCI 373GIS and Geospatial Metadata GIS Functions Geospatial data analysis location and extent enable entity/attribute: Multi-level analysis: coincidence deviation proximity temporal patterns Graphic developed by Kenneth E. Foote and Margaret Lynch, Department of Geography, University of Texas

CSCI 373GIS and Geospatial Metadata GIS Functions Geospatial data analysis location and extent enable entity/attribute: Single-level (feature) analysis contiguity dispersion spatial patterns

CSCI 373GIS and Geospatial Metadata GIS Functions Geospatial data analysis location and extent enable entity/attribute : Feature characterization size shape smoothness salient points

CSCI 373GIS and Geospatial Metadata GIS Functions Geospatial data management access share assess use update organize geospatial data

CSCI 373GIS and Geospatial Metadata What is geospatial metadata? Data ‘reporting’ WHO created the data? WHAT is the content of the data? WHEN was it created? WHERE is it geographically? HOW was the data developed? WHY was the data developed?

CSCI 373GIS and Geospatial Metadata What is geospatial metadata? title supplemental information abstract time period author sources (file) size

CSCI 373GIS and Geospatial Metadata What is geospatial metadata? entity attributes

CSCI 373GIS and Geospatial Metadata Metadata as a Data Component Metadata Title Originator Purpose Abstract Geographic Extent Time Period of Content Sources Used Process Description Positional Accuracy Entities and Attributes……. phenomena map / image / database metadata abstraction content context DATA

CSCI 373GIS and Geospatial Metadata DATA map (content) metadata (context) Metadata as a Data Component access share use search download describe publish assess apply Data Management

CSCI 373GIS and Geospatial Metadata Metadata the Awful Geospatial Data Producers perceive metadata as: time consuming excessive for the benefits of others Geospatial Managers perceive metadata as: non-productive costly (time, training, software) derive classify collect planimetricimagery analysis alternative committee review PLAN charette metadata?

CSCI 373GIS and Geospatial Metadata Metadata the Magnificent Metadata can support: data management project management If it is: considered a component of the data created during data development populated with rich content derive classify collect planimetricimagery analysis alternative committee review PLAN charette meta

CSCI 373GIS and Geospatial Metadata Data Management via Metadata Data Accountability Discovery & Re-use Maintenance & Update Data Liability

CSCI 373GIS and Geospatial Metadata Data Management: Data Maintenance and Update Maintenance Are the data current? older than? prior to significant change ? Are the data valid? newer sources? better methods? Update Contact information Distribution policies, availability, pricing URLS New derivations

CSCI 373GIS and Geospatial Metadata Data Management: Data Discovery and Re-use Marketing metadata in the past… If you create metadata, other people can discover your data If you create metadata, you can find your own data New and improved message…

CSCI 373GIS and Geospatial Metadata Data Management: Data Discovery and Re-use Data discovery by themes / attributes geographic extent temporal character methods sources quality Discoverable data is usable data

CSCI 373GIS and Geospatial Metadata Data Management: Data Accountability Exercise in data comprehension: What do you know? What don’t you know? What should you know? Are you willing to associate yourself with the metadata record?

CSCI 373GIS and Geospatial Metadata Data Management: Data Accountability Repeatable process: methods variables parameters Defensible process: public participation decision-making GIS-savvy public Metadata can be crafted to preserve individual accountability in team projects

CSCI 373GIS and Geospatial Metadata Data Management: Data Liability Metadata is declaration of: Purpose originator’s application of the data ? ontological pedigree ? Use Constraints appropriate and inappropriate utility of the data Completeness what is missing from the data Distribution Liability explicit liability of the producer and assumed liability of the consumer What to do… What not to do…

CSCI 373GIS and Geospatial Metadata Project Management via Metadata PROJECT PLANNING DELIVERABLES COMMON LANGUAGE PROJECT MONITORING

CSCI 373GIS and Geospatial Metadata Project Management: Project Planning Project design document: description / intent geo & temporal extent source data attribute requirements Benefits: expectations outlined integrated into process provide medium to record progress

CSCI 373GIS and Geospatial Metadata Project Management: Project Monitoring Monitor: status QA/QC measures changes Requires that the metadata be actively maintained and reviewed. time milestones

CSCI 373GIS and Geospatial Metadata Project Management: Common Language for Multi-participants Common reference for: descriptors & parameters keywords, vocabularies & thesauri contact information attributes distribution information If reviewed regularly by all participants, improved opportunity for coordinating: source data analytical methods new information template

CSCI 373GIS and Geospatial Metadata Project Management: Contract Deliverables Metadata is a data component therefore part of any data deliverable Clearly specify your metadata requirement via a metadata: classification/validation schema, e.g. ‘level’ of metadata template specification manual Provide a sample record if possible

CSCI 373GIS and Geospatial Metadata Metadata Roles If created with utility in mind, metadata can serve multiple roles: and this is only human utility of metadata… archivist preserve lineage accountant preserve investment developer document process manager track progress contributors communicate consumer locate, assess, access data

CSCI 373GIS and Geospatial Metadata How do I create geospatial metadata? To create geospatial metadata you must: 1.make metadata part of the process 2.be familiar with the US metadata standard 3.utilize a metadata editor tool

CSCI 373GIS and Geospatial Metadata Make Metadata Part of the Process New tools enable us to better integrate metadata creation into the data development process

CSCI 373GIS and Geospatial Metadata If metadata were collected throughout the data process… 1.more accurate (no guessing) 2.more details 3.better decision-making. Make Metadata Part of the Process

CSCI 373GIS and Geospatial Metadata Build templates identify pertinent fields populate fixed fields standardized language distribution methods standards used build source and contact libraries templates can be built at multiple levels: organization, project, themes…. Make Metadata Part of the Process

CSCI 373GIS and Geospatial Metadata Identification Information title abstract purpose time period of content keywords completeness Attribute Information attribute labels/domains Data Quality Attribute Information compilation accuracies compilation processes source files field check accuracies analytical processes attribute values Data Processing Data Planning Data Analysis manager technicians analysts Map metadata to the workflow Make Metadata Part of the Process

CSCI 373GIS and Geospatial Metadata Establish policies mandate use of standards and templates develop boilerplate metadata deliverable language for data contractors include metadata as a performance measure require units to publish their metadata publish metadata SOP to document policies and procedures Make Metadata Part of the Process

CSCI 373GIS and Geospatial Metadata Content Standard for Digital Geospatial Metadata (CSDGM) imagery digital land surveys GIS filesgeographic databases required for use by: federal agencies federally-sponsored research some state/county/city governments info at: US Federal Metadata Standard

CSCI 373GIS and Geospatial Metadata CSDGM Overview Organized into seven primary sections: 1. Identification Information General bibliographic information including: title, originator, data contact, status, date, time period of content, abstract, purpose, keywords, geographic location 2. Data Quality Information Lineage and data assessments sources, process methods, accuracy, data processing contact

CSCI 373GIS and Geospatial Metadata CSDGM Overview 3. Spatial Data Organization Data format: vector, point, raster 4. Spatial Reference Information Coordinate system parameters: horizontal / vertical coordinate system, projection, datum

CSCI 373GIS and Geospatial Metadata 5. Entity and Attribute Information Database design entities, attributes, domains, description of data values 6. Distribution Information How to acquire the data distribution contact, available formats, online distribution website, costs CSDGM Overview

CSCI 373GIS and Geospatial Metadata CSDGM Overview 7. Metadata Reference Information General information about the metadata record itself metadata contact, metadata standard used, metadata creation date, metadata review date

CSCI 373GIS and Geospatial Metadata CSDGM Overview But that wasn’t enough for some people... Extensions: added elements to the CSDGM Remote Sensing Extension Profiles content requirements for specific elements may included added elements as well Biological Profile Shoreline Profile

CSCI 373GIS and Geospatial Metadata Transition to ISO Metadata Standardized Metadata Content Standard for Digital Geospatial Metadata (CSDGM) Vers. 2.0 remains current US standard International Geospatial Metadata Standard (ISO 19115) standard completed US (ANSI) adoption in progress

CSCI 373GIS and Geospatial Metadata 1.Content CSDGM similar and new elements Domains and conditionality Essential or core metadata 2.Format UML / XML Multi-level metadata What’s new with ISO metadata?

CSCI 373GIS and Geospatial Metadata Metadata Tools How do I determine the best metadata tool? Does your organization provide a tool? Does your GIS software provide an internal editor? Do you use a CSDGM Profile or Extension? Do you need to document data resource beyond those managed within your GIS? Do you need a tool that is easily distributed to partners? What features are most important to you? auto-capture of information bundling of metadata with data creation and use of templates easy to use interface robust help systems and tutorials

CSCI 373GIS and Geospatial Metadata Metadata Tools What metadata editors are available? Freeware tkme/xtme USGS, supports all profiles/extensions, well-maintained MetaVist USFS, desktop, supports biological profile MERMAid NOAA CSC, online utility supports biological and shoreline profiles

CSCI 373GIS and Geospatial Metadata Metadata Tools What metadata editors are available? Commercial SMMS (Intergraph GeoMedia and stand-alone) auto capture from multiple file types, contact/source libraries, data exploration utilities ArcCatalog metadata ‘synchronized’ w/data, ability to enclose documents, metadata bundled with data export Blue Angel highly customizable, supports non-geospatial metadata

CSCI 373GIS and Geospatial Metadata Metadata Tools What other metadata tools are available? Parsing and Validation Metadata Parser (mp) checks for conformance to CSDGM specified: conditionality (are all mandatory elements are populated?) data formats element domains mp batch batch processor shareware from Intergraph Chew N Spit (cns) Rectifies indentation Inserts capitalization and underbars FGDC ‘compliant’ metadata must pass mp!

CSCI 373GIS and Geospatial Metadata Metadata Tools What other metadata tools are available? Conversion error2htm provides user-friendly interpretation of mp error report dbfmeta converts dbase to CSDGM Entity Attribute elements mq provides interface for editing large, diverse collections of metadata

CSCI 373GIS and Geospatial Metadata How is metadata used to distribute geospatial data? Geospatial data portals, online systems and catalogs: Geospatial One-Stop US Federal geospatial data portal NC OneMap State geospatial data portal Buncombe County GIS County GIS National Biological Information Infrastructure Thematic Metadata Catalog

CSCI 373GIS and Geospatial Metadata Geospatial OneStop

CSCI 373GIS and Geospatial Metadata NC OneMap

CSCI 373GIS and Geospatial Metadata Buncombe County GIS

CSCI 373GIS and Geospatial Metadata NBII Metadata Catalog

CSCI 373GIS and Geospatial Metadata Future Role of Metadata External Utility distribution role will be limited to exact vs. general queries with improvements to context- based search utilities (MetaCarta) Internal Utility management role will increase with shift to OOP-based GIS (hierarchy, relations, etc.) Geospatial Metadata is a GIS Best Practice

CSCI 373GIS and Geospatial Metadata Questions? Lynda Wayne FGDC Metadata Website ESRI GIS Primer