Presentation is loading. Please wait.

Presentation is loading. Please wait.

ISO/TC211 Geographic information/Geomatics Metadata David Danko Work Item 15 - Project Leader

Similar presentations


Presentation on theme: "ISO/TC211 Geographic information/Geomatics Metadata David Danko Work Item 15 - Project Leader"— Presentation transcript:

1 ISO/TC211 Geographic information/Geomatics Metadata David Danko Work Item 15 - Project Leader ddanko@esri.com

2 Metadata Data about Data Geospatial data has a long history using MetadataGeospatial data has a long history using Metadata –Map catalogs –Maps and Charts –Imagery –Digital data files

3 Title Symbols ( Feature Codes) Identification Scale Accuracy Producer Navigation notices Reference system Sources Warnings Location Date Paper Maps

4 Metadata perspectives Why its more important now?Why its more important now? –Expansion in the use of Geographic Information –Proliferation of data –Non-geographers using geospatial data –The producer is not the user –Geospatial data is imperfect –A model, a point of view –Assumptions, limitations, approximations, simplifications –Expensive –Reuse –Data management Why should it be standardized?Why should it be standardized? –Provide an understanding of data – around the Globe and across information communities

5 Metadata Applications To understand the right data for the right purpose LocateLocate – –Find – –Discover EvaluateEvaluate – –Restrictions – –Quality – –Reputation Extract –Order –Download Employ –Apply –Use

6 The metadata environment Environment ApplicationApplication

7 Cataloging datasets Index of DatasetsIndex of Datasets Product CatalogProduct Catalog –Printed –On-line ClearinghouseClearinghouse –Searching –Browsing Data WarehouseData Warehouse –Management LocateEvaluateExtract Federal Agency Academic State Agency Local Agency Private Company Non-Profit Agency ? ? ? ? ? ? ClientMetadata Spatial Data Set

8 Pleasantville Understanding data Understand the ModelUnderstand the Model –How features are represented –Connectivity Understand the ContentUnderstand the Content –Why features are included or excluded Understand the Point-of-ViewUnderstand the Point-of-View –Business/Commercial –Environmental/Scientific –Military/Defense/Intel LocateEvaluateEmploy

9 Processing support Support user DecisionsSupport user Decisions –Identify multiple datasets within an application –Know the good and bad areas –Merging data (which is the better data?) –Currentness –Quality Support Computer ProcessingSupport Computer Processing –Application software functions –Extraction/Creation (I/O) –Guide software through the data ExtractEmploy

10 Historical records Production ManagementProduction Management –Storage/Archival –Coordinating production –Planning - setting priorities Legal RecordsLegal Records –Proper use –Document assumptions LocateEvaluate

11 ISO 19115:2003 Metadata Stage date: 2003-05-08 http://www.iso.org/iso/en/prods-services/ISOstore/store.html

12 ISO 19115:2003 Scope...the schema required for describing geographic information and services....the schema required for describing geographic information and services....information about the identification, the extent, the quality, the spatial and temporal schema, spatial reference, and distribution of digital geographic data....information about the identification, the extent, the quality, the spatial and temporal schema, spatial reference, and distribution of digital geographic data....applicable to the cataloguing of datasets, clearinghouse activities, and the full description of datasets for a wide range of geographic applications....applicable to the cataloguing of datasets, clearinghouse activities, and the full description of datasets for a wide range of geographic applications. …applicable to geographic datasets, dataset series, and individual geographic features and attributes…applicable to geographic datasets, dataset series, and individual geographic features and attributes...may be used for other forms of geographic data such as map, charts, textual documents...may be used for other forms of geographic data such as map, charts, textual documents

13 The ISO Process Formal ProcessFormal Process –Refined over 50 years –Stages and timelines fully defined Consensus basedConsensus based –Drafts considered until consensus reached through voting process by P- members

14 Preliminary Stage Proposal Stage Preparatory Stage Committee Stage Enquiry Stage Approval Stage Publication Stage ISO Development Stages

15 ISO metadata foundation Regional metadata standards Regional metadata standards – – ANZLIC Working Group on Metadata: Core Metadata Elements Guidelines Draft 7, Australia and New Zealand Land Information Council, November 1995, Sydney. – – the Canadian Directory Information Describing Digital Geo-referenced Data Sets, Canadian General Standards Board, July 1994, Ottawa. – – Standard for Geographic Information - Metadata, European Committee for Standardisation (CEN), September 1996, Brussels. – – Content Standard for Geospatial Metadata Federal Geographic Data Committee, June 8, 1994, Washington DC Other influential documents Other influential documents – – Digital Geographic Information Exchange Standard (Digest), Version 1.2. Digital Geographic Information Working Group, January 1994, – – IHO Transfer Standard for Digital Hydrographic Data, International Hydrographic Bureau, October 1995, Monaco – – Spatial Data Transfer Standard (SDTS), US Department of Commerce, August 1992, Gaithersburg, MD – – Application Profile for the Government Information Locator Service (GILS), US Department of Commerce, December 1994, Gaithersburg, MD – – Cartographic materials: A manual of interpretation for AACR2, Anglo-American Committee on Cataloguing of Cartographic materials, 1982, Chicago – – USMARC Format for Bibliographic Data, US Library of Congress, 1988, Washington, DC

16 ISO 19115:2003 Metadata applications MD_Metadata > DS_Aggregate DS_DataSet DS_OtherAssociation DS_StereoMate DS_SeriesDS_Initiative GF_PropertyType GF_FeatureType FE_FeatureAttribute FE_Feature 0..* 1..* 0..* 1..* 0..* 1..* DS_PlatformDS_SensorDS_ProductionSeries

17 Metadata packages Identification InformationLocate Constraint Information Maintenance Information Data Quality Information 19113,14 Content Information 19110, 21, 23, 24 Evaluate Distribution InformationExtract Metadata Extension Information Reference System Information 19108, 11, 12 Spatial Representation Information 19107 Portrayal Catalogue Information 19117 Application Schema Information 19109 Employ Developed to fulfill primary metadata applications

18 ISO 19115: 2003 Metadata schema object models MD_KeywordTypeCode + discipline + place + stratum + temporal + theme > MD_TopicCategoryCode + farming + biota + boundaries + climatologyMeterologyAtmosphere + economy + elevation + environment + geoscientificInformation + health + imageryBaseMapsEarthCover + intelligenceMilitary + inlandWaters + location + oceans + planningCadastre + society + structure + transportation + utilitiesCommunications > MD_ProgressCode + completed + historicalArchive + obsolete + onGoing + planned + required + underDevelopment > MD_Format (from Distribution information) MD_Usage + specificUsage : CharacterString + usageDateTime[0..1] : DateTime + userDeterminedLimitations[0..1] : CharacterString + userContactInfo [1..*] : CI_ResponsibleParty MD_MaintenanceInformation (from Maintenance information) MD_Metadata (from Metadata entity set information) MD_Keywords + keyword[1..*] : CharacterString + type [0..1] : MD_KeywordTypeCode + thesaurusName[0..1] : CI_Citation MD_Constraints (from Constraint information) MD_Identification + citation : CI_Citation + abstract : CharacterString + purpose [0..1] : CharacterString + credit [0..*] : CharacterString + status [0..*] : MD_ProgressCode + pointOfContact [0..*] : CI_ResponsibleParty > 0..* +resourceFormat 0..* +resourceSpecificUsage 0..* +resourceMaintenance 0..* 1..* +identificationInfo 1..* 0..* +descriptiveKeywords 0..* +resourceConstraints 0..* MD_BrowseGraphic + fileName : CharacterString + fileDescription[0..1] : CharacterString + fileType[0..1] : CharacterString 0..* +graphicOverview 0..* MD_Resolution + equivalentScale : MD_RepresentativeFraction + distance : Distance > MD_CharacterSetCode + ucs2 + ucs4 + utf8 + utf16 + isoIec8859oneTo15 + jis + shiftJIS + eucJP > MD_DataIdentification + spatialRepresentationType [0..*] : MD_SpatialRepresentationTypeCode + spatialResolution [0..*] : MD_Resolution + language [1..*] : CharacterString + characterSet [0..1] : MD_CharacterSetCode = "utf8" + topicCategory [1..*] : MD_TopicCategoryCode + geographicBox [0..*] : EX_GeographicBoundingBox + geographicDescription [0..*] : EX_GeographicDescription + environmentDescription [0..1] : CharacterString + extent [0..*] : EX_Extent + supplementalInformation [0..1] : CharacterString MD_ServiceIdentification MD_RepresentativeFraction /+ denominator : Integer > Scale (from Units of Measure) /Scale Where MD_Representative Fraction.denominator = 1/Scale.measure And Scale.targetUnits = Scale.sourceUnits characterSet: documented if ISO 10646-1 is not used {MD_Metadata.hierarchyLevelCode = "dataset" implies count (geographicBox) + count (geographicDescription) >=1} MD_SpatialRepresentationTypeCode + vector + grid + textTable + TIN + stereoModel + video >

19 Citation data types

20 Extent data types

21 CodeListsCodeLists > MD_ProgressCode + completed + historicalArchive + obsolete + onGoing + planned + required + underDevelopment NameDomainCodeDefinition MD_ProgressCodeProgCodestatus of the resource completed001production has been completed historicalArchive002data has been stored offline obsolete003data is no longer relevant onGoing004data is continuously being... planned005fixed date has been established… required006data needs to be generated or... underDevelopment007data is currently in the process...

22 Why codelists Suggested items (pick lists)Suggested items (pick lists) Searchable (common representation)Searchable (common representation) Registered definition (dictionary)Registered definition (dictionary) Multi-lingualMulti-lingual

23 ISO 19115: 2003 Metadata data dictionary

24 Recommended core metadata for geographic datasets ü Dataset title ü Dataset reference date ü Dataset responsible party ü Geographic location of the dataset (by four coordinates or by geographic identifiers) ü Dataset language ü Dataset character set ü Dataset topic category – Spatial Resolution ü Abstract describing the dataset – Distribution format – Additional extent information (vertical and temporal) – Spatial representation type – Reference system – Lineage statement – On-line resource – Metadata file identifier – Metadata standard name – Metadata standard version ü Metadata language ü Metadata character set ü Metadata point of contact ü Metadata time stamp ü Mandatory

25 ISO 19115:2003 Annex E Comprehensive dataset metadata application schema

26 ISO 19115:2003 Annex E Comprehensive dataset metadata profile Comprehensive metadata application schema (UML model)Comprehensive metadata application schema (UML model) –Implementation profile –Applicable to a broad range of information communities –Complete range of metadata

27 ISO 19115:2003 Designed:Designed: –to support geographic information; –to work with wider information technology standards and practices; –to serve the global community, in a multi-national, multi-language environment; –based on a foundation of national, regional, and special information community standards and experiences Developed through a rigorous, consensus ISO processDeveloped through a rigorous, consensus ISO process

28 Resolution 226 - Proceeding of ISO DIS 19115 Metadata ISO/TC 211 resolves to delete the informative annex F, clause J.3 and any references to these, in ISO DIS 19115, as requirements for XML DTDs are replaced by requirements for XML schemas in 19118.ISO/TC 211 resolves to delete the informative annex F, clause J.3 and any references to these, in ISO DIS 19115, as requirements for XML DTDs are replaced by requirements for XML schemas in 19118. ISO/TC 211 instructs the secretariat to process the corrections above and other editorial and minor technical improvements in accordance with the ISO Directives, and to forward ISO DIS 19115 to the ISO Central Secretariat for issuing as FDIS. ISO/TC 211 instructs the secretariat to process the corrections above and other editorial and minor technical improvements in accordance with the ISO Directives, and to forward ISO DIS 19115 to the ISO Central Secretariat for issuing as FDIS. ISO/TC 211 resolves that an implementation UML model and an XML Schema for metadata in compliance with ISO 19115 and 19118 will be a new work item proposal for a Technical Specification. Based on discussions at the 14 th ISO/TC 211 plenary, the new work item proposal will be submitted for ballot by 2002-06-30. ISO/TC 211 resolves that an implementation UML model and an XML Schema for metadata in compliance with ISO 19115 and 19118 will be a new work item proposal for a Technical Specification. Based on discussions at the 14 th ISO/TC 211 plenary, the new work item proposal will be submitted for ballot by 2002-06-30.

29 ISO Technical Specification Geographic Dataset Metadata Implementation Separate from ISO 19115Separate from ISO 19115 Based on Comprehensive Profile ISO 19115Based on Comprehensive Profile ISO 19115 More easily evolve with changes in technologyMore easily evolve with changes in technology Quickly establish implementation of ISO 19115Quickly establish implementation of ISO 19115 XML SchemaXML Schema –More rigorous validation of compliance –More exacting representation of UML

30 Technical Specification implementation ISO-Comprehensive Geographic Metadata.xsd DCW.xml Recommended Core Metadata Schiphol Environmental Impact data.xml Full comprehensive metadata comprised of over 300 metadata elements NMA Specific.xsd VMap 1-NL.xml NMA cataloging profile which may include ISO recommended core plus additional selected metadata elements. The NMA XSD will define NMA specific metadata and code lists North Sea Soundings.xml only 12 mandatory metadata elements

31 ProfilesProfiles A standard related to a community of interest

32 Metadata profiles The ISO Metadata standard is a list of possible metadata elements A Profile is a selection of those elements that fit an organizations needs

33 Regional, national, & organizational profiles ANZLIC Profile Canadian Profile EO Profile European Profile US Federal Profile NATO Profile Profiles Enable Interoperability Between Communities ISO Standard 19115 Geographic Information - Metadata State Profile Navigation Profile

34 Building a Profile Requirements AnalysisRequirements Analysis –Scope –Community of interest –Applicable context –Functions that require support –Legacy systems –Life cycle (data)

35 Life Cycle Discovery/Retrieval of Information Planning Generate Task Tasking Request for collection Process/Exploit Data Dissemination/Archiving Acquisition Collect Data Request for Information SUCCESS FAILURE SUCCESS

36 New Metadata Work Items ISO/TS 19139 Geographic Information – Metadata – Dataset Implementation SpecificationISO/TS 19139 Geographic Information – Metadata – Dataset Implementation Specification ISO 19115-2 Geographic Information – Metadata – Part 2 Extensions for Imagery and Gridded DataISO 19115-2 Geographic Information – Metadata – Part 2 Extensions for Imagery and Gridded Data

37 ISO/TS 19139 This implementation specification is applicable to digital geographic datasets and can be used to describe many other forms of geographic data such as maps, charts, and textual documents. It provides information about the identification, the extent, the quality, the spatial and temporal reference, and the distribution of digital geographic data. More specifically, this specification provides an implementation UML model based on the ISO 19115 abstract UML model and defines an XML schema derived from the implementation UML model. Scope

38 ISO 19139 Geographic Dataset Metadata Implementation Specification Separate from ISO 19115Separate from ISO 19115 Based on Comprehensive Profile ISO 19115Based on Comprehensive Profile ISO 19115 More easily evolve with changes in technologyMore easily evolve with changes in technology Quickly establish implementation of ISO 19115Quickly establish implementation of ISO 19115 XML SchemaXML Schema –More rigorous validation of compliance –More exact representation of UML

39 Overview of ISO 19139 Draft Composed of three essential parts in the Requirements Clause:Composed of three essential parts in the Requirements Clause: –ISO 19139 expands Annex E of ISO 19115 to show all the metadata elements (Not XML Specific) –ISO 19139 also defines new constraint types to further refine the metadata elements for implementation (Not XML Specific) –ISO 19139 defines XML Schema for geographic information dataset metadata (XML Specific)

40 XML Schema Implementation Although the XML schema in ISO 19139 is to be used to provide metadata for digital geographic datasets, the schemas may also be applied to aggregations of datasets, feature types, individual features, attribute types, and individual attributesAlthough the XML schema in ISO 19139 is to be used to provide metadata for digital geographic datasets, the schemas may also be applied to aggregations of datasets, feature types, individual features, attribute types, and individual attributes

41 How Were Building ISO 19139 Harmonized ISO Model Implementation UML Model (ISO 19139) Intermediate XML Description Transformation with Rational Rose Scripts Metadata XML Schema (s) XSLT Transformation Stylesheet Create Implementation Model of Dataset Profile with Rational Rose Scripts

42 ISO 19139 Schedule Working Draft:2003-09Working Draft:2003-09 Preliminary Draft TS: 2004-02Preliminary Draft TS: 2004-02 Draft TS:2004-07Draft TS:2004-07 Technical Specification:2004-11Technical Specification:2004-11 Work is just starting – get involved

43 ISO 19115-2 Geographic Information – Metadata – Part 2 Extensions for Imagery and Gridded Data ScopeScope –This International Standard extends ISO 19115:2003 Geographic Information – Metadata by defining the schema and additional metadata required for imagery and gridded data

44 ISO 19115-2 Current ISO 19115 MetadataCurrent ISO 19115 Metadata –Some geospatial imagery support exists –Detailed imagery metadata definition purposely deferred Geospatial Imagery MetadataGeospatial Imagery Metadata –User Requirements (same as regular geospatial user requirements): –Locate –Evaluate –Extract –Employ –Requirements: Reside in a variety of disciplines and communities

45 ApproachApproach Take Advantage of the TC211 Harmonized ModelTake Advantage of the TC211 Harmonized Model –Develop UML model of new elements –Leverage existing elements where possible and appropriate –Do not interfere with existing implementations As ISO 19115 - Part 2As ISO 19115 - Part 2 –Augments ISO 19115 –Allows incorporation of new elements –Permits current standard to stand alone

46 Liaison Organizations and Related Work ISO 19115:2003 FGDC Metadata Remote Sensing Extensions FGDC Metadata Remote Sensing Extensions ISO 19115 - 2 Imagery Extensions ISO 19115 - 2 Imagery Extensions IHO S-57 Edition 4 IHO S-57 Edition 4 SMPTE JTC1/SC24 ISO/IEC 12087-5 BIFF JTC1/SC24 ISO/IEC 12087-5 BIFF Commercial SPOT Commercial SPOT Consortium IEEE ISPRS WMO Consortium IEEE ISPRS WMO

47 Proposed Extension Identification Information MD_DataIdentification MD_Identification New Imagery Elements and Existing Classes Number_of_Thematic_Layers Mission_Completion Mission_Description Mission_Significant_Event Mission_Start_Date Data_Dictionary_Reference Science_Paper User's_Guide Platform_Information Platform_and_Instrument_Identification

48 Proposed Extension Data Quality – Lineage LI_ProcessStep Algorithm_Change_History Algorithm_Identifiers Algorithm_Peer_Review_Information Algorithm_Reference Algorithm_Text_Description Command_Line_Processing_Parameter Processing_Change_History Processing_Documentation Processing_Identifiers Processing_Procedure_Description Processing_Run_History Processing_Software_Reference New Imagery Elements and Existing Classes

49 ISO 15115-2 Schedule Working Draft:2003-09Working Draft:2003-09 Committee Draft:2004-08Committee Draft:2004-08 CD2:2005-03CD2:2005-03 Draft International Standard: 2005-09Draft International Standard: 2005-09 Final DIS:2006-05Final DIS:2006-05 IS:2006-08IS:2006-08

50 Implementing ISO 19115

51 Geographic Data and Services Life Cycle End User 6. Use Distributed GIS activities Create Data and Services 1. Create Content Query, Discover 5. Discover Document with Metadata 2. Document (Metadata) Metadata Catalog 3. Catalog Publish Services 4. Publish Catalog Portal

52 ArcCatalogArcCatalog A tool for exploring and managing geographic dataA tool for exploring and managing geographic data –File-based data on disk in many formats –Design and implement spatial databases in an enterprise RDBMS –Access vector, image, metadata services on ArcIMS Internet servers

53 Design goals for metadata in ArcCatalog Make it easy to create and use metadataMake it easy to create and use metadata –Create editors that are easy to use –Create and update metadata automatically with a datasets current properties

54 Design goals for metadata in ArcCatalog Support ISO metadata content standard out-of-the-boxSupport ISO metadata content standard out-of-the-box –Support other standards through customization Support metadata for everythingSupport metadata for everything –Geographic data, non-spatial files, folders, databases, etc.

55 Design goals for metadata in ArcCatalog Metadata is part of the dataMetadata is part of the data –Travels with the data when copied, moved, renamed, or exported –Doesnt get lost Achieve our goals using open, flexible, industry standard technologyAchieve our goals using open, flexible, industry standard technology –Metadata stored in XML format

56 ISO metadata tools in ArcCatalog Editor for typing informationEditor for typing information Stylesheets for viewingStylesheets for viewing Synchronizer for updating automaticallySynchronizer for updating automatically Importers and exportersImporters and exporters Translator from one standard to anotherTranslator from one standard to another

57 ISO metadata editor Wizard-based editor designed for the average personWizard-based editor designed for the average person Elements are introduced by plain languageElements are introduced by plain language Navigate with Next and Back buttons or go directly to a page using the TOCNavigate with Next and Back buttons or go directly to a page using the TOC Handles core elements as defined by 19115Handles core elements as defined by 19115

58 ISO Metadata Editor

59 ISO Synchronizer Automates much of the work for metadata collection and maintenanceAutomates much of the work for metadata collection and maintenance Vector and raster information, spatial reference, etc.Vector and raster information, spatial reference, etc. ArcIMS Services Files Automatically senses and records properties

60 ArcCatalog Internet ArcIMS Metadata Server ArcSDE Author Publish Discover ArcIMS 4.0 allows easier metadata publishing Metadata Server

61 Metadata Server Goals DATA SHARING!!!DATA SHARING!!! –Provide a central repository of metadata that can be accessed by everyone over the internet. –A place for data producers to publish their data and data consumers to find the data. –Using ArcCatalog publishers can publish to multiple metadata servers

62 Publishing Metadata Publish metadata by copy/paste or drag/dropPublish metadata by copy/paste or drag/drop –Copy/drag the metadata onto the Metadata Server folder to publish Metadata is copied to the ServerMetadata is copied to the Server –a new record is created in the database for this metadata dataset. –Contents are indexed to optimize search and retrieval. Must have publishing privileges.Must have publishing privileges.

63 Searching for Geospatial Data Metadata Catalog Geography Network ArcCatalog HTML or Java Clearinghouse Z39.50 Metadata Explorer

64 Searching Metadata Use ArcCatalog or the web-based Metadata Explorer as the search client.Use ArcCatalog or the web-based Metadata Explorer as the search client. Searching a metadata repository is possible in 2 ways:Searching a metadata repository is possible in 2 ways: 1.Via selected search criteria (keyword, extent, content type, data theme). 2.By browsing through the hierarchy of documents.

65 CustomizingCustomizing Metadata ExplorerMetadata Explorer -Graphics -Title -Search criteria -Help instructions -Display of results, details, map views Metadata ServerMetadata Server -Custom content -Based on XML –ISO –FGDC –National profile

66 ISO 19115 development –based on a solid foundation of national, regional, and information community standards –has broad global participation –has gone through formal development cycles New ISO metadata work initiated – –ISO 19139 Metadata implementation Technical Specification – –Robust implementation / Validation – –ISO 19115-2 Imagery – –Improved imagery metadata – –Developed by imagery experts from around the world Summary ISO Metadata Metadata is absolutely essential for all aspects of spatial data handling –Locate –Evaluate –Extract –Employ the foundation for a Global Spatial Data Infrastructure ISO standard metadata –Allows expanded networks –Provides a common understanding –Global Interoperability


Download ppt "ISO/TC211 Geographic information/Geomatics Metadata David Danko Work Item 15 - Project Leader"

Similar presentations


Ads by Google