Publishing Clearinghouse resources to geodata.gov Doug Nebert FGDC Secretariat Geospatial One-Stop Team September 17, 2004

2 NSDI: a Foundation for GOS Geospatial One-Stop (GOS) implements the principles of the NSDI spelled out in Executive Order (recently revised) GOS builds on the resources already available in the NSDI – FGDC and endorsed external Framework Standards, NSDI Clearinghouse Network Operated as project coordinated through FGDC Secretariat with many agency partners

3 Geodata.gov and the NSDI Clearinghouse Over 150 collections of metadata exist within searchable NSDI Clearinghouse Nodes in the US All FGDC metadata records are searchable by fields and full-text through six replicated search gateways Additional non-Z39.50 metadata collections exist that should be part of the NSDI via geodata.gov

4 What's different about One-Stop? GOS has a timeline for implementation of the various modules Standards are being developed with multi- sectoral stakeholders as national (ANSI) standards, not FGDC ones Visibility of the initiative as one of 24 e-gov initiatives from the Administration Goals include measures of costs and savings through cost-sharing in data acquisition, processing, and service of geospatial data

5 Some operational features geodata.gov will speed and simplify search and browse of metadata as a replacement for the domestic NSDI Gateways Metadata are harvested from remote collections into a single metadata ‘cache’ to speed search and ranking Browsing for geospatial data is made possible through common ISO Categories

6 Portal at geodata.gov OGC Web Map Services (WMS) and ArcIMS ‘image’ services supported in viewer where links provided in metadata (Online_Linkage) Data, map services, static maps, and applications are among the resource types indexed Channels (thematic communities) post selected browseable content

7

8 How do I publish? Before you can publish metadata in geodata.gov, you need to register as a publisher After your registration is completed, you will have username and password to access the portal as a publisher

9 1. Start registration: Login 2. Register online

10 3. Complete user account information 4. Receive and confirm registration 5. Read and accept publisher agreement

11 6. Complete publisher registration Publisher main menu

12

13 Current Publication Options Users may contribute metadata one of three ways: Enter FGDC metadata into a form at geodata.gov and they are stored and indexed there Upload metadata as FGDC XML to the geodata.gov site Register their existing metadata collection to be harvested into the GOS metadata repository

14 metadata cache geodata.gov map viewer metadata data form entry XML upload search map services

15 Data Entry Form If you do not have any FGDC metadata and anticipate only a few records to be published to geodata.gov you can use an online entry form to collect abbreviated FGDC metadata that will be hosted at geodata.gov

16 Upload XML Metadata If you have access to a metadata editor such as ArcCatalog but do not have a Z39.50 server or ArcIMS Metadata Server you can upload a small set of FGDC metadata to geodata.gov

17 Register metadata site(s) to be harvested (must use Internet Explorer 6+)

18 Help files

19 Metadata Validation Valid values for minimum FGDC: Derived values, for example resource type (Live Map, Downloadable Data…) In your FGDC Online_Linkage field: For a OGC Web Map Server, enter: For an OGC Web Feature Service, enter: For an ArcIMS image service, enter: For an ArcIMS feature service, enter:

20 Harvesting Option If you have or would like to maintain a collection of metadata at your site and can let geodata.gov know its location, geodata.gov can ‘harvest’ or fetch new and updated metadata to make it searchable You can describe any type of resource (planned data activity, existing data, a map service, an application, etc.) using your published set of metadata

21 Harvesting options A provider wanting to have content harvested into in geodata.gov can register: Z39.50 “GEO” Metadata server (NSDI Clearinghouse Node) ArcIMS Metadata Server OAI-PMH (Open Archives Initiative, Protocol for Metadata Harvest) Web Accessible Folder

22 Harvesting capabilities Harvesting is a scheduled retrieval of metadata from a remote collection, such as an existing Clearinghouse Node The harvester detects new content and brings it into a metadata ‘cache’ at geodata.gov for inclusion in search Scheduling can be established in the registration profile of each provider

23 If you have a Z39.50 Clearinghouse Node If your metadata collection is served on Z39.50 (such as Isite), you need to implement the newest version of Isite (2.10) Update version for Isite is available at: ftp://ftp.awcubed.com/pub/Software/Isite2/ Other brands of Z39.50 software (Compusult, Intergraph, ESRI, Blue Angel) will be implementing the new features for harvest in coming months

24 Web Accessible Folder Simplest option for publishing moderate numbers of metadata records (<1000) from an organization Create browse-enabled web directory (directory listing view, no default.htm or index.html file present) with FGDC XML and optionally HTML records present Register organization and WAF location with geodata.gov Initial harvest pulls all content, subsequent harvests pull only changed content based on file time-stamps

25 Inclusion Strategy FGDC Staff has been working on an outreach and ‘inclusion’ schedule to get all domestic Clearinghouses (Z39.50 and otherwise) from State/Local, Federal, and Commercial sources Encourage partnerships and community networking to include as many resources as possible

26 Summary Steps If you have FGDC metadata, get it in XML form and register as a publisher Evaluate a crosswalk of your theme keyword values with ISO Categories Insert map service and/or download URLs in your Online_Linkage fields – you may have multiple onlinks! Consider an upgrade of software or change of protocol to be more efficient in your services Depending on your site: register to be harvested, use form to enter individual records, or upload multiple XML files View and test your resources once the registration and publishing is processed using the geodata.gov viewer

27 Metadata harvest counselors Federal Providers Sharon Shin, Sharon Maccini, Western States Doug Nebert, Intermountain/Great Plains, Northeast States Matt Orstad, Gulf/Southern States Lynda Wayne, Midwest, Carolinas, Mid-Atlantic States Melissa Wegner,