Page 1 CSISS Center for Spatial Information Science and Systems WGISS-37 meeting,2014 CWIC OpenSearch Implementation Yuanzheng Shao, Lingjun Kang, Archie Warnock {yshao3, WGISS-37 CWIC Project, April 15, 2014

Page 2 CSISS Center for Spatial Information Science and Systems Outline CWIC OpenSearch introduction Data provider analysis CWIC OpenSearch architecture CWIC OpenSearch interface design CWIC OpenSearch interaction

Page 3 CSISS Center for Spatial Information Science and Systems CWIC OpenSearch Introduction WGISS37 - CWIC OpenSearch Implementation

Page 4 CSISS Center for Spatial Information Science and Systems CWIC provides a common access point to search and access satellite data from the CEOS agencies Unified query interface and response achieved across all integrated data center CWIC enriched existing data center by implementing both CSW interface and OpenSearch interface CWIC does not harvest any data or metadata CWIC OpenSearch Introduction

Page 5 CSISS Center for Spatial Information Science and Systems Data Provider Analysis WGISS37 - CWIC OpenSearch Implementation

Page 6 CSISS Center for Spatial Information Science and Systems Heterogeneity among existing data providers –Different web portal –Different query language and queryables –Different metadata model –Different data access method Data Provider Analysis - Heterogeneity

Page 7 CSISS Center for Spatial Information Science and Systems Data Provider Analysis – 1/3 Data provider Search criteria Native query method Data access URL Datasets number b CSW & OS Support spatialtemporalEntry ID CSWOS NASA ECHOOORSOAP & OSDownload1704 NY Brazil INPERORWeb APIOrder15 NN NOAA GHRSST OORCSWDownload51 YY CCMEOOOO a CSW & OSOrder2 YY USGS/LSIOORSOAPDownload and order 38 NN a The numbers vary over time due to data provider update their records in GCMD. b CCRS provides two CSW endpoint for RadarSat-1 and 2 respectively. Required (R)Optional (O)Not Applicable (NA) Refer CWIC-DOC r3

Page 8 CSISS Center for Spatial Information Science and Systems Data Provider Analysis – 2/3 Refer CWIC-DOC r3 Data provider Support Date Support Time Support Single Temporal point a Support Multiple TOI b Temporal Operator Chronological sorting NASA ECHO YesNoYes Before, After, BetweenAscending Brazil INPEYes NoOverlapsDescending NOAA GHRSST Yes Between, EqualTo, GreaterThan, GreaterThanEqualTo, LessThan, LessThanEqualTo Descending CCMEOYes EqualTo, LessThan, GreaterThan, LessThanEqualTo, LessThanOrEqualTo, GreaterThanEqualTo, GreaterThanOrEqualTo Descending USGS/LSIYes NoOverlapsAscending

Page 9 CSISS Center for Spatial Information Science and Systems Data Provider Analysis – 3/3 Refer CWIC-DOC r3 Data provider Support BoundingBox Support Polygon Support multiple AOI Coordinates Order Coordinate Projection Spatial Operator NASA ECHO Yes N/AEPSG:4326Equal, Touch, Within, Contains, Relate Brazil INPEYesNo N/AEPSG:4326BBOX NOAA GHRSST Yes long latEPSG:4326BBOX, Contains, Disjoint, Equals, Intersects, Overlaps, Within CCMEOYes long latEPSG:4326BBOX, Equals, Overlaps, Disjoint, Intersects, Touches, Crosses, Within, Contains USGS/LSIYesNo N/AEPSG:4326BBOX

Page 10 CSISS Center for Spatial Information Science and Systems In order to discover data from multiple data centers, users need to –deal with different web portal –manage multiple user account information –get familiar with different query interface –understand different metadata model Data Provider Analysis - Challenges

Page 11 CSISS Center for Spatial Information Science and Systems CWIC OpenSearch Architecture WGISS37 - CWIC OpenSearch Implementation

Page 12 CSISS Center for Spatial Information Science and Systems CWIC Architecture Design Mediator-wrapper –Mediator Receive a query from data client Dispatch request to relevant wrapper Assemble and return the query results –Wrapper Translate global query language to native query language Execute data inventory search Convert native metadata model to global metadata model Return response to mediator

Page 13 CSISS Center for Spatial Information Science and Systems CWIC OpenSearch Architecture CWIC Mediator CWIC OpenSearch Service Interface Mediator Core IDN Legend CWIC – Wrapper CWIC – Mediator OGC CSW Protocol Java API Native Protocol OpenSearch API CWIC OpenSearch Clients OpenSearch Interface USGS Landsat Connector USGS Landsat Connector OpenSearch Interface NASA ECHO Connector NASA ECHO Connector OpenSearch Interface Brazil INPE Connector Brazil INPE Connector OpenSearch Interface CCMEO Connector CCMEO Connector USGS LSI Brazil INPE NASA ECHO Canada CCMEO Canada CCMEO OpenSearch Interface NOAA GHRSST Connector NOAA GHRSST Connector NOAA GHRSST

Page 14 CSISS Center for Spatial Information Science and Systems CWIC OpenSearch Design WGISS37 - CWIC OpenSearch Implementation

Page 15 CSISS Center for Spatial Information Science and Systems CWIC Best Practice OGC r8 –OGC OpenSearch Geo and Time Extensions OpenSearch Draft 5 – raft_5 ATOM Syndication Format – CWIC OpenSearch Design - Standards

Page 16 CSISS Center for Spatial Information Science and Systems Aim –generating OpenSearch description document dynamically based on the dataset identifier. Instruct the granule-level querying –Customized response for each dataset, hard-coded the dataset identifier in the query template Parameter –datasetId: used to specify dataset identifier (optional) –clientId: used to specify client identifier (mandatory) Sample OSDD request ( RESTful request ) – sdd.xml?clientId=chromeTest CWIC OpenSearch Design - OSDD

Page 17 CSISS Center for Spatial Information Science and Systems Dataset Identifier (mandatory) –The dataset identifier (datasetId) parameter is used to specify the dataset identifier which could be retrieved from IDN as DIF Entry ID. This parameter is a required parameter. The client can not specify more than one dataset in single request –Required namespace: xmlns:cwic=" Client Identifier (optional) –The client identifier (clientId) parameter is used to identify user information CWIC OpenSearch Design – Request (datasetId)

Page 18 CSISS Center for Spatial Information Science and Systems Temporal Extension (optional) –Adopted OGC r8 –Required namespace: xmlns:time=" Parameter Values –time:start - a string describing the start of the temporal interval to search (bigger or equal to) –time:end - a string describing the end of the temporal interval to search (smaller or equal to). Format –Character string with the start of the temporal interval according to RFC-3339 date only: YYYY-MM-DD date-time: YYYY-MM-DDTHH:MI:SSZ CWIC OpenSearch Design – Request (temporal)

Page 19 CSISS Center for Spatial Information Science and Systems GEO Extension (optional) –Adopted OGC r8 –Required namespace: xmlns:geo=" Parameter Value –geo:box - the bouding box specifying the area of interest Format –the box is defined by "west, south, east, north" coordinates of longitude, latitude, in an EPSG:4326 decimal degrees. CWIC OpenSearch Design – Request (GEO)

Page 20 CSISS Center for Spatial Information Science and Systems Used namespace in ATOM Response CWIC OpenSearch Design – ATOM Response Namespace URL xmlnshttp:// xmlns:opensearchhttp://a9.com/-/spec/opensearch/1.1/ xmlns:dchttp://purl.org/dc/elements/1.1 xmlns:georsshttp:// xmlns:geohttp://a9.com/- /opensearch/extensions/geo/1.0/ xmlns:timehttp://a9.com/- /opensearch/extensions/time/1.0/ xmlns:cwichttp://cwic.wgiss.ceos.org/opensearch/ex tensions/1.0/

Page 21 CSISS Center for Spatial Information Science and Systems element CWIC OpenSearch Design – ATOM Response Element Value titleFixed value: CWIC OpenSearch Response updatedCurrent system date/time authorFixed value: CEOS WGISS Integrated Catalog (CWIC) - CWIC Contact - Web: idFixed value: linkProvide the “self” link corresponding to the request linkProvide the “search” link corresponding to the OSDD request opensearch:totalResultsThe number of search results available for the current search. opensearch:startPageReplaced with the page number of the set of search results desired by the search client. opensearch:itemsPerPageThe number of search results returned per page. opensearch:QueryDefines a search query that can be performed by search clients.

Page 22 CSISS Center for Spatial Information Science and Systems / element CWIC OpenSearch Design – ATOM Response Element Value titlegranule name idFixed URL prefix followed by granule identifier. For example: SST_s2348_e2352-v01.nc.bz2 updatedgranule update time authorFixed value for each data provider georss:boxbounding box of specific entry dc:datetemporal range of specific entry summarya text construct that conveys a short summary, abstract, or excerpt of an entry. linksee next slide

Page 23 CSISS Center for Spatial Information Science and Systems / / element CWIC OpenSearch Design – ATOM Response Type of link Definitionrel valuemime-type datalink representing a data file or other science data resource; enclosureapplication/x-netcdf, application/x-hdf, etc. metadatafile with (usually) structured information about corresponding data files viatext/xml browserimage of the data typically used for making data request decisions iconimage/jpeg, image/png etc. ordergranule ordering urlenclosuretext/html

Page 24 CSISS Center for Spatial Information Science and Systems / / for OPeNDAP CWIC OpenSearch Design – ATOM Response Type of link Definitionrel value mime-type Onlinkurn:x-esri:specification:ServiceType:ArcIMS:Metadata:Onlinkenclosuretext/html Thumbnailurn:x-esri:specification:ServiceType:ArcIMS:Metadata:Thumbnailiconimage/png (for GHRSST) Documenturn:x-esri:specification:ServiceType:ArcIMS:Metadata:Documentviatext/xml TDSurn:x-esri:specification:ServiceType:TDSenclosureapplication/x-bzip2 FTPurn:x-esri:specification:ServiceType:FTPenclosureapplication/x-bzip2 OPeNDAPurn:x-esri:specification:ServiceType:OPeNDAPenclosuretext/html LASurn:x-esri:specification:ServiceType:LASiconimage/png (for GHRSST) Downloadurn:x-esri:specification:ServiceType:Downloadenclosureapplication/x-bzip2 WMS/WCSurn:x-esri:specification:ServiceType:WMS urn:x-esri:specification:ServiceType:WCS enclosuretext/xml

Page 25 CSISS Center for Spatial Information Science and Systems CWIC OpenSearch Interactions WGISS37 - CWIC OpenSearch Implementation

Page 26 CSISS Center for Spatial Information Science and Systems CWIC OpenSearch Sequence Diagram

Page 27 CSISS Center for Spatial Information Science and Systems Register Dataset Dataset EntryId Data Provider Dataset Query EntryId of Dataset DatasetId EntryId Pair EntryId DatasetId GCMD Title OpenSearch Query (EntryId) Data Provider Query Query Result OpenSearch ATOM Result CEOS International Dictionary Network CWIC CWIC OpenSearch Client CWIC OpenSearch Interactions

Page 28 CSISS Center for Spatial Information Science and Systems Questions?