1. CEOS OpenSearch Project Yoshiyuki Kudo (JAXA) WGISS-37

2. Project StatusYoshiyuki Kudo CEOS OpenSearch Best PracticeYoshiyuki Kudo Agency Implementations –CNESJérôme Gasperi –IDN,CWIC,ECHODoug Newman –FedEO (will be reported prior to this session) Agenda of the session 1

3. Project Status 2

4. How to achieve interoperability between CWIC and FedEO ? (SIT meeting, 2012) –CWIC : NASA, NOAA, USGS, CCMEO, INPE, AOE, … –FedEO : esa, other catalog systems in Europe Solution : OpenSearch interface on both –Simple specification –Low-hurdle for implementation –Adoption in OGC Catalog Service Project formed at WGISS-35 （ May 2013, INPE ） 3 CWIC Clients CWIC 1 FedEO(HMA) 2 CSW 2.0.2 ISO Profile CSW 2.0.2 ebRIM EO Profile FedEO Clients History

5. Objective 4 GEO/CEOS Portals IDN/CWICFedEO(HMA) OpenSearch Other CEOS Catalogs Establish a common CEOS interoperability best practice of OpenSearch in order to allow for standardized and harmonized access to metadata and data of CEOS agencies, including CWIC and FedEO communities.

6. Project Member AgencyName JAXA Yoshiyuki Kudo (Co-Lead) Satoko Miura ESA Pier Giorgio Marchetti Giuseppe Troina Yves Coene NASA Andrew Mitchell Yonsook Enloe Douglas Newman Christopher Lynnes CNES Richard Moreno Jérôme Gasperi (Co-Lead) NOAA Martin Yapur Kenneth McDonald CCMEO Patrick King 5

7. A collection of simple formats for the sharing of search results –OpenSearch description document (OSDD) –Response in syndication formats (eg. Atom, RSS, etc) –Complementary pamameters/elements Query parameter : searchTerms, count, startIndex, startPage,… Results element : totalResults, startIndex, itemsPerPage, … OpenSearch 6 What is OpenSearch ?

8. http://foo.ceos.org/opensearch/index.html OpenSearch 7 http://foo.ceos.org/search?q=precipitation&ts=2012-04-01&te=2012-06-30 Discovery load a web page and notice support of OpenSearch http://foo.ceos.org/opensearch/description.xml OSDD (xml) Service Description search result (eg. Atom) Search Response What is OpenSearch ? ServerClient Examine URL template and construct valid search query My resource is available in this way http://foo.ceos.org/search? q={searchTerms?}&ts={timeStart?} &te={timeEnd?} &... http://foo.ceos.org/search? q=precipitation &ts=2012-04-02 &te=2012-04-06 &...

9. OpenSearch specs & related documents 8 OpenSearch Geo + Time Extension [OGC 10-032] OpenSearch Geo + Time Extension [OGC 10-032] OpenSearch EO Extension [OGC 13-026] OpenSearch EO Extension [OGC 13-026] OpenSearch Parameter Extension OpenSearch Parameter Extension O&M EO Metadata [OGC 10-157] O&M EO Metadata [OGC 10-157] Time and Space parameters For search request and response Parameters specific to EO （ Search request and response ） Enhancement to OSDD Metadata Model OGC opensearch.org What is OpenSearch ?

10. CEOS OpenSearch Best Practice ? OGC specifications : comments submission CEOS OpenSearch Best Practice Document –In Google Docs Common Best Practices to date – 2 Step Search – Search Request – Search Response (Atom) – Search Engine Discovery Status 9

11. CEOS OpenSearch Best Practice ? Compliant to OGC OpenSearch specification –OpenSearch Geo and Time Extensions [10-032] –OpenSearch EO Extension [13-026] Best Practice ≠ Specification, but … –Define implementation requirements where necessary (option  requirement) –For users benefit Maintain Simplicity 10

12. Coordination with OGC –Review and provide comments on OGC specs by CEOS project members –Comments not fit OGC specification ? CEOS OpenSearch Best Practice 39 comments collected Submitted to OGC –Directly to the author (34 comments) –In public comment period (5 comments) Comments submission to OGC 11

13. Introduction to CEOS OpenSearch Best Practice (draft) 12

14. Draft stage Under work on Google Docs Document Status 13

15. Document Content Chap1: Introduction Chap2: Common Best Practices Chap3: Closer Look On Implementations CWIC FedEO CNES … Chap4: Reference 14

16. 2 step search 15 ADEOS OCTS RTC L1A VNI Dataset Dataset (Collection) time... ALOS PALSAR L1.1 Dataset... Granule (File) space Best Practice Satellite data granularity / hierarchy 2 Step –First step : Dataset level search –Second step : Granule level search Eg. Step 1 Step 2

17. 16 Client Server Request for OSDD XML OpenSearch request – Dataset level XML OSDD Atom OpenSearch request – Granule level XML Atom XML OSDD Step 1 Step 2 Construct search query Based on URL template Construct search query Based on URL template Parse response (Atom) and Discover OSDD URL for granule level search 2 step search Best Practice Request for OSDD of a specific dataset

18. Search Query 17 http://foo.ceos.org/search? q={searchTerms?}&ts={timeStart?}&te={timeEnd?}&... pf={platformShortName?}&ins={instrument?}&ob={orbitType?}&.. Server Client Common rules –Multiple words in {searchTerms} Specify in OSDD by Parameter Extension, or Fixed rule (when not supported in the parameter extension) –q=air+temperature : air AND temperature –q="air+temperature" : “air temperature” in phrase –Recommended list of query parameters (incl. combination) e.g. geo:name with geo:radius to define a search area ? Which gazetteer for geo:name values ? Best Practice

19. Search Result 18 server client Atom Search Response Best Practice Common rules (applicable to Atom response) –Use atom:link@rel=“alternate” for detailed metadata –Use GeoRSS Simple for Geographical area （ cf. GeoRSS GML ） –Browse in Atom : either is OK (clarified in 13-026 ??) atom:link@rel=“icon” (for browse, not for thumbnail (TBD)) media:group (explicit notation for browse, thumbnail, bitmask) Server Client

20. Case 1 ① Keywords (eg.variable name, disaster, location name,etc ） ② Discovery of portals ③ Make search in the portal ④ Discovery of satellite data Case 2 ① Keywords (eg.variable name, disaster, location name,etc ） ② Discovery of satellite data Discovery from Search Engines 19 OpenSearch can help Big hurdle Best Practice

21. 20 source: Jerome Gasperi / WGISS-35 Discovery from Search Engines Best Practice

22. Discovery from Search Engines Practice #1 –Support of html response at the OpenSearch server –Schema.org (https://schema.org/Dataset)https://schema.org/Dataset doi:10.3334/ORNLDAAC/1 1 ORNL_DAAC ABSTRACT: USGS 15 minute stream flow data for Kings Creek on the Konza Prairie 2000-01-01T00:00:00Z/ -55.0 -180.0 90.0 180.0 http://schema.org/Dataset Practice #2 –Jerome will present about this 21 Best Practice

23. Remaining topics Best Practices on –List of search parameters and Atom response elements –Exceptions –Ranking Server side Client side (how to deal with multi-source results) –etc. Implementation specific practice (CWIC,FedEO) “Compliance” test suite Reference Client 22

24. CEOS OpenSearch Workshop at WGISS-38 Purpose –Workshop to educate : for Client implementers: –How to access and make better use of CEOS catalogs using OpenSearch for server implementers: –How to implement an OpenSearch server aligning with Best Practice to expose agencies’ satellite data catalog Possible Agenda Items –Walk through of the best practice document –Demos –Code sharing etc. Continued support prepared in CEOS OpenSearch web page 23

25. Schedule 24 20142015 WGISS-37 AprilSep CEOS OpenSearch Best Practice Document WGISS-38 Base for draft (Feb 6) Ver 1.0 Feb May Oct-Nov Workshop for Client/server implementers WGISS-39 draft Refinement towards v.1.0 Jul We are here

26. Q&A 25