Hervé CAUMONT OGC Interoperability Program Team GEOSS Architecture Implementation Pilot (AIP) CEN/TC 287 workshop on Interoperability between INSPIRE, GMES, and GEOSS 8-9 November 2010, JRC Hervé CAUMONT OGC Interoperability Program Team

Intro - Focus of the workshop Contribute to the data interoperability between: INSPIRE data specifications GMES data product specifications GEOSS data “Shape” the GMES initial operations concerning data products

Presentation summary Outcomes of the GEOSS Architecture Implementation Pilot (AIP) process Current activities within GEOSS related to Data, Metadata and Products Harmonization (GEO Task DA-09-01b and coordination activities) Data Harmonization & AIP-3 results, an overview GMES Sentinel-1 Data Products and Data Accuracy Ground-segment Harmonization - HMA Evaluation of GMES input data for modeling …. GSE Forest Monitoring fundings…

1) GEOSS AIP Process Outcomes

Focus on some drivers of the GEOSS development Harmonization of data, metadata & products Data Tagging Usage & Permissions Information extraction Life-cycle management Interoperability accross registries Data Sharing Principles GEO multiplicity: organisational models, stakeholders, governance rules, fundings, levels of implementation, technical approaches, timelines Cape Town declaration, DSTF Impl. Guidelines GEOSS Data CORE, QA4EO guidelines for metrology and the question of their extension to address GEOSS SBAs needs Current issues of need for inventory, and need for harmonization of fragmented observations

A process, elaboration of GEOSS Architecture SBA Tasks, UIC, CBC, STC URR, Data Sharing Task Force Transfer to operations 2011-2015 User Needs, Scenarios requirements Design, Develop, Deploy ADC activities including: Architecture Implementation Pilot (AIP) Task AR-09-01b DSP QA4EO LTDP support Operational Capability SIF outreach GEOSS Common Infrastructure (GCI) Task AR-09-01a persistent implementation GCI-Coordination Team Of particular interest for the GMES data products : - Data Sharing Principles, Quality Assurance for Earth Observations, SIF convergence guidelines and practices - Long Term Data Preservation - Risk Management, disaster/failure recovery 6

AIP Reusable Process for Deploying Scenarios Scenarios: end user view of the value of GEOSS Focused on topics of interest to a community Occur in a geographic Area of Interest (AOI) Steps in a scenario are mapped to Use Cases Engineering Use Cases support SBA Scenarios Use cases for discovery, data access, etc Utilize Standards & Interoperability Arrangements Reusable service oriented architecture Leverages ‘operational domain value’ through interoperable services

AIP-2 Achievements Community of Practice Scenarios deployed through collaboration with SBA Tasks Reusable Process for applying scenarios on Service oriented Architecture – GEOSS SoA Contribution/registration of persistent services using GEOSS Interoperability Arrangements AIP-2 Call for Participation June 2008 Demonstrations to GEO Committees May 2009 Reports Completed September 2009

AIP-3 builds on AIP-2 process Build on GCI and Community Services Promote mash-ups in a "link-rich" environment OGC continue as Task Lead Engage additional Communities of Practice (CoP) Focus on Data; Promote Content Results in time to support EO Summit AIP-3 Call for Participation January 2010 Kickoff Workshop March 2010 Demonstrations for EO Summit September 2010 All Deliverables Completed November 2010

Scenarios in AIP CFP Scenarios begun in AIP-2 Scenarios new in AIP-3 Disaster Management Health: Air Quality Biodiversity and Climate Change – Prediction of an Ecosystem Evolution Biodiversity and Climate Change – Arctic Spatial Data Infrastructure Renewable Energy Water – Drought Water – Water Quality Extreme Precipitation Health and the Environment Scenario – Early Warning of Malaria

AIP-3 Status – To Date What is working ? What are the potential impacts on the GCI ? What is still needed ?

AIP-3 Status – To Date What is working ? Sharing of information/knowledge/best practices across communities Coordination with GEO Tasks Alignment of AIP activities with funded activities and community priorities Community/scenario-driven approach Self-explanatory

AIP-3 Status – To Date What are the potential impacts on the GCI ? Data access conditions & user management Metadata Possible new GCI component GEOSS Common Record Impact on clearinghouse, CSR, etc Data quality, lineage, etc Semantic-enabled search Registration of ontologies Possible brokering component Self-explanatory

AIP-3 Status – To Date What is still needed ? More interoperability GEOSS Common Record, Semantics, WPS Profiles Finding the right balance More documentation More sharing of lessons learned Increased usage of the GEOSS best practices wiki Continued coordination with other GEO Tasks Many challenges remain within communities Challenges spanning technical and organizational issues Self-explanatory

Architecture Video for Ministerial Theme : Bold vision endorsed 5 years ago Architecture vision has now been demonstrated Ministers should invest in their agency developments consistent with plan Sources : AIP-2 Demo Videos Interviews South Africa Summit Footage GEOSS Design themes http://www.ogcnetwork.net/geoss/aip-3/ A short video is being developed for use at the ministerial in November.

2) Data, Metadata & Products Harmonization Some perspectives from GEOSS AIP

AIP depends on other GEO Tasks DI-09-02: Multi-Risk Management DI-06-09: Use of Satellites for Risk Management WA-06-02: Droughts, Floods and Water Management WA-06-07: Water Resource Management BI-07-01: BON EN-07-02 - Energy Enviro. Impact HE-09-01: Info Systems for Health HE-09-02: Monitoring and Prediction for Health US-09-01: User Engagement DA-06-01: Data Sharing Principles DA-09-01: Data Management DA-09-02: Data Integration and Analysis DA-09-03: Global Data Sets AR-09-02: Interoperable Systems for GEOSS AR-09-04: Dissemination and Distribution Networks

The « Data Harmonization » topic GEO Task AR-09-01b (AIP) Emergence of Data Harmonization topic, pilot and input for the GEO Task DA-09-01b Emphasis on Data Quality and Uncertainty Management GEO Task DA-09-01b Data, Metadata and Products Harmonization Other GEO Tasks (Data Integration, Global Datasets…) INSPIRE 2010 Conference and Workshops Numerous sessions with Data Harmonization topic OGC A cross-WG topic : SensorML, O&M, GML, WCS… Could be similar to OWS for service interfaces Could reach out the Data Quality SWG

Soil top soil moisture modeling into root zone soil moisture GMES Data Products Scenarios that require cross-border and cross-theme data integration, leading to the identification of interoperability requirements in different application areas… Statistical data for modeling dry deposition rates of atmospheric acidifying components into forest ecosystems Soil top soil moisture modeling into root zone soil moisture … Modeling: do the GMES Data Products comply to user requirements & acceptance criteria ? GMES MyOcean scenario considered by GIGAS

INSPIRE Data Usability (GIS4EU)

QA4EO for GEO QA4EO was developed to meet the current and aspirational needs of the societal themes of the Group on Earth Observation (GEO)’s Global Earth Observation System of Systems (GEOSS) It was prepared as a direct response to GEO task DA-06-02 (now DA-09-01a) to “Develop a GEO data quality assurance strategy” It is beginning with space-based observations, and evaluating expansion to in situ observations, taking account of existing work in this arena”

QA4EO Workshop Sessions 2-4 « QA4EO and GEO » assets: Quality assurance process Metrology domain to be extended towards GEO SBAs Roles for Data harmonization / Data interoperability End to end process to identify open issues QA4EO seen as a ‘badge/stamp’ first a questionnaire to assess and auto-declare conformance then possibly an audit process

3) Data Harmonization & AIP-3 results An overview

GEO Task AR-09-01b Architecture Implementation Pilot Develop and pilot new process and infrastructure components for the GCI and the broader GEOSS architecture Continuation of existing efforts, e.g., IP3, and new activities solicited through Calls for Participation (CFPs) “fostering interoperability arrangements and common practices for GEOSS” Consistent with that, Task AR 09-01b is defined as: highlighting the development and testing of contributed components and leveraging of the GEOSS Common Infrastructure in a pilot setting exercising interoperability arrangements to serve SBAs/CoPs

GEOSS Interoperability Arrangements - From the GEOSS 10 Year Plan Reference Document - Interoperability through open interfaces Interoperability specifications agreed to among contributing systems Access to data and information through service interfaces Open standards and intellectual property rights GEOSS adopting standards; agreed upon by consensus, preference to formal international standards GEOSS will not require commercial or proprietary standards Multiple software implementations compliant with the open standards should exist Goal is that at least one of the implementations should be available to all implementers "royalty-free"

AIP-3 Working Groups and Leaders Disaster Management Didier Giacobbo Arnaud Cauchy Water: Quality and Agricultural Drought Will Pozzi Stefano Nativi Liping Di Brad Lee Health: AQ and Infectious Disease Stefan Falke François Marques Biodiversity and Climate: Ecosystem evolution and Arctic SDI Doug Nebert Energy: Environmental Impacts Lionel Menard Isabelle Blanc End-to-End Engineering Nadine Alameh Josh Lieberman Larry McGovern Data Harmonization Herve Caumont Data Sharing Guidelines Steve Browdy (CIESIN) Vocabularies and Semantics Cristiano Fugazza Roberto Lucchi Masahiko Nagai Participants are grouped into working groups: Groups on the left are communities of practice/scenario WGs Groups on the right are transverse technology working groups (cross cutting) This presentation covers a quick update of the activities of the different WGs with a highlight of the main issues and lessons learned to-date by each WG.

AIP-3 results overview Data Sharing WG Semantics WG Steve Browdy, IEEE Cristiano Fugazza, JRC

Data Sharing Use Cases for licensing conditions: Include recommendation for metadata encoding and potential impacts to Clearinghouse and GWP Use Cases for user management Using ASTER GDEM and Disaster Management scenario as case studies Experimental implementation of Use Cases Development between May and September Testing from July/August forward

Data Sharing Data Access Conditions: User Management Licenses for, and waivers of, data usage Experimenting with Creative Commons CC0, CC BY, CC BY-NC Have developed Use Cases and necessary metadata fields to be used Working towards agreement on ISO 19115 classes to use for data access conditions Begin tests in September based on Use Cases User Management User registration Discussions with UIC regarding the URR (http://www.scgcorp.com/urr) User login with single sign-on Experiment with OpenID initially Considering federated solution with minimal impact on the GCI Considering centralized solution with heavy impact on the GCI Perform trade study and publish a recommendation for a solution (Cf. also GIGAS technical report, GMES SCDA…) Two activities being pursued: Data access conditions (including licenses and waivers for data usage) Note that this has an impact on the metadata User management (including registration and log-in) Start experimenting with openID initially Note impact on GCI in case a centralized solution is adopted

Semantic Mediation & GCI Role Users of GEOSS Resources Providers of GEOSS Resources SBA Issue Client Server EO Resource GCI Search Tool Clearinghouse Query Expander Concepts & Mappings Metalevels of Resource Interaction Support: Clients access data through deployed services (SIR, BPW) Users discover resources through published metadata (CSR & Clearinghouse) Communities connect through mediation between registered & mapped vocabularies (Vocabulary & Mapping Registry) EuroGEOSS broker is testing mediation in AIP-3 Semantic mediation supports additional metalevels. Access requires discovery. Discovery requires matching search terms to catalogue terms. The vocabulary mapping to support term matching across communities / organizations requires registration and maintenance (inference and addition of mapping relationships) of the vocabularies used for resource description and data domains. This is a common infrastructure need just the same as registration of datasets.

AIP-3 results overview Data Harmonization WG Contribution from the GIGAS Project Andrew Woolf, Clemens Portele, Simon Cox

GIGAS Recommendations on ISO 19156 O&M

A harmonized model Brings a consistency model between a sampling feature property (SDI World) and a coverage range type (EO World) O&M talks of chains of measurements / Observation processes (analysis, algorithms), so you can always attach metadata (using the rich quality stack from ISO TC211)

AIP-3 results overview Data Harmonization Working Group Aston University & UncertWeb project Dan Cornford

Uncertainty enabled pressure correction chain Cf. GEO Task AR-09-02d: Loosely coupled models that interact via web services, and are independently developed, managed, and operated. Air Pressure measurements Elevation samples Weather underground data SRTM Digital Elevation Model Observations service (SOS) Elevation sampling (WPS) Interpolation (INTAMAP WPS) Pressure correction UncertML translator API propagation of uncertainty from individual samples Station level pressure & GML Point O&M obs. coll. + UncertML dist. Corrected pressure values correction sequence http://uncertws.aston.ac.uk/client/

AIP-3 results Air Quality Working Group Contribution from University of Muenster

Air Quality working group

Workflow Interpolation is needed to estimate the concentrations of polluants at some points of interest Interpolated concentrations are thus estimates. Estimation errors need also to be communicated. An interpolation Web Processing Service is demonstrated Several uncertainty types, like quantiles, which shall be returned, can be specified in the request

Visualizing uncertainty information

AIP-3 results Energy Working Group Contribution from GENESIS project Lionel Menard, Mines ParisTech

AIP-3 Energy scenario: “Information on environmental impacts of the production, transportation and use of energy” Leader: Mines ParisTech (Poc: Lionel Menard & Isabelle Blanc) Team: GENESIS and EnerGEO consortiums (European Commission FP7 funded projects) Ecoinvent (Swiss SME) Why assessing the environmental impacts of the energy sector ? Key issues when assessing the environmental impacts of the Photovoltaic sector (Users) Worldwide demand is growing: +40-50 % from 2003 to 2030 (IEA, 2005) Energy demand implies considerable pressure on the environment Sustainability of current and future energy consumptions, cross SBA concerns (Climate, Water, Ecosystems, Health) Need to assess current environmental impacts on a global and local scale: diversify sources, reduce pressure on environment. Look for the most favorable technology for PV module (Installers) Environmental performances of PV systems related to their implementation (Policy planners, Energy operators) Carbon footprint of a PV system according to its lifecycle (Policy planners, Energy operators) Environmental performances of PV systems related to their fabrication (Installers, Energy operators, Policy planners) The Energy Working Group is focused on answering key user questions with regard to assessing the environmental impacts of the Photovoltaic sector (questions listed on the right hand side of the slide)

Scenario objectives: Provide the necessary GEOSS compatible components to answer user’s concerns Component’s list includes: OGC Web Map Service (WMS) and Web Processing Service (WPS) of: - Average annual solar irradiation (kWh/m2) (Mines ParisTech) - Environmental outputs of PV systems (Ecoinvent & Mines ParisTech) OGC CSW (Catalog Service Web) (EnerGEO) Appropriate web map (WMS) and web processing capacities (WPS) using software from the GENESIS project solutions Web Portal and Geodata Visualization Portlet (GUI) (GENESIS) The Energy WG is focused on answering the previous questions by providing the necessary GEOSS compatible components to answer user’ concerns. In the component list, note The development of a community catalog (CSW) The development of a processing service WPS (in support of revising the geoprocessing use case) The development of a portal (screen shots on next two slides)

Uncertainty management issues The data resulting from processing are themselves used as observations It could be outputs of photovoltaic systems or environmental impact indicators In most cases, there is a need to validate (calibrate) against measurements (truth), and derive from that assessments of uncertainty The major difficulty is having confidence in the measurements, and challenge is to use them to offer EO-derived products with "known" quality

Energy WG findings to-date Moved from W3C W*S to OGC W*S to leverage future use of resources Transition first dreaded by proved easier than expected Main obstacle: misunderstanding of interoperability concepts and benefits Genesis Toolbox used (including OGC WPS) will be available free of charge under open source license Process of registering community catalog into GEOSS harder than expected Issues still ongoing (harvesting demands delay, discrepancies in query results between new and old resources harvested, duplication of records, etc) Process should be improved and automated More documentation is needed Formal, long, detailed documentation as well as Short, sharp, targeted simple topic videos (how to deploy your resource; how to register your resource; how to create your metadata, etc) 3 key findings – self explanatory – findings shared by other working groups such as Health WG

GENESIS Portal – Env. impacts assessment

Conclusions

AIP-3 Deliverables - 2010 Demonstration Demonstration of community Scenarios implemented through transverse Use Cases Demonstrations recorded and made available via WWW Engineering Reports To be posted in GEOSS Best Practice Wiki Community of Practice Scenarios Transverse Technology Use Cases AIP-3 Summary Report Registered Services and Components Consolidate and increase the number of services and components registered in CSR Support of the GEOSS operational task (AR-09-01a) Self-explanatory

References GEO earthobservations.org GEO Architecture Implementation Pilot www.ogcnetwork.net/AIpilot GEOSS registries and SIF geossregistries.info George Percivall percivall@myogc.org

Enabling the Sensor Web OGC Sensor Web Enablement framework

GEOSS Common Infrastructure