Presentation on theme: "Hervé CAUMONT OGC Interoperability Program Team"— Presentation transcript:
1 Hervé CAUMONT OGC Interoperability Program Team GEOSS Architecture Implementation Pilot (AIP) CEN/TC 287 workshop on Interoperability between INSPIRE, GMES, and GEOSS 8-9 November 2010, JRCHervé CAUMONTOGC Interoperability Program Team
2 Intro - Focus of the workshop Contribute to the data interoperability between:INSPIRE data specificationsGMES data product specificationsGEOSS data“Shape” the GMES initial operations concerning data products
3 Presentation summaryOutcomes of the GEOSS Architecture Implementation Pilot (AIP) processCurrent activities within GEOSS related to Data, Metadata and Products Harmonization (GEO Task DA-09-01b and coordination activities)Data Harmonization & AIP-3 results, an overviewGMES Sentinel-1 Data Products and Data AccuracyGround-segment Harmonization - HMAEvaluation of GMES input data for modeling….GSE Forest Monitoring fundings…
5 Focus on some drivers of the GEOSS development Harmonization of data, metadata & productsData Tagging Usage & PermissionsInformation extractionLife-cycle managementInteroperability accross registriesData Sharing PrinciplesGEO multiplicity: organisational models, stakeholders, governance rules, fundings, levels of implementation, technical approaches, timelinesCape Town declaration, DSTF Impl. GuidelinesGEOSS Data CORE, QA4EO guidelines for metrology and the question of their extension to address GEOSS SBAs needsCurrent issues of need for inventory, and need for harmonization of fragmented observations
6 A process, elaboration of GEOSS Architecture SBA Tasks,UIC, CBC,STCURR, Data Sharing Task ForceTransfer to operationsUserNeeds,ScenariosrequirementsDesign,Develop,DeployADC activitiesincluding:ArchitectureImplementationPilot (AIP)Task AR-09-01bDSPQA4EOLTDPsupportOperationalCapabilitySIF outreachGEOSS CommonInfrastructure (GCI)Task AR-09-01apersistentimplementationGCI-Coordination TeamOf particular interest for the GMES data products :- Data Sharing Principles, Quality Assurance for Earth Observations, SIF convergence guidelines and practices- Long Term Data Preservation- Risk Management, disaster/failure recovery6
7 AIP Reusable Process for Deploying Scenarios Scenarios: end user view of the value of GEOSSFocused on topics of interest to a communityOccur in a geographic Area of Interest (AOI)Steps in a scenario are mapped to Use CasesEngineering Use Cases support SBA ScenariosUse cases for discovery, data access, etcUtilize Standards & Interoperability ArrangementsReusable service oriented architectureLeverages ‘operational domain value’ through interoperable services
8 AIP-2 AchievementsCommunity of Practice Scenarios deployed through collaboration with SBA TasksReusable Process for applying scenarios on Service oriented Architecture – GEOSS SoAContribution/registration of persistent services using GEOSS Interoperability ArrangementsAIP-2 Call for ParticipationJune 2008Demonstrations to GEO CommitteesMay 2009Reports CompletedSeptember 2009
9 AIP-3 builds on AIP-2 process Build on GCI and Community ServicesPromote mash-ups in a "link-rich" environmentOGC continue as Task LeadEngage additional Communities of Practice (CoP)Focus on Data; Promote ContentResults in time to support EO SummitAIP-3 Call for ParticipationJanuary 2010Kickoff WorkshopMarch 2010Demonstrations for EO SummitSeptember 2010All Deliverables CompletedNovember 2010
10 Scenarios in AIP CFP Scenarios begun in AIP-2 Scenarios new in AIP-3 Disaster ManagementHealth: Air QualityBiodiversity and Climate Change – Prediction of an Ecosystem EvolutionBiodiversity and Climate Change – Arctic Spatial Data InfrastructureRenewable EnergyWater – DroughtWater – Water QualityExtreme PrecipitationHealth and the Environment Scenario – Early Warning of Malaria
11 AIP-3 Status – To Date What is working ? What are the potential impacts on the GCI ?What is still needed ?
12 AIP-3 Status – To Date What is working ? Sharing of information/knowledge/best practices across communitiesCoordination with GEO TasksAlignment of AIP activities with funded activities and community prioritiesCommunity/scenario-driven approachSelf-explanatory
13 AIP-3 Status – To Date What are the potential impacts on the GCI ? Data access conditions & user managementMetadataPossible new GCI componentGEOSS Common RecordImpact on clearinghouse, CSR, etcData quality, lineage, etcSemantic-enabled searchRegistration of ontologiesPossible brokering componentSelf-explanatory
14 AIP-3 Status – To Date What is still needed ? More interoperability GEOSS Common Record, Semantics, WPS ProfilesFinding the right balanceMore documentationMore sharing of lessons learnedIncreased usage of the GEOSS best practices wikiContinued coordination with other GEO TasksMany challenges remain within communitiesChallenges spanning technical and organizational issuesSelf-explanatory
15 Architecture Video for Ministerial Theme :Bold vision endorsed 5 years agoArchitecture vision has now been demonstratedMinisters should invest in their agency developments consistent with planSources :AIP-2 Demo VideosInterviewsSouth Africa Summit FootageGEOSS Design themesA short video is being developed for use at the ministerial in November.
16 2) Data, Metadata & Products Harmonization Some perspectives from GEOSS AIP
17 AIP depends on other GEO Tasks DI-09-02: Multi-Risk ManagementDI-06-09: Use of Satellites for Risk ManagementWA-06-02: Droughts, Floods and Water ManagementWA-06-07: Water Resource ManagementBI-07-01: BONEN Energy Enviro. ImpactHE-09-01: Info Systems for HealthHE-09-02: Monitoring and Prediction for HealthUS-09-01: User EngagementDA-06-01: Data Sharing PrinciplesDA-09-01: Data ManagementDA-09-02: Data Integration and AnalysisDA-09-03: Global Data SetsAR-09-02: Interoperable Systems for GEOSSAR-09-04: Dissemination and Distribution Networks
18 The « Data Harmonization » topic GEO Task AR-09-01b (AIP)Emergence of Data Harmonization topic, pilot and input for the GEO Task DA-09-01bEmphasis on Data Quality and Uncertainty ManagementGEO Task DA-09-01bData, Metadata and Products HarmonizationOther GEO Tasks (Data Integration, Global Datasets…)INSPIRE 2010 Conference and WorkshopsNumerous sessions with Data Harmonization topicOGCA cross-WG topic : SensorML, O&M, GML, WCS…Could be similar to OWS for service interfacesCould reach out the Data Quality SWG
19 Soil top soil moisture modeling into root zone soil moisture GMES Data ProductsScenarios that require cross-border and cross-theme data integration, leading to the identification of interoperability requirements in different application areas…Statistical data for modeling dry deposition rates of atmospheric acidifying components into forest ecosystemsSoil top soil moisture modeling into root zone soil moisture…Modeling: do the GMES Data Products comply to user requirements & acceptance criteria ?GMES MyOcean scenario considered by GIGAS
21 QA4EO for GEOQA4EO was developed to meet the current and aspirational needs of the societal themes of the Group on Earth Observation (GEO)’s Global Earth Observation System of Systems (GEOSS)It was prepared as a direct response to GEO task DA (now DA-09-01a) to “Develop a GEO data quality assurance strategy”It is beginning with space-based observations, and evaluating expansion to in situ observations, taking account of existing work in this arena”
22 QA4EO Workshop Sessions 2-4 « QA4EO and GEO » assets:Quality assurance processMetrology domain to be extended towards GEO SBAsRoles for Data harmonization / Data interoperabilityEnd to end process to identify open issuesQA4EO seen as a ‘badge/stamp’first a questionnaire to assess and auto-declare conformancethen possibly an audit process
23 3) Data Harmonization & AIP-3 results An overview
24 GEO Task AR-09-01b Architecture Implementation Pilot Develop and pilot new process and infrastructure components for the GCI and the broader GEOSS architectureContinuation of existing efforts, e.g., IP3, and new activities solicited through Calls for Participation (CFPs)“fostering interoperability arrangements and common practices for GEOSS”Consistent with that, Task AR 09-01b is defined as: highlighting the development and testing of contributed components and leveraging of the GEOSS Common Infrastructure in a pilot setting exercising interoperability arrangements to serve SBAs/CoPs
25 GEOSS Interoperability Arrangements - From the GEOSS 10 Year Plan Reference Document - Interoperability through open interfacesInteroperability specifications agreed to among contributing systemsAccess to data and information through service interfacesOpen standards and intellectual property rightsGEOSS adopting standards; agreed upon by consensus, preference to formal international standardsGEOSS will not require commercial or proprietary standardsMultiple software implementations compliant with the open standards should existGoal is that at least one of the implementations should be available to all implementers "royalty-free"
26 AIP-3 Working Groups and Leaders Disaster ManagementDidier GiacobboArnaud CauchyWater: Quality and Agricultural DroughtWill PozziStefano NativiLiping DiBrad LeeHealth: AQ and Infectious DiseaseStefan FalkeFrançois MarquesBiodiversity and Climate: Ecosystem evolution and Arctic SDIDoug NebertEnergy: Environmental ImpactsLionel MenardIsabelle BlancEnd-to-End EngineeringNadine AlamehJosh LiebermanLarry McGovernData HarmonizationHerve CaumontData Sharing GuidelinesSteve Browdy(CIESIN)Vocabularies and SemanticsCristiano FugazzaRoberto LucchiMasahiko NagaiParticipants are grouped into working groups:Groups on the left are communities of practice/scenario WGsGroups on the right are transverse technology working groups (cross cutting)This presentation covers a quick update of the activities of the different WGs with a highlight of the main issues and lessons learned to-date by each WG.
27 AIP-3 results overview Data Sharing WG Semantics WG Steve Browdy, IEEECristiano Fugazza, JRC
28 Data Sharing Use Cases for licensing conditions: Include recommendation for metadata encoding and potential impacts to Clearinghouse and GWPUse Cases for user managementUsing ASTER GDEM and Disaster Management scenario as case studiesExperimental implementation of Use CasesDevelopment between May and SeptemberTesting from July/August forward
29 Data Sharing Data Access Conditions: User Management Licenses for, and waivers of, data usageExperimenting with Creative CommonsCC0, CC BY, CC BY-NCHave developed Use Cases and necessary metadata fields to be usedWorking towards agreement on ISO classes to use for data access conditionsBegin tests in September based on Use CasesUser ManagementUser registrationDiscussions with UIC regarding the URR (User login with single sign-onExperiment with OpenID initiallyConsidering federated solution with minimal impact on the GCIConsidering centralized solution with heavy impact on the GCIPerform trade study and publish a recommendation for a solution(Cf. also GIGAS technical report, GMES SCDA…)Two activities being pursued:Data access conditions (including licenses and waivers for data usage)Note that this has an impact on the metadataUser management (including registration and log-in)Start experimenting with openID initiallyNote impact on GCI in case a centralized solution is adopted
30 Semantic Mediation & GCI Role Users of GEOSS ResourcesProviders of GEOSS ResourcesSBAIssueClientServerEO ResourceGCISearch ToolClearinghouseQuery ExpanderConcepts & MappingsMetalevels of Resource Interaction Support:Clients access data through deployed services (SIR, BPW)Users discover resources through published metadata (CSR & Clearinghouse)Communities connect through mediation between registered & mapped vocabularies (Vocabulary & Mapping Registry)EuroGEOSS broker is testing mediation in AIP-3Semantic mediation supports additional metalevels. Access requires discovery. Discovery requires matching search terms to catalogue terms. The vocabulary mapping to support term matching across communities / organizations requires registration and maintenance (inference and addition of mapping relationships) of the vocabularies used for resource description and data domains. This is a common infrastructure need just the same as registration of datasets.
31 AIP-3 results overview Data Harmonization WG Contribution from the GIGAS ProjectAndrew Woolf, Clemens Portele, Simon Cox
33 A harmonized modelBrings a consistency model between a sampling feature property (SDI World) and a coverage range type (EO World)O&M talks of chains of measurements / Observation processes (analysis, algorithms), so you can always attach metadata (using the rich quality stack from ISO TC211)
34 AIP-3 results overview Data Harmonization Working Group Aston University & UncertWeb projectDan Cornford
35 Uncertainty enabled pressure correction chain Cf. GEO Task AR-09-02d: Loosely coupled models that interact via web services, and are independently developed, managed, and operated.Air Pressure measurementsElevation samplesWeather underground dataSRTM Digital Elevation ModelObservations service(SOS)Elevation sampling(WPS)Interpolation(INTAMAP WPS)Pressure correctionUncertML translatorAPIpropagation of uncertainty from individual samplesStation level pressure& GML PointO&M obs. coll. + UncertML dist.Corrected pressure valuescorrection sequence
36 AIP-3 results Air Quality Working Group Contribution from University of Muenster
38 WorkflowInterpolation is needed to estimate the concentrations of polluants at some points of interestInterpolated concentrations are thus estimates. Estimation errors need also to be communicated.An interpolation Web Processing Service is demonstratedSeveral uncertainty types, like quantiles, which shall be returned, can be specified in the request
40 AIP-3 results Energy Working Group Contribution from GENESIS projectLionel Menard, Mines ParisTech
41 AIP-3 Energy scenario: “Information on environmental impacts of the production, transportation and use of energy”Leader: Mines ParisTech (Poc: Lionel Menard & Isabelle Blanc)Team: GENESIS and EnerGEO consortiums (European Commission FP7 funded projects)Ecoinvent (Swiss SME)Why assessing the environmental impacts of the energy sector ?Key issues when assessing the environmental impacts of the Photovoltaic sector (Users)Worldwide demand is growing: % from 2003 to 2030 (IEA, 2005)Energy demand implies considerable pressure on the environmentSustainability of current and future energy consumptions, cross SBA concerns (Climate, Water, Ecosystems, Health)Need to assess current environmental impacts on a global and local scale: diversify sources, reduce pressure on environment.Look for the most favorable technology for PV module (Installers)Environmental performances of PV systems related to their implementation (Policy planners, Energy operators)Carbon footprint of a PV system according to its lifecycle (Policy planners, Energy operators)Environmental performances of PV systems related to their fabrication (Installers, Energy operators, Policy planners)The Energy Working Group is focused on answering key user questions with regard to assessing the environmental impacts of the Photovoltaic sector (questions listed on the right hand side of the slide)
42 Scenario objectives: Provide the necessary GEOSS compatible components to answer user’s concerns Component’s list includes:OGC Web Map Service (WMS) and Web Processing Service (WPS) of:- Average annual solar irradiation (kWh/m2) (Mines ParisTech)- Environmental outputs of PV systems (Ecoinvent & Mines ParisTech)OGC CSW (Catalog Service Web) (EnerGEO)Appropriate web map (WMS) and web processing capacities (WPS) using software from the GENESIS project solutionsWeb Portal and Geodata Visualization Portlet (GUI) (GENESIS)The Energy WG is focused on answering the previous questions by providing the necessary GEOSS compatible components to answer user’ concerns.In the component list, noteThe development of a community catalog (CSW)The development of a processing service WPS (in support of revising the geoprocessing use case)The development of a portal (screen shots on next two slides)
43 Uncertainty management issues The data resulting from processing are themselves used as observationsIt could be outputs of photovoltaic systems or environmental impact indicatorsIn most cases, there is a need to validate (calibrate) against measurements (truth), and derive from that assessments of uncertaintyThe major difficulty is having confidence in the measurements, and challenge is to use them to offer EO-derived products with "known" quality
44 Energy WG findings to-date Moved from W3C W*S to OGC W*S to leverage future use of resourcesTransition first dreaded by proved easier than expectedMain obstacle: misunderstanding of interoperability concepts and benefitsGenesis Toolbox used (including OGC WPS) will be available free of charge under open source licenseProcess of registering community catalog into GEOSS harder than expectedIssues still ongoing (harvesting demands delay, discrepancies in query results between new and old resources harvested, duplication of records, etc)Process should be improved and automatedMore documentation is neededFormal, long, detailed documentation as well asShort, sharp, targeted simple topic videos (how to deploy your resource; how to register your resource; how to create your metadata, etc)3 key findings – self explanatory – findings shared by other working groups such as Health WG
47 AIP-3 Deliverables - 2010 Demonstration Demonstration of community Scenarios implemented through transverse Use CasesDemonstrations recorded and made available via WWWEngineering ReportsTo be posted in GEOSS Best Practice WikiCommunity of Practice ScenariosTransverse Technology Use CasesAIP-3 Summary ReportRegistered Services and ComponentsConsolidate and increase the number of services and components registered in CSRSupport of the GEOSS operational task (AR-09-01a)Self-explanatory