Presentation on theme: "Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac."— Presentation transcript:
Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac
Information access in Météo France Stage 1: Current status –Okapi production platform (finalized products) with a Web portal –IAA (Random Access on Legacy databases) with a bespoke language via ftp Stage 2: Information system evolution –SOA (with a part of OGC services) –Information model with geographic references –Spatial databases –Light and smart client (forecaster station project) Stage 2 bis: WIS solution –OpenWIS developed with UKMO –Metadata generator
Stage 1: Production Service Okapi - IAA OKAPI: Three software bricks, loosely linked : –Okapi production platform (products factory). –Internal production portal : Okapimet (For web and webservice customers). –production portal : Climatheque (For web and webservice customers). IAA –Random access –On the legacy databases –Archive access possible –With a bespoke language
Stage 2: New project Synopsis: Forecaster tools based on SOA Two main requirements SOA –Development efforts factorization –Processing and data pool access –Standard interfaces –Management of different topologies (local or remote server, standalone) –WMO needs and INSPIRE recommendation Client station –Last technologies –Deployment and support easy –Light or smart client –Scalable, efficient –Multi-platforms
Technical choices Synopsis Server : –Linux 64 bits : Re-use of current services in different systems Use of programs and libraries of ECMWF –Use of bricks OpenSource Databases: PostgreSQL, PostGIS Image processing: GDAL, Proj4 Mapserver : services OGC Geonetwork for the catalogue
The services Different service levels –Metadata access (catalogue) –Data access –Business processing (graphic processing) –Presentation services (images, maps, graphics…); Interoperability for the map services –So : WMS (Web Map Service) et CSW (Web Catalog Service) For INSPIRE, interoperability also on data and processing services (transformation and downloading) –So : WCS (Web Coverage Service) WFS (Web feature Service), WPS (Wep processing Service) ….
SOA : Reference architecture Application composite Business process Engine Orchestration BPM Supervision SAMBAM Data access CRUD Application composite Administration Plate-Form Business services Processing / Transformation Bus for messages Legacy databases Application composite Services Registry SAM : Service Activity Monitoring BAM : Business Activity Monitoring BPM : Business Process Management CRUD : Create Read Update Delete
Interoperability Strategic target Use of the standards OGC standards for geo-referenced data Web Map Server Web Coverage Server Web Feature Server Web Map Service (WMS) Web Feature Service (WFS) Web Coverage Service (WCS) Catalogue (CSW) Geography Markup Language (GML) Web Map Context (WMC) OGC KML Others…
SOA : Architecture interoperability on legacy databases with geographic extension Client SYNOPSIS Java Web Start Supervision Plate form Interface HPOV Data Service WFSWCS Client SYNOPIS Full Web Administration Plate-Form Bus of messages JMS Other applications composites Catalogue CSW SOS Processing servicePresentation service FPSWMSWPSSPS BDMO Geo- extension BDMO Ref) Legacy databases BDAP Ref BDI Ref BDEPI Ref BDE Ref BDIBDEPIBDEBDAP Geo-ext
Data Access Services Services de DONNEES WCSWFSSOS WFS Web Feature Service Coast map lines Objects : Anasyg Pi, Sympo2, Aeronautic OACI Annex 3
Portrayal Services Services PRESENTATION FPSWMS Observation Objects : Anasyg Pi, Sympo2, WMS Web Map Service Static geographic layers Models plots Aeronautic OACI Annex 3 Images Radar, Sat
General Architecture Data and services catalogue (standard) –On line products and services discovery. –Message bus Balanced flow (cluster services) Loosely link between server and client Spatial database –Using MapServer and other OGC implementations Standard interfaces used by the clients –Possibility to access to extern services (without guarantee of performances) –Useful for a wandering forecaster
Prototype Architecture Middleware ( bus JMS ) Frontal SYNOPSIS ( SynFront ) HTTP -> JMS Network (IP) Metadata ISO 19115 ISO 19119 BD Spatiale (SynBase) PosGIS Services on cluster WMS(cartes) CATALOGUE Geonetwork ISO 19115-19119 CSW MapServer Magics++ Business service MapScriptServlet ExecutableCGI Server SYNOPSIS ( SynServ ) JMS WMS Soprano Transmet Retim File System Client SYNOPSIS Full Web Client SYNOPSIS JAVA Web Start Alimentation BD ( SynDATA )
Architecture Target (Back Office) Backbone of services (ESB ?) MonitoringAdministrationSécurity Front End WMSPrésentationcartesWPSProcessing CRS transf. … CATALOGUE Geonetwork ISO 19115-19119 CSW Serveur SYNOPSIS Servers CEP WEB High availability Obs Front End WMS Présentation Cartes SOSSPS bus JMS internal bus JMS internal BDs SOPRANO BDM BDCLIM BDAP BDI Front End CBD [OKAPI ?] SOSAccess Obs validated BD spatiale (SynBase) PostGIS BDs Spatiales PostGIS BDEPI BDE BDI « new » Clients WCSAccessImagesModèles WMSPrésentationMaps WPSProcessingStats Client Synopsis JAVA Client Synopsis WEB Client Production Obs & time series CLUSTER WFS Object access PI, SYMPO2 AERO (WXXM) RMDCN
Stage 2 bis: WIS Approach OpenWIS development : –Information fetching: Different use cases –OpenWIS: Open interfaces –Request or subscription –Météo France use two diffusion systems Metadata GTS generator –To populate the WIS catalogue –Mapping between Volume C1 and Core Metadata Profile –Close the prompting question on information sources
5 : Storage in the shopping cart for an online distrbution, or preparation of the dissemination instructions: they are constructed from the user profile, among other elements. DAR 3: the user composes an ad-hoc request for the product type. The user specifies which products are of interest, and the chosen dissemination options. Portal subscriptions (user profile) 4: The product type is part of the global dataset. The requested products are extracted from the Cache. Routing MSS FSS 6 : the products and instructions are forwarded. 7 : Dissemination according to instructions. 7bis : the user receives the products. Ad-hoc Request for a product in the Cache – dissemination via the FSS (GISC function) OpenWIS 1 : the user discovers local product type in the catalogue 2 : the user is authenticated (several steps) 5bis : the user obtains the products from the shopping cart.
6 : Storage in the online shopping cart, or preparation for dissemination. DAR Portal subscriptions (user profile) 4: the product type is owned by a local NC or DCPC. Routing MSS FSS 6bis : the user obtains the products from the shopping cart. SOURCE 5: the required products are extracted and returned. Ad-hoc Request for a local product – dissemination via the FSS (NC or DCPC function) OpenWIS 1 : the user discovers local product type in the catalogue 2 : the user is authenticated (several steps) 3: the user composes an ad-hoc request for the product type. The user specifies which products are of interest, and the chosen dissemination options. 8bis : the user receives the products. 7 : the products and instructions are forwarded. 8 : Dissemination according to instructions.
4 : Storage in an online shopping cart or preparation for dissemination: construction of the dissemination instructions. DAR Portail subscriptions (user profile) 3: Is someone subscribed to this type of product ? Routing MSS FSS 1 : the MSS receives a new product 5 : the product and instructions are forwarded 2 : the MSS routes the product according to its routing table 2bis : the product is collected and inserted in the GISC Cache 4bis : the user obtains the product from the shopping cart. 6 : Dissemination according to instructions. 6bis : the user receives the product. Arrival of a new GTS product at the MSS (GISC function) OpenWIS
5 : Storage in an online shopping cart or preparation for dissemination: construction of the dissemination instructions. OpenWIS DAR Portal subscriptions (user profile) 3: Is someone subscribed to this type of product ? Routage TRANSMET FSS 6 : the product and instructions are forwarded 2 : Notification of the product availability 5bis : the user obtains the product from the shopping cart. 7 : Dissemination according to instructions. 7bis : the user receives the product. SOURCE 1 : New local product 4: the required products are extracted and returned. New local product available (NC or DCPC WIS function)
Monitoring & Control Service External Interface Metadata serviceData service Security Service User Interface (web portal) DARMet User & Data Policies Metadata Catalogue Cache A7 A1 A3 A5 A1 A3 A1 A3 A5 A2 A4 A6 A1 A5A5 A1 Make / Follow Request Browse / Search DAR Admin / Monitoring Authentication Authorisation Manage Requests Catalogue Access Monitoring Administration Collection Synchro & Harvesting « Ad Hoc » Routine « Push » DIFF MSS/FSS Local System POSSIBLE CHOICES SIMDAT base Sun OpenSSO base GeoNetwork base MSS SMART / GEMS OpenWIS UK MetOffice Replication
GTS Metadata Generator Close to prompting question on digitization