Presentation on theme: "GMES Marine Service MY OCEAN WP 12 Thematic Assembly Centre for Ocean Colour Rosalia Santoleri-WP12 Leader."— Presentation transcript:
GMES Marine Service MY OCEAN WP 12 Thematic Assembly Centre for Ocean Colour Rosalia Santoleri-WP12 Leader
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma n Scientific Challenges –to improve the quality of ocean colour products for the European Seas. –to establish reliable error bars for each of the core products. n Technical Challenges –To build an OCTAC from pre-existing pre-operational systems developed in Europe in the last 10 years. –To build a common European system capable to follow the rapid evolution of the OC R&D results and to deliver state of the art products. n Operational Challenges –To ensure the timely availability of complete and accurate OC products –To maintain the quality control and monitoring systems that ensure OCTAC is an efficient and robust system n Ultimate Challenge –To integrate and develop a common European service providing comprehensive Ocean Colour products for marine applications and services bridging the gap between space agencies providing ocean colour data and GMES intermediate and downstream marine users. Main Challenges
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma Coordination aims: short and long term product evolution -> MYO Governmental body, harmonisation of products, units, activities & operations CNR: Mediterranean Production Unit, Centralised Q/C and Delivery ACRI: Global Production Unit, interface with G/S JRC: Reanalysis Production Unit, Global validation PML: North West Shelves Production Unit Ifremer: IBIROOS Production Unit Reminder - Partnership CNR JRC ACRI Ifremer PML JRC CNR ACRI Ifremer PML ACRI CNR Ifremer JRC PML ACRI CNR Ifremer PML WP 12 Ocean Colour TAC (coordination) R&D Development Maintenance Production CalVal CNR
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma Reminder - Objectives for R&D n Main R&D objectives over 3 years n To improvement in the Long term global and regional OC products n To develop and validate the products that will be at the base of the next service evolution n Main issues over 3 years n Characterisation of OC data uncertainties of products at global and regional scales (ALL) n Improvement of global and regional Products (ALL) n Development of OC products for validation/assimilation in ecosystem models (CNR, ACRI, PML and Ifremer) n Develop European products on the basis of regional characteristics (JRC)
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma R&D : main achievements n Main achievements are n Implementation of agreed common metrics for error characterization of OC products in each PU (ALL) n Atmospheric correction used to process SeaWiFS and MODIS data (new NASA reprocessing) was assessed by a comprehensive validation exercise at global scale (JRC). (operation v1) n The characterisation of OC data uncertainties of the core products (Rrs & Chl) at both global and regional scales has been achieved providing estimates of V1 errors at the global and regional scales (ALL). (operation v1) n IBI Level-4 chlorophyll maps (merged MERIS/MODIS) have been improved correcting for the contamination of partially cloudy pixels (Ifremer). (operation v1) n MED-specific OC products have been developed for validation/assimilation into ecosystem models (CNR). (operation v1) n The DINEOF method to produce MED L4 Chlorophyll data was tested. results are promising since it is able to fill data gaps without introducing bias in the chlorophyll estimates and artificial features in the horizontal field (CNR). (operation v2) n Improvement of the NWS IOP processing chain has been obtained (PML). (operation v2)
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma characterisation of OC data uncertainties of the New Re-Analysis: JRC These results are consistent with respect to the SeaWiFS results presented by Gregg and Casey (2004, RSE). Global PRODUCTS OC-JRC-GLO-RAN_RRS_SEAWIFS_L3-OBS OC-JRC-GLO-RAN_CHL_SEAWIFS_L3-OBS OC-JRC-GLO-RAN_KD490_SEAWIFS_L3-OBS European PRODUCTS OC-JRC-EUR-RAN_RRS_MODIS_L3-OBS OC-JRC-EUR-RAN_CHL_MODIS_L3-OBS OC-JRC-EUR-RAN_KD490_MODIS_L3-OBS RMS difference for log-transformed data (< 0.3) fulfils the accuracy goal
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma Mediterranean Calibration Results: CNR Spatial distribution of the in situ-satellite matchups MODISMERIS The error characterization of both MODIS and MERIS Chla and Rrs V1 products relies on the in situ dataset owned by CNR Rrs at 443 nm, the most sensitive band that is used in Chla algorithms, to atmospheric correction. RPD shows a slight MODIS underestimation of the in situ values. Overall good correspondence between in situ and V1 MED regional products
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma Calibration results of IBI Products: Ifremer CHL Matchup points= 439 R 2 = 0.62; bias = 0.2 on the log-transformed data Note: statistics based on coastal station data MODIS and in-situ Mean (a) and percentile 90 (b) of chl-a (productive period) and annual means of non-algal SPM (c) and turbidity (d) at the selected stations. ‘MERIS and in situ Mean (e) and Percentile 90 (f) of chl-a (productive period) and annual means of non-algal SPM (g) and turbidity (h) at the selected stations. Ba’ is Bastia, ‘Ma’ is Marseille_Frioul, ‘Ban’ is Banyuls. Analysis of mean and 90 percentile clearly indicate a good agreement between satellite and in situ data in the productive period even near the coast.
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma Tilstone et al. (in revision, 2011) Journal of Geophysical Research-Oceans. 1. MERIS standard Case 2 product (AP2): a neural network (NN) that derives a and b and through empirical relationships, it converts IOP to Chla and TSM concentrations. 2. HYDROPT parameterised with sIOP (HYD): Semi-analytical algorithm that combines the approach of Garver and Siegel  with the radiative transfer code HYDROLIGHT [Mobley, 1994] to partition the reflectance spectra into its respective IOP. It predicts remote sensing reflectance spectrum from knowledge of the sIOP of a particular region and retrieves the concentrations by minimizing the difference between observed and modeled reflectance spectra. MSLog-RMSRel % AP2 Chla-0.060.250.2640 HYDChla-0.080.150.179 AP2 TSM-0.220.240.3333 HYDTSM-0.140.310.3450 AP2adg-0.240.510.5819 HYDcdom0.110.280.3113 Quality Assement of IOPs in NWS: PML
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma R&D : main achievements n Main difficulties n Limited resources for R&D activities. n Remaining activities/objectives n To complete (IOPs) and update the product assessment (-> new NASA/ESA re-processing). n To improve/complete the multi-sensor data merging & the L4 data analysis. n To develop European products on the basis of regional characteristics.
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma Reminder - Objectives for Dev. & Maintenance n Objectives over the 3 years: n To implement a European integrated ocean colour operational processing and assembly centre on the basis of pre-existing production systems (V0 -> V1->V2) n To upgrade OCTAC system to ensure long-term system evolution n Steps: n V0: pre-existing processing chains developed by OCTAC partners n V1: first version of the integrated OCTAC system n V2: upgrade of OCTAC taking into account the development of the GMES G/S and the upgrade of MyOcean system. Upgrade of processing chains with R&D outcome. n Issues: n Harmonisation of processing chains and products among Production Units n OCTAC sub-system integration within MYO system (WP2, WP16, WP17);
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma OCTAC Overview OCTAC :Overview
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma OCTAC: PUs / DUs overview OC OC-ACRI-NICE- FR OC-CNR-ROME-FR OC-IFREMER-BREST- FR OC-JRC-BRUSSELS- BE OC-PML-PLYMOUTH- UK Ocean Colour TAC Stream 1 PU/DU: v1.0 Stream 2 PU/DU: v1.1
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma Dev. & Maint. : main achievements n Main achievements are n Definition of OCTAC main architecture in compliance with MyOcean system requirements n Upgrade preexisting processing chains taking OCTAC architecture elements, OCTAC product harmonisation requirements, new NASA software/products and new G/S interfaces n Development of online validation and quality control system compliant with PQCV requirements and Scientific Validation Plan at each PU (completed and tested by v1.0 PUs: CNR, ACRI; completed & under testing by v1.1 PUs: Ifremer, PML). n V1.0 OCTAC processing systems upgraded with results of R&D activity, with implementation of the PQCV module and integrated into the MyOcean System (CNR: MED, BS; ACRI: GLO, ARC, BAL). n Development of a new NWS processing chain which implements OC5 algorithm as a standard product in the main processing, data harmonisation and data transfer to the OCTAC CNR DU. n V1.1 OCTAC processing systems ready for integration (Ifremer: IBI; PML: NWS) n Main difficulties n Schedule for V1 was very tight n Low flexibility of the Motu software used by MIS/THREDDS for integration n Major problems arose in testing access to OC data through the MIS catalogue n Remaining tasks n Complete the integration of the V1.1/stream2 PUs in the OCTAC n Update the OCTAC in view of V2
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma Reminder - Objectives for Production n Objectives n to ensure production and archiving of global, Pan-European, regional (ROOS) OC products as defined in the FTSS Baseline products: Non standard L2: nLw(λ), Kd(490), chlorophyll-a L3: NRT, DT, RAN nLw(λ), Kd(490), chlorophyll-a daily, multi-day and monthly composites L4: DT, RE chlorophyll-a analysis. Specific products for MFCs NRT: products available (within <24 hours after sensing) DT: after ancillary data availability (within < 5 days after sensing) RAN: re-analysis 1997 to the present n Steps: n V0: GLO, MED, NWP, IBI and RE generated by pre-existing processing chains n V1: 71 OC V1 FTSS products harmonised among production units (formats, metadata, and dissemination); following service protocol (WP16, WP2.3, WP17). n V2: will include upgrades according to R&D results and the user satisfaction feedback (WP17 & WP18), new products like IOPs and pixel level error estimates.
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma Production : main achievements n Main achievements are n Systematic production of OCTAC FTSS V0 products at global, pan-European and regional levels n PU monitoring of own production and maintenance of product archive n Systematic production of OCTAC Global, Pan-European, Mediterranean V1 products (since the start of MyOcean v1.0 service) n New Global and European Reanalysis products were produced by JRC. The new RAN products will be available to MyOcean users in June (V1.1). n management of requests from MyOcean (more than 400) and previous PU users (V0) n Overall/ integrated management of OCTAC 2 nd level service desk interfaced with MyOcean Service and OCTAC PU/DUs: reply to user requests, provide information on products, inform on incident occurred at V1.0 DU/PUs (ACRI, CNR) and their implication on data availability and quality, maintain the incident and change database, prepare the service monthly report n Management of the main change due to the end of the SeaWiFS mission n Main difficulties n Manage day-by-day information exchange among PUs and between OCTAC and service desk n Problems with upstream data providers (ESA and NASA) n Remaining objectives n Setting V1.1 & V2 OC sub-system production in place
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma Reminder - Objectives for Cal / Val n Objectives n Perform scientific validation to characterise accuracy and quality of the OCTAC products n Perform OCTAC service validation against users requirements n Activities: n Monitor the overall OCTAC operation (CNR) n Interface with the service desk (CNR) n Product Key Performance Indicators (ALL) n Define OCTAC CAL/VAL strategy and intercompare Pan-European regional and global OC products (JRC with contribution of partners) n Issues: harmonisation of CAL/VAL methods and Q/C procedures among Production Units n Risks: limited availability of MyOcean in situ biological data from in Situ TAC; lack of sufficient in situ data for operational CAL/VAL; no provision of bio-optical in situ data.
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma Cal/Val : main achievements n Main achievements are n Implementation of agreed common methods/principles/metrics for validation and quality control of L3 and L4 products in each PU n OCTAC V1.0 and V1.1data were calibrated against available in situ observations n Scientific Calibration and Re-analysis reports were produced for both Stream 1 (V1.0) and Stream 2 (V1.1) products assessing that the quality of the OCTAC V1 products fulfil the accuracy goal and demonstrating the slight improvement of V1 products with respect to V0 ones. n Online quality control in place at the V1.0 OCTAC PUs (ACRI & CNR) able to: 1) assess the time consistency of each product, 2) to identify sensors drifts or shifts in near-real time; 3) to identify possible natural changes which are not expected to occur n Scientific Validation Report provides a synthetic view of the quality of the operational (GLO, MED & BS) products delivered within the V1 time period, showing the quality of the products to be reliable according to the defined metrics. n Main difficulties n To identify absolute uncertainties of NRT data due to the lack of an appropriate in situ operational program to monitor the same quantities. n Remaining tasks n To implement the online QC in the Stream2 OCTAC Pus (Ifremer, PML) n To monitor the Scientific data quality for a prolonged period. n To upgrade the Scientific CAL/Val reports.
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma Online validation respect to Climatology [1998-2010]: ACRI Comparaison pixel per pixel, threshold set on the percentage of pixel consistent with climatology Comparison at basin scale Pixels outside +-4* σ are considered as an anomaly
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma Online validation respect to Climatology [1998-2006]:CNR
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma n Scientific Challenges –to improve the quality of ocean colour products for the European Seas –to establish reliable error bars for each of the core products –to develop a regional multi-sensor analysis n Technical Challenges –Schedule of V2 is very near to V1.1 start. –Development of the v2 system should be done in parallel to v1.1 integration n Operational Challenges –to ensure the timely availability of complete and accurate OC products. –Strong dependence of FTSS products on upstream data source n Main Risks – Synchronization of all the components of the OC sub-system –management of two or more version of the OCTAC sub-system in parallel Future Challenges
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma n Past (event, work or tasks achieved) : –October 2009: the complete set of 71 V0 FTSS OCTAC products was made available to users –September 2010: Start production of V1 harmonized OC products in parallel with V0 production –Autumn 2010: integration of OC DUs into the MyOcean system –December 2010 start of V1: Stream 1 OCTAC PUs become operational (ACRI, CNR) –December 2010: SeaWiFS data no more available –February 2011: end of SeaWiFS & major change v1 OCTAC catalogue –March 2011: OCTAC annual meeting –March 2011: Stream2 PUs tested n Future : –June 2011: All 134 V1 OC products available in the same format and accessible through the MyOcean MIS –Jun 2011: new consistent GLO and EUR Re-analysis product (1997-2010) –March 2012: new V2 products available to users (eg. MED daily L4 analysis without data gaps) Calendar
Marine Core Service MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma Some illustrations… GLO daily GLO monthly IBI L4 MED L3 NWS L3 GLO weekly Reanalysis MED L3 NWS L3