Presentation on theme: "EO CalVal Portal Philippe Goryl ESA/ESRIN"— Presentation transcript:
1 EO CalVal Portal Philippe Goryl ESA/ESRIN INTER-COMPARISON DATA, PROTOCOLS & GUIDE LINESFOR CAL &VAL
2 CEOS WGCV Recommendation Cal/Val portal is the ESA response to the CEOS recommendationInitiate an activitydocument reference methodologyto predict Top of Atmosphere (TOA) radiancefor intercomparison of currently flying and planned wide swath sensorscreate a standard for traceabilityCreate and maintain a fully accessible web pageinstrument characteristicsdatabase of instrument dataspecific vicarious calibration sitescommon formatCEOS Working Group on Calibration and Validation, 18th Plenary Meeting, Beijing, November 2004, Doc No: 12.1
3 EO CALVAL Portal Harmonisation & Interoperability Requirements Instrument characteristics(Radiometry, Spectralresolution, Geometry)Reference Methods and protocols(Cal./Val. Techniques)DataCalibration Metrics (sensor data)Diagnostic sitesWTF sitesAncillary information networkse.g. AERONETDatabaseDatabaseGECAHarmonisation & Interoperability RequirementsOther AgenciesInstrument dataCatalogue and data accessmethodology
4 Project Elements Web Portal Description of methodologies (IVOS for the 1st release)Description of instrument characteristics (SensorML)All GMES sensors will be supported (optical, radar, atm.Chem.)Access to EO dataDesigned to support all GMES sensorsVersion 1: MERIS FR and RR, AATSR, ALOS PRISM and AVNIR2Version 2: additional Chris/Proba, Vegetation, …Access to in-situ dataLocal databaseAccess to Nilu, Aeronet, external database (GECA)Access to toolsCalVal ResultsUser management, Forum, Help
5 Plan for 2007 WTF continuation AATSR: full archive reprocessing and rolling archive metric (MERIS calibration site) extractionIntegration and extension to other IVOSIntegration of geometry validation – methodology, GCP, reference dataProposed standardisation for the geometric validationEvolution to non optical sensors – SMOS / SARStrengthen the link with validation DBAccess to other catalogues/dataset (international cooperation)Fill the cal/val portal with documentation/project.Automatise cal/val procedures (reciprocity method over Bolivian site)
6 Plan for 2007 WTF Continuation TargetA major effort stated in the extension contract of the CalValPortal shall focus on the seamless continuation of the data services provided by USGS covering sensor calibration datasets. This project is known as the WGISS Test Facility (WTF core test sites). The service shall be integrated into the CalValPortal web-interface software.To reduce duplication of data and to ensure that continuous updating of the content can be performed by the US partners, the datasets shall reside at their original location. A set of appropriate metadata shall be extracted from the existing archive datasets. This metadata shall be integrated into the CalValPortal database system to allow standard queries through the web-interface and streaming download of selected result products.The calibration sites stored at USGS shall be integrated into the CalValPortal as regular sites, eventually identified by a site group identifier.
7 Plan for 2007 WTF Continuation Suggested solutionEstablish communication To ensure close collaboration with the USGS technical staff, communication channels shall be established.Analyse existing datasets A thorough inventory of the content of the current WTF web system shall be performed. This study shall identify all data servers attached to the USGS system in terms of Accessibility (current set-up, possibilities to adapt access methods)Data contentStatic or dynamically growing sourceDefine of common metadata A set of metadata shall be defined that allows the integration of the continuation service into the CalValPortal system. Requirements for this task are:A simple formatMetadata fields are contained in the source productsMetadata covers sufficient information to allow integration into CalValPortal system.
8 Plan for 2007 WTF Continuation Suggested solutionGenerate metadataOnce the metadata format and the image properties are defined, the WTF servercontent needs to be processed to generate metadata and image files. The resultsof this stage needs to be transferred to BC.Integrate into CalValPortalThe software and database schemata of the current CalValPortal system needto be updated to be able to handle injection of metadata files, automated storageof quicklook images and the retrieval of remote datasets.Metadata and image files resulting from 2.4 must be ingested into the CalValPortalsystem.Continuous updatesMethods need to be defined to ensure that the WTF server data content ismirrored correctly in the CalValPortal. A change in server content can result fromNew data being ingestedObsolete data being removedReprocessing of data requires updates
9 Plan for 2007 WTF Continuation Current statusContact to has been successfully established. Primary contact persons are:John L. Dwyer at SAIC, Contractor to the USGS Center for Earth Resources Observation and Science, Jeffrey Morisette at NASA's Goddard Space Flight Center, Terrestrial Information Systems BranchA thorough analysis of existing datasets server content has been performed and the result has been distributed to the partners. The WTF data content has be analyzed according to the following criteriaNumber of datasets per product type/sensorAvailability of metadataAvailability of quicklook imagesWeb-address and access mode of the serversSoftware “spikes” to validate the feasibility of the solution planned have been implemented and successfully tested.A metadata format has been defined by Brockmann Consult that covers all the needs expressed. This format has been proposed to the partners at USGS/DAAC and has been accepted in general. A detailed analysis is currently taking place.
10 Plan for 2007 WTF Continuation Current statusPartners at USGS are analysing the efforts needed to generate the metadata and quicklook images. For most of the data stored at WTF, metadata does not exist and has to be generated from the satellite products. Software needs to be written to realise this target. It has been agreed that USGS partners re-use existing software with the capability of reading all data formats to generate metadata.Metadata and quicklook images should be prepared and be made available for download in a suitable way, which needs to be discussed.A major obstacle seems to be that USGS has not enough human resources at their disposal to realise the metadata generation task.ActionsJohn Dwyer is currently discussing wit the USGS/DAAC technical staff about possibilities to generate metadata and quicklook-images. This discussion shall result in a rough estimate on the manpower needed for realisation.A tele-conference is been planned after WGISS meeting to iterate further steps.
11 Calibration Support The CalVal Portal will support calibration by Supplying Satellite Data from multiple SensorsSupplying in-situ MeasurementsSupply Sensor ParametersPrepare input files for 6S given Sensor Parameters, Atmospheric Conditions, …Supply a platform to exchange resultsGive access to calibration toolsBEAM6S input file generation6S RTT…
16 Methodology Reference methodology for optical sensors Vicarious calibration: a reflectance based methodApplicable toVisibleNIRAvailable as a document for download from the PortalScientific backgroundGeneral approachCook-book like step-by-step descriptionSupported by interactive tools and links to SW toolsFuture extension: Reference methodologies forGeometryRadar instrumentsAtmospheric chemistry
17 IVOS Methodology NB : Methodology will be extended from radiometric Only to Geometric calibration
18 Structure of the Method Description Introduction, Applicability, ScopePhysical / mathematical descriptionTechnical DescriptionOverviewDetailed description of ModulesPreparation, Campaign planningEO data retrievalEO data extractionMeteorological dataAerosol modelSurface reflectance (in-situ data)Radiative transfer modelCalibrationApplication Example (La Crau)Recommendations of in-situ measurementsNumerical models6SSOS code
19 Methodological Reference PDF/html with scientific background descriptionPDF/html with application examples (Cook-book)
20 Methodological Reference html/PDF with scientific background descriptionhtml/PDF with application examples (Cook-book) readyVicarious calibration in the solar domain using bright land test sites - MethodologyVicarious calibration in the solar domain using bright land test sites: The La Crau siteDetailed description of current technologyThe Acqua Alta Oceanographic Platform (AAOT) Site (Zibordi & Berthon)The SeaPRISM CIMEL radiometer (Zibordi, Berton & Melin)Measurements for calibration in the solar domain: The automatic CIMEL radiometer (R. Santer)RTC for calibration in the solar domain; the Successive Order of Scattering code (R. Santer)Second Simulation of a Satellite Signal in the Solar Spectrum (Eric Vermote)
23 Example: use of the cal/val portal for: Cross calibration: ALOS and MERIS over land MERIS: a reference!Strong requirements for ocean colourOn board calibrationClear sky conditionsTwo types of sensors:Spatial resolution=> homogeneous siteSpectral featuresALOS and MERIS extracted over the same stable sites available in the cal/val portal
24 The AVNIR2 spectral bands MERISAVNIR2 spectral bands and the atmospheric transmission for an aerosol free, mid latitude summer atmosphere with WV=2 g.m-2 and O3=300 DobsonBoth MERIS and ALOS precise spectral response are given in the Cal/Val portal
25 Spectral match: Methodology Derive surface reflectances from MERIS6S backwardAtmospheric modelAerosol modelReconstruct the surface reflectance for ALOSIntroduicing a mean reflectance for each bandBRDF modelDerive TOA ALOS reflectances6S forward with the same conditionsThe ALOS official solar irradiances6S and pre-processing tool is given in the cal/val portal.Solar irradiance used in ALOS is given in the cal/val portal.Angles calculation for ALOS is given in the cal/val portal.
26 Second order terms BRDF correction Aerosol model Using BRDF model of the site (POLDER-PARASOL)Aerosol modelProximity of AERONET station(access via Cal/Val portal)
27 Results: Intercalibration ALOS AVNIR calibration verification B1:0.954 B2: B3:0.927 B4:0.829 when accounted for WV, B4 0.876
28 SummaryEO CalValPortal provides data, instrument description and methodologies for Calibration and ValidationVersion 1 supports calibration of IVOS sensorsVersion 2 (2007)extension to geometric calibrationvalidation supportextension to other types of sensorsincorporation of the functionality of the CEOS WGISS TestfacilityCalVal projects can link into share data and resultsGlobcolour, MAVT/MQWG, ALOS are currently using the portalWork in accordance with and supported by CEOSGEOSS is interested in taking on board the CalVal Portal