P.Lewis (1) Gomez-Dans, J. (1), Kaminski, T. (2) ; Settle, J. (3), Quaife, T. (3), Gobron, N. (4), Styles, J. (5), Berger, M. (6) Data Assimilation of.

Slides:



Advertisements
Similar presentations
Data Assimilation Tristan Quaife, Philip Lewis. What is Data Assimilation? A working definition: The set techniques the combine data with some underlying.
Advertisements

UoL MSc Remote Sensing Dr Lewis
Bayesian Belief Propagation
Data-Assimilation Research Centre
Introduction to Data Assimilation NCEO Data-assimilation training days 5-7 July 2010 Peter Jan van Leeuwen Data Assimilation Research Center (DARC) University.
Data Assimilation Tristan Quaife, Philip Lewis. What is Data Assimilation? A working definition: The set techniques the combine data with some underlying.
Progress with land DA P. Lewis UCL Geography & NERC NCEO.
Radiative Transfer Modelling for the characterisation of natural burnt surfaces AO/1-5526/07/NL/HE Recommendations #2c P. LEWIS 1, T. QUAIFE 5, J. GOMEZ-DANS.
Land Data Assimilation
Analysis of the terrestrial carbon cycle through data assimilation and remote sensing Mathew Williams, University of Edinburgh Collaborators L Spadavecchia,
EOLDAS_ng The new generation Prof. P. Lewis, Dr. Jose Gomez-Dans, UCL/NCEO.
Multi-sensor and multi-scale data assimilation of remotely sensed snow observations Konstantinos Andreadis 1, Dennis Lettenmaier 1, and Dennis McLaughlin.
A Framework for Integrating Remote Sensing, Soil Sampling, and Models for Monitoring Soil Carbon Sequestration J. W. Jones, S. Traore, J. Koo, M. Bostick,
Exploitation of MODIS and MISR Surface Albedos in Support of SVAT Models LANDFLUX meeting, Toulouse, May 28-31, 2007 JRC – Ispra Bernard Pinty, T. Lavergne,
Optimal Retrieval of Vegetation Canopy Characteristics Using Operational MODIS and MISR Surface Albedo Products LMD, Paris, October 5, 2007 JRC – Ispra.
Lab 2 Lab 3 Homework Labs 4-6 Final Project Late No Videos Write up
W. McNair Bostick, Oumarou Badini, James W. Jones, Russell S. Yost, Claudio O. Stockle, and Amadou Kodio Ensemble Kalman Filter Estimation of Soil Carbon.
MODIS Science Team Meeting - 18 – 20 May Routine Mapping of Land-surface Carbon, Water and Energy Fluxes at Field to Regional Scales by Fusing Multi-scale.
Some template text and images for presentations on the Advanced Data Assimilation Methods project Bethan Harris Assimila Ltd.
Ibrahim Hoteit KAUST, CSIM, May 2010 Should we be using Data Assimilation to Combine Seismic Imaging and Reservoir Modeling? Earth Sciences and Engineering.
Motion Tracking. Image Processing and Computer Vision: 82 Introduction Finding how objects have moved in an image sequence Movement in space Movement.
Data Assimilation in the NCEO (National Centre for Earth Observation) Peter Jan van Leeuwen Data-Assimilation Research Centre DARC University of Reading.
VENUS (Vegetation and Environment New µ-Spacecraft) A demonstration space mission dedicated to land surface environment (Vegetation and Environment New.
Retrieval Theory Mar 23, 2008 Vijay Natraj. The Inverse Modeling Problem Optimize values of an ensemble of variables (state vector x ) using observations:
REMOTE SENSING & THE INVERSE PROBLEM “Remote sensing is the science and art of obtaining information about an object, area, or phenomenon through the analysis.
Arizona State University DMML Kernel Methods – Gaussian Processes Presented by Shankar Bhargav.
The Calibration Process
Lecture II-2: Probability Review
Geogg124 TERRESTRIAL CARBON: MODELLING and MONITORING P. Lewis Professor of Remote Sensing UCL Geography & NERC NCEO.
Helsinki University of Technology Adaptive Informatics Research Centre Finland Variational Bayesian Approach for Nonlinear Identification and Control Matti.
Colorado Center for Astrodynamics Research The University of Colorado STATISTICAL ORBIT DETERMINATION Project Report Unscented kalman Filter Information.
1 Bayesian methods for parameter estimation and data assimilation with crop models Part 2: Likelihood function and prior distribution David Makowski and.
Applications of Bayesian sensitivity and uncertainty analysis to the statistical analysis of computer simulators for carbon dynamics Marc Kennedy Clive.
Data assimilation in land surface schemes Mathew Williams University of Edinburgh.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
Carbon, soil moisture and fAPAR assimilation Wolfgang Knorr Max-Planck Institute of Biogeochemistry Jena, Germany 1 Acknowledgments: Nadine Gobron 2, Marko.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
Mean Field Variational Bayesian Data Assimilation EGU 2012, Vienna Michail Vrettas 1, Dan Cornford 1, Manfred Opper 2 1 NCRG, Computer Science, Aston University,
Ch 2. Probability Distributions (1/2) Pattern Recognition and Machine Learning, C. M. Bishop, Summarized by Yung-Kyun Noh and Joo-kyung Kim Biointelligence.
A unifying framework for hybrid data-assimilation schemes Peter Jan van Leeuwen Data Assimilation Research Center (DARC) National Centre for Earth Observation.
17 May 2007RSS Kent Local Group1 Quantifying uncertainty in the UK carbon flux Tony O’Hagan CTCD, Sheffield.
Center for Radiative Shock Hydrodynamics Fall 2011 Review Assessment of predictive capability Derek Bingham 1.
INVERSE MODELING OF ATMOSPHERIC COMPOSITION DATA Daniel J. Jacob See my web site under “educational materials” for lectures on inverse modeling atmospheric.
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
FastOpt Quantitative Design of Observational Networks M. Scholze, R. Giering, T. Kaminski, E. Koffi P. Rayner, and M. Voßbeck Future GHG observation WS,
INVERSE MODELING TECHNIQUES Daniel J. Jacob. GENERAL APPROACH FOR COMPLEX SYSTEM ANALYSIS Construct mathematical “forward” model describing system As.
Quality of model and Error Analysis in Variational Data Assimilation François-Xavier LE DIMET Victor SHUTYAEV Université Joseph Fourier+INRIA Projet IDOPT,
Recursive Calibration of Ecosystem Models Using Sequential Data Assimilation Mingshi Chen¹, Shuguang Liu¹, Larry L. Tieszen², and David Y. Hollinger 3.
Eawag: Swiss Federal Institute of Aquatic Science and Technology Mechanism-Based Emulation of Dynamic Simulation Models – Concept and Application in Hydrology.
Forecasts & their Errors Ross Bannister 7th October / 23 PDFsAssimilationMeasuringModellingRefiningChallenges Forecasts & their Errrors Ross Bannister.
Derivative-based uncertainty quantification in climate modeling P. Heimbach 1, D. Goldberg 2, C. Hill 1, C. Jackson 3, N. Petra 3, S. Price 4, G. Stadler.
Data assimilation as a tool for biogeochemical studies Mathew Williams University of Edinburgh.
Hydrologic Data Assimilation with a Representer-Based Variational Algorithm Dennis McLaughlin, Parsons Lab., Civil & Environmental Engineering, MIT Dara.
6. Population Codes Presented by Rhee, Je-Keun © 2008, SNU Biointelligence Lab,
Inverse Modeling of Surface Carbon Fluxes Please read Peters et al (2007) and Explore the CarbonTracker website.
Geogg124: Data assimilation P. Lewis. What is Data Assimilation? Optimal merging of models and data Models Expression of current understanding about process.
École Doctorale des Sciences de l'Environnement d’Île-de-France Année Universitaire Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
École Doctorale des Sciences de l'Environnement d’ Î le-de-France Année Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
Mesoscale Assimilation of Rain-Affected Observations Clark Amerault National Research Council Postdoctoral Associate - Naval Research Laboratory, Monterey,
Probabilistic Robotics Bayes Filter Implementations Gaussian filters.
Alexander Loew1, Mike Schwank2
The Carbon Cycle Data Assimilation System (CCDAS)
The Calibration Process
Jincong He, Louis Durlofsky, Pallav Sarma (Chevron ETC)
Lecture 10: Observers and Kalman Filters
Ensemble variance loss in transport models:
Kostas M. Andreadis1, Dennis P. Lettenmaier1
Filtering and State Estimation: Basic Concepts
Michal Rosen-Zvi University of California, Irvine
Kalman Filter: Bayes Interpretation
Presentation transcript:

P.Lewis (1) Gomez-Dans, J. (1), Kaminski, T. (2) ; Settle, J. (3), Quaife, T. (3), Gobron, N. (4), Styles, J. (5), Berger, M. (6) Data Assimilation of Sentinel-2 Observations: Preliminary results from EO-LDAS and Outlook (1) UCL and NCEO, (2) FastOpt, (3) University of Reading and NCEO (4) European Commission, DG Joint Research Centre (5) Assimila Ltd., (6) ESA ESRIN, Science Strategy, Coordination and Planning Office (EOP-SA), +FSU Jena (field data)

EO-LDAS ESA STSE project prototype Earth Observation Data Assimilation System Software soon to be released: python package gain experience with using DA with EO data Variational system Includes interface to the canopy Radiative Transfer model: semi-discrete (Gobron et al.) + soil & leaf spectral with associated adjoint code

The remote sensing problem Context here: vegetation canopies Infer vegetation properties from radiometry E.g. LAI, chlorophyll, water Test/drive models e.g. biogeochem. for C flux, crop models etc. Historically Vegetation indices Data transforms to maximise sensitivity to target variable (e.g. LAI) Empirical or model-based relationships Model ‘inversion’ RT model predictions of measurements y as function of state x LUT/ANN mapping of inverse function

Issues with inversion Poor or no treatment of uncertainty Problem mostly ill-conditioned Not enough information to solve for all terms E.g. RT model state: Assume some terms ‘known’ Better to specify knowledge as explicit constraint With associated uncertainty LAILeaf inclination distribution Leaf chlorophyll Leaf waterLeaf dry matter Soil brightness Soil water

Bayes theorum Combine probabilities Gaussian

Combine prior and observation Optimal (ML) estimate for x at max(exp(j)) So min(J) Recognise J as ‘cost fn’

Combine prior and observation For illustration, consider simplest case: H(x)=I(x) so y=x

prior

observation

posterior

e.g. MERIS with weak prior Prior conditions solution

0.4<=LAI<=0.9

Predict MODIS from solution

Data Assimilation Variational methods Solve for minimum of (summed) J Can solve large (10 3+ ) state vector Make use of Jacobian J’ So need adjoint code for efficiency Uncertainty from error fn curvature (Hessian) J’’ Solve for all x at once Easiest if assume Gaussian stats Sequential methods E.g. Kalman filter++

Elements of a DA system State vector x Observations y Prior constraint Process model Q(x) Obs constraint with y=H(x)

Constraint models Allows to integrate process model and observations E.g. biogeochem model/crop model Options: Solve for initial conditions (strong constraint) Solve for full state vector With model uncertainty (weak constraint) Issues: Models for all elements that affect EO not available

Strong constraint e.g. meteo forecast

Weak constraint

Simplest Q model Zero-order process model x(t+1) = x(t) E[x(t+1)-x(t)=0] = C model So Dx=0 1 st O difference constraint regularisation

EO-LDAS MODIS data Wheat field, Gebesee

MODIS results Slight over-smoothed But viable LAI But demonstrate ability to solve for all (8 here) vegetation state parameters For each day of year = 8x365 ~= 3000 Using only simple regularisation model 2 nd difference here

Sentinel-2 MSI Synthetic experiment See Lewis et al. (2012) RSE 2 scenarios Full (5 day) coverage Cloudy (50%) coverage Assume temporal trajectories Green lines in plots Solve for vegetation state For each sample day (loose prior only) With prior + D1 & D2 regularisation models

Sentinel-2 MSI: cloudy

Sentinel-2 MSI: regularisation

Sentinel-2 MSI Viable results for MSI with prior But quite large uncertainties DA with regularisation model Reduce uncertainty by ~2 on average Solve for all days Speed bottleneck for full RT model Replace by GP emulation models Same for process models?

Outlook DA framework appropriate way to estimate vegetation state from EO Priors express certainty in expectations Rather than simply assuming terms constant Regularisation methods allow estimation of full state vector If no other process model available Or if purpose is to test process model Framework can integrate any process models E.g. biogeochem models for C flux estimation E.g. crop growth Framework can be applied to space as well as time Route for multi-scale sensor integration

EO-LDAS Project website Software tutorial Software release soon New ESA DA project Integrate SVAT/vegetation dynamics models More observation operators: Passive microwave

Thank you