1 Radiative Transfer Models and their Adjoints Paul van Delst.

Slides:



Advertisements
Similar presentations
Assimilation of radar data - research plan
Advertisements

Lect.3 Modeling in The Time Domain Basil Hamed
Isoparametric Elements Element Stiffness Matrices
Assimilation Algorithms: Tangent Linear and Adjoint models Yannick Trémolet ECMWF Data Assimilation Training Course March 2006.
A Discrete Adjoint-Based Approach for Optimization Problems on 3D Unstructured Meshes Dimitri J. Mavriplis Department of Mechanical Engineering University.
The Inverse Regional Ocean Modeling System:
Polly Smith, Alison Fowler, Amos Lawless School of Mathematical and Physical Sciences, University of Reading Exploring coupled data assimilation using.
Inversion of coupled groundwater flow and heat transfer M. Bücker 1, V.Rath 2 & A. Wolf 1 1 Scientific Computing, 2 Applied Geophysics Bommerholz ,
1 Regression Models & Loss Reserve Variability Prakash Narayan Ph.D., ACAS 2001 Casualty Loss Reserve Seminar.
Properties of State Variables
Regression Analysis Once a linear relationship is defined, the independent variable can be used to forecast the dependent variable. Y ^ = bo + bX bo is.
L.M. McMillin NOAA/NESDIS/ORA Regression Retrieval Overview Larry McMillin Climate Research and Applications Division National Environmental Satellite,
Engineering Optimization – Concepts and Applications Engineering Optimization Concepts and Applications Fred van Keulen Matthijs Langelaar CLA H21.1
280 SYSTEM IDENTIFICATION The System Identification Problem is to estimate a model of a system based on input-output data. Basic Configuration continuous.
ECMWF CO 2 Data Assimilation at ECMWF Richard Engelen European Centre for Medium-Range Weather Forecasts Reading, United Kingdom Many thanks to Phil Watts,
Common Factor Analysis “World View” of PC vs. CF Choosing between PC and CF PAF -- most common kind of CF Communality & Communality Estimation Common Factor.
CSE351/ IT351 Modeling and Simulation
October, Scripps Institution of Oceanography An Alternative Method to Building Adjoints Julia Levin Rutgers University Andrew Bennett “Inverse Modeling.
ENGG 1801 Engineering Computing MATLAB Lecture 7: Tutorial Weeks Solution of nonlinear algebraic equations (II)
Advanced data assimilation methods with evolving forecast error covariance Four-dimensional variational analysis (4D-Var) Shu-Chih Yang (with EK)
Development of Empirical Models From Process Data
Dynamical Systems Analysis II: Evaluating Stability, Eigenvalues By Peter Woolf University of Michigan Michigan Chemical Process Dynamics.
Transfer Functions Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: The following terminology.
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
1 Adjoint Method in Network Analysis Dr. Janusz A. Starzyk.
Ordinary Differential Equations (ODEs)
Objectives of Multiple Regression
Modeling a Dipole Above Earth Saikat Bhadra Advisor : Dr. Xiao-Bang Xu Clemson SURE 2005.
Tutorial 5: Numerical methods - buildings Q1. Identify three principal differences between a response function method and a numerical method when both.
Computing a posteriori covariance in variational DA I.Gejadze, F.-X. Le Dimet, V.Shutyaev.
MML Inference of RBFs Enes Makalic Lloyd Allison Andrew Paplinski.
Newton's Method for Functions of Several Variables Joe Castle & Megan Grywalski.
The vertical resolution of the IASI assimilation system – how sensitive is the analysis to the misspecification of background errors? Fiona Hilton and.
Data assimilation and observing systems strategies Pierre Gauthier Data Assimilation and Satellite Meteorology Division Meteorological Service of Canada.
A physical basis of GOES SST retrieval Prabhat Koner Andy Harris Jon Mittaz Eileen Maturi.
Overview of Techniques for Deriving Emission Inventories from Satellite Observations Frascati, November 2009 Bas Mijling Ronald van der A.
Indo-European network on Advanced Instability Methods Sensitivity and Adjoint operators: a simple matlab example (the discrete adjoint approach)‏
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 18: Minimum Variance Estimator.
Solution of a System of ODEs with POLYMATH and MATLAB, Boundary Value Iterations with MATLAB For a system of n simultaneous first-order ODEs: where x is.
INVERSE MODELING OF ATMOSPHERIC COMPOSITION DATA Daniel J. Jacob See my web site under “educational materials” for lectures on inverse modeling atmospheric.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Derivation Computational Simplifications Stability Lattice Structures.
AIRS Radiance and Geophysical Products: Methodology and Validation Mitch Goldberg, Larry McMillin NOAA/NESDIS Walter Wolf, Lihang Zhou, Yanni Qu and M.
INVERSE MODELING TECHNIQUES Daniel J. Jacob. GENERAL APPROACH FOR COMPLEX SYSTEM ANALYSIS Construct mathematical “forward” model describing system As.
Quality of model and Error Analysis in Variational Data Assimilation François-Xavier LE DIMET Victor SHUTYAEV Université Joseph Fourier+INRIA Projet IDOPT,
NCAF Manchester July 2000 Graham Hesketh Information Engineering Group Rolls-Royce Strategic Research Centre.
Variational data assimilation: examination of results obtained by different combinations of numerical algorithms and splitting procedures Zahari Zlatev.
Bayes Theorem The most likely value of x derived from this posterior pdf therefore represents our inverse solution. Our knowledge contained in is explicitly.
An Introduction to Optimal Estimation Theory Chris O´Dell AT652 Fall 2013.
MIIDAPS Application to GSI for QC and Dynamic Emissivity in Passive Microwave Data Assimilation.
Geogg124: Data assimilation P. Lewis. What is Data Assimilation? Optimal merging of models and data Models Expression of current understanding about process.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Kalman Filter with Process Noise Gauss- Markov.
A New Ocean Suite Algorithm for AMSR2 David I. Duncan September 16 th, 2015 AMSR Science Team Meeting Huntsville, AL.
Adjoint models: Theory ATM 569 Fovell Fall 2015 (See course notes, Chapter 15) 1.
MathematicalMarketing Slide 5.1 OLS Chapter 5: Ordinary Least Square Regression We will be discussing  The Linear Regression Model  Estimation of the.
École Doctorale des Sciences de l'Environnement d’ Î le-de-France Année Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course Mar 2016.
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course
Transfer Functions Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: The following terminology.
Adjoint modeling and applications
ENGG 1801 Engineering Computing
Clear Sky Forward Model & Its Adjoint Model
Assimilating Tropospheric Emission Spectrometer profiles in GEOS-Chem
FSOI adapted for used with 4D-EnVar
§1-2 State-Space Description
Important Properties of Laplace Transforms
Linear regression.
MURI Hyperspectral Workshop Madison WI, June 7
Chapter 3 Modeling in the Time Domain
Derivatives and Gradients
Presentation transcript:

1 Radiative Transfer Models and their Adjoints Paul van Delst

Use of satellite radiances in Data Assimilation (DA) Radiative Transfer Model (RTM) components and definitions Testing the RTM components. Advantages/disadvantages Overview

Adjust the model trajectory with data. Iteratively minimise the difference between a model prediction and data using a cost/penalty function, e.g. – X, X b : Input state vector and background estimate – Y m, Y(X): Measurements and forward model – B, O, F: Error covariances of X b, Y m, and Y(X) Iteration step direction is determined from Y(X) linearised about X b, Where the K(X b ) are the Jacobians (K-Matrix) of the forward model for the background state X b, Use of satellite radiances in DA

Forward (FWD) model. The FWD operator maps the input state vector, X, to the model prediction, Y, e.g. for predictor #11: RTM components and definitions (1) Tangent-linear (TL) model. Linearisation of the forward model about X b, the TL operator maps changes in the input state vector,  X, to changes in the model prediction,  Y, Or, in matrix form:

Adjoint (AD) model. The AD operator maps in the reverse direction where for a given perturbation in the model prediction,  Y, the change in the state vector,  X, can be determined. The AD operator is the transpose of the TL operator. Using the example for predictor #11 in matrix form, RTM components and definitions (2) Expanding this into separate equations:

K-Matrix (K) model. Consider a channel radiance vector, R, computed using a single surface temperature, T sfc,. For every channel, l, RTM components and definitions (3) This is not what you want for DA/retrievals since the sensitivity of each channel is accumlated in the final surface temperature adjoint variable. Simple solution: So in the RTM, the K-matrix code simply involves shifting all the channel independent adjoint code inside the channel loop. That’s it.

Start with the assumption that the FWD component is in good shape (e.g. validated with observations, radiosonde matchups, etc). TL test against the forward model. Run the TL model with  X inputs varying from -  X  0  +  X to give  Y TL. Run the FWD model with X+  X inputs and difference from the zero perturbation case to get the non-linear result  Y NL. Inspect  Y TL and  Y NL as a function of  X. TL must be linear (d’oh) for all  X and tangent (d’oh 2 ) to the NL result at  X=0. Linearity of the TL result can be checked by numerical differentiation to give a constant for all  X. Numerical differentiation of NL result should give same value as TL at  X=0. But accuracy of numerical derivative is an issue if the perturbation resolution is low. Testing the RTM components – FWD/TL

Assume the FWD model input vector, X, has K elements and the output vector has L elements, Testing the RTM components – TL/AD Run the TL model j = 1 to K times with input, saving the  Y vector output each run to give a LxK matrix, TL. saving the  *X vector output each run to give a KxL matrix, AD. Then, to within numerical precision, Run the AD model j = 1 to L times with input,

Input: T 2 P 2 Output: P

Input: Wet P * Output: P

Input: Ozo P ** Output: Ozo A

Advantages – Adjoint method produces Jacobians fully consistent with the forward model. – Well defined set of rules for applying method to code. – Code tests are straightforward and definitive – particularly for the TL/AD test. – Easy to incorporate model changes, improvements, additions, etc. – Good for sensitivity analyses. TL used to investigate impact of small disturbances, AD can be used to investigate origin of the anomaly. Disadvantages – Complexity. Compared to finite differences (if one can live with using them), adjoint coding can be a bit of a brain teaser. – Very easy to produce code slower than a snail in a straitjacket. Up front code design is an important step. – Have to be careful when vectorising and optimising code. Advantages/Disadvantages