Adjoint modeling and applications

Slides:



Advertisements
Similar presentations
Introduction to Data Assimilation NCEO Data-assimilation training days 5-7 July 2010 Peter Jan van Leeuwen Data Assimilation Research Center (DARC) University.
Advertisements

Using PALM to integrate variational data assimilation algorithms with OPA ECMWF, 29 june 2005, Reading. Nicolas Daget CERFACS, Toulouse.
A Discrete Adjoint-Based Approach for Optimization Problems on 3D Unstructured Meshes Dimitri J. Mavriplis Department of Mechanical Engineering University.
Setup of 4D VAR inverse modelling system for atmospheric CH 4 using the TM5 adjoint model Peter Bergamaschi Climate Change Unit Institute for Environment.
Aspects of Conditional Simulation and estimation of hydraulic conductivity in coastal aquifers" Luit Jan Slooten.
GEOS-CHEM adjoint development using TAF
Motion Analysis (contd.) Slides are from RPI Registration Class.
October, Scripps Institution of Oceanography An Alternative Method to Building Adjoints Julia Levin Rutgers University Andrew Bennett “Inverse Modeling.
A Variational Carbon Data Assimilation System (CDAS-4DVar)
A Concept of Environmental Forecasting and Variational Organization of Modeling Technology Vladimir Penenko Institute of Computational Mathematics and.
Advanced data assimilation methods with evolving forecast error covariance Four-dimensional variational analysis (4D-Var) Shu-Chih Yang (with EK)
Intercontinental Source Attribution of Ozone Pollution at Western U.S. Sites Using an Adjoint Method Lin Zhang, Daniel J. Jacob, Monika Kopacz Harvard.
Retrieval Theory Mar 23, 2008 Vijay Natraj. The Inverse Modeling Problem Optimize values of an ensemble of variables (state vector x ) using observations:
12 1 Variations on Backpropagation Variations Heuristic Modifications –Momentum –Variable Learning Rate Standard Numerical Optimization –Conjugate.
GEOS-Chem Adjoint: construction and long-term maintainability A. Sandu, K. Singh: Virginia Tech D. Henze: Caltech K. Bowman: JPL.
Interval-based Inverse Problems with Uncertainties Francesco Fedele 1,2 and Rafi L. Muhanna 1 1 School of Civil and Environmental Engineering 2 School.
UNCONSTRAINED MULTIVARIABLE
IFAC Control of Distributed Parameter Systems, July 20-24, 2009, Toulouse Inverse method for pyrolysable and ablative materials with optimal control formulation.
Understanding the 3DVAR in a Practical Way
ROMS/TOMS TL and ADJ Models: Tools for Generalized Stability Analysis and Data Assimilation Andrew Moore, CU Hernan Arango, Rutgers U Arthur Miller, Bruce.
Newton's Method for Functions of Several Variables Joe Castle & Megan Grywalski.
Application of Differential Applied Optimization Problems.
GLOBAL MODELS OF ATMOSPHERIC COMPOSITION Daniel J. Jacob Harvard University.
CSDA Conference, Limassol, 2005 University of Medicine and Pharmacy “Gr. T. Popa” Iasi Department of Mathematics and Informatics Gabriel Dimitriu University.
« Data assimilation in isentropic coordinates » Which Accuracy can be achieved using an high resolution transport model ? F. FIERLI (1,2), A. HAUCHECORNE.
Smoke from open fires in Equatorial Asia affects one of the most densely populated regions in the world Fire emissions in color (June-November 2006) Cities.
Assimilation of HF Radar Data into Coastal Wave Models NERC-funded PhD work also supervised by Clive W Anderson (University of Sheffield) Judith Wolf (Proudman.
Tbilisi, GGSWBS'14 Optimization for inverse modelling Ketevan Kasradze 1 Hendrik Elbern 1,2
NUMERICAL MODELING OF THE OCEAN AND MARINE DYNAMICS ON THE BASE OF MULTICOMPONENT SPLITTING Marchuk G.I., Kordzadze A.A., Tamsalu R, Zalesny V.B., Agoshkov.
Overview of Techniques for Deriving Emission Inventories from Satellite Observations Frascati, November 2009 Bas Mijling Ronald van der A.
Analysis of TraceP Observations Using a 4D-Var Technique
Computer Animation Rick Parent Computer Animation Algorithms and Techniques Optimization & Constraints Add mention of global techiques Add mention of calculus.
MODEL ERROR ESTIMATION EMPLOYING DATA ASSIMILATION METHODOLOGIES Dusanka Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University.
Research Vignette: The TransCom3 Time-Dependent Global CO 2 Flux Inversion … and More David F. Baker NCAR 12 July 2007 David F. Baker NCAR 12 July 2007.
Development of an EnKF to estimate CO 2 fluxes from realistic distributions of X CO2 Liang Feng, Paul Palmer
INVERSE MODELING OF ATMOSPHERIC COMPOSITION DATA Daniel J. Jacob See my web site under “educational materials” for lectures on inverse modeling atmospheric.
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
Inverse modeling in a linear algebra framework State vector x (dimension n) Observation vector y (dimension m) correlations between vector elements Use.
INVERSE MODELING TECHNIQUES Daniel J. Jacob. GENERAL APPROACH FOR COMPLEX SYSTEM ANALYSIS Construct mathematical “forward” model describing system As.
Errors, Uncertainties in Data Assimilation François-Xavier LE DIMET Université Joseph Fourier+INRIA Projet IDOPT, Grenoble, France.
Quality of model and Error Analysis in Variational Data Assimilation François-Xavier LE DIMET Victor SHUTYAEV Université Joseph Fourier+INRIA Projet IDOPT,
Variational data assimilation: examination of results obtained by different combinations of numerical algorithms and splitting procedures Zahari Zlatev.
1 Chapter 6 General Strategy for Gradient methods (1) Calculate a search direction (2) Select a step length in that direction to reduce f(x) Steepest Descent.
Variations on Backpropagation.
1 Training a Feed Forward Neural Network Metamodel of a Manufacturing System using a Homotopy Approach Corinne MacDonald, P.Eng. Dr. Eldon A. Gunn, P.Eng.
MIIDAPS Application to GSI for QC and Dynamic Emissivity in Passive Microwave Data Assimilation.
Further Developments and Applications for the Adjoint of CMAQ
NASA, JPL,January  CLIME INRIA Paris  Météo France  Institut de Mathématiques, Université de Toulouse  LEGI, Grenoble  MOISE INRIA Grenoble.
Recent Developments in Computational Tools for Chemical Data Assimilation A. Sandu: Virginia Tech G.R. Carmichael: University of Iowa J.H. Seinfeld: Caltech.
Observations and Ocean State Estimation: Impact, Sensitivity and Predictability Andy Moore University of California Santa Cruz Hernan Arango Rutgers University.
Assimilation of Satellite Derived Aerosol Optical Depth Udaysankar Nair 1, Sundar A. Christopher 1,2 1 Earth System Science Center, University of Alabama.
Introduction In 1904, Bjerknes pointed out that the future state of the atmosphere could be predicted by integrating the partial differential equations.
1 Radiative Transfer Models and their Adjoints Paul van Delst.
École Doctorale des Sciences de l'Environnement d’ Î le-de-France Année Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
Public health impacts of the severe haze in Equatorial Asia in September-October 2015: A new tool for fire management to reduce downwind smoke exposure.
Retrieving sources of fine aerosols from MODIS/AERONET observations by inverting GOCART model INVERSION: Oleg Dubovik 1 Tatyana Lapyonok 1 Tatyana Lapyonok.
Comparison of adjoint and analytical approaches for solving atmospheric chemistry inverse problems Monika Kopacz 1, Daniel J. Jacob 1, Daven Henze 2, Colette.
Estimating emissions from observed atmospheric concentrations: A primer on top-down inverse methods Daniel J. Jacob.
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
Carbon Cycle Data Assimilation with a Variational Approach (“4-D Var”) David Baker CGD/TSS with Scott Doney, Dave Schimel, Britt Stephens, and Roger Dargaville.
Hybrid Data Assimilation
Implementation of Linear Sensitivity Approximate Method
Monika Kopacz, Daniel Jacob, Jenny Fisher, Meghan Purdy
Ensemble variance loss in transport models:
Assimilating Tropospheric Emission Spectrometer profiles in GEOS-Chem
Variations on Backpropagation.
Chapter 10. Numerical Solutions of Nonlinear Systems of Equations
FSOI adapted for used with 4D-EnVar
Variations on Backpropagation.
Sarah Dance DARC/University of Reading
Presentation transcript:

Adjoint modeling and applications Consider a forward model y = F(x) with Jacobian matrix The adjoint of that forward model applies KT to vectors called adjoint forcings This is useful for Determining the sensitivity of model output to model variables going back in time; Solving the inverse problem numerically rather than analytically to accommodate large state vectors (4DVAR inversion)

Adjoint model as sensitivity analysis tool Forward model (CTM): State vector x(0) Concentrations y(0) y(1) y(p-1) y(p) Time t0 t1 tp-1 tp Jacobian expresses sensitivity of y(p) to x(0): Take transpose: Apply sequentially to unit vector v = (1,0…0)T: followed by etc… Single pass of the adjoint over [tp, t0] returns sensitivity of y(p),1 to all model variables at all previous times: y(p),1/y(p-1), y(p),1/y(p-2),… y(p),1/x(0)

Application to receptor modeling: sensitivity of smoke in Singapore to fire locations in Equatorial Asia MODIS fire observations, June 20-29 2013 Smoke in Singapore, June 20 Smoke transport simulated by GEOS-Chem Large fire emissions in Equatorial Asia from oil palm and timber plantations Adjoint can identify the sensitivity of smoke concentrations at a particular receptor site to fire emissions at all locations and previous times Smoke concentration in surface air Kim et al. [2015]

Using GEOS-Chem adjoint to compute sensitivity of smoke concentrations in Singapore to fire emissions Emissions E(x, t) from bottom-up inventory Concentrations y(x, t) =F(E(x, t)) computed with GEOS-Chem Sensitivities s (x, t,t’) = ySingapore(t)/E(x, t’) computed with GEOS-Chem adjoint Contributions to Singapore smoke Smoke concentrations in Singapore can be calculated for ANY emission inventory E and time t using archived sensitivities computed just ONCE from the adjoint:

Simple construction of a CTM adjoint Consider a CTM split into advection (A), chemistry (C), and emission (E) operators: Linearize each operator so that it operates as a matrix: This defines the Tangent Linear Model (TLM) and the model adjoint: TLM Adjoint Constructing the adjoint requires construction of the TLM by differentiating the model equations or the model code…and this represents most of the work

Adjoint of a linear advection operator transpose (adjoint) α 1 2 3 Courant number α = ut/ x α α Linear upstream advection scheme: Transpose applies reverse winds: Same applies in a linear Lagrangian model (reverse the winds to get the adjoint)

Adjoint of a linear chemistry operator A linear chemistry operator is self-adjoint; same operator can be used in forward and adjoint models. Sensitivity with respect to emissions is also self-adjoint:

Variational inversion xA Solve the inverse problem ° 1 2 ° x1 numerically rather than analytically ° x2 1. Starting from prior xA , calculate 2. Using a steepest-descent algorithm get next guess x1 3. Calculate 3 x3 ° , get next guess x2 4. Iterate until convergence Adjoint model computes by applying KT to adjoint forcings Minimum of cost function J

Adjoint method for calculating cost function gradient Time t0 t1 tp-2 tp-1 tp Observations y(0) y(1) y(p-2) y(p-1) y(p) Forward model F(xA) over[t0, tp] add add add add t0 t1 tp-2 tp-1 tp adjoint model

3DVAR and 4DVAR data assimilation State vector: 3-D time-dependent concentration field (very large) Observation vector: observations of state variables or related variables Example: assimilation of satellite observations of stratospheric ozone t0 t1 = t0 + h t2 = t0 + 2h 3DVAR 4DVAR Forecast model with assimilation at time increments h 3DVAR: same as Kalman filter but minimize cost function numerically 4DVAR: use adjoint to optimize field at t0 using observations spread over [t0, t0 + h]