Variational data assimilation: examination of results obtained by different combinations of numerical algorithms and splitting procedures Zahari Zlatev.

Slides:



Advertisements
Similar presentations
Introduction to Data Assimilation NCEO Data-assimilation training days 5-7 July 2010 Peter Jan van Leeuwen Data Assimilation Research Center (DARC) University.
Advertisements

Example Project and Numerical Integration Computational Neuroscience 03 Lecture 11.
Formal Computational Skills
MANE 4240 & CIVL 4240 Introduction to Finite Elements
Assimilation Algorithms: Tangent Linear and Adjoint models Yannick Trémolet ECMWF Data Assimilation Training Course March 2006.
Computational Challenges in Air Pollution Modelling Z. Zlatev National Environmental Research Institute 1. Why air pollution modelling? 2. Major physical.
Fighting the Great Challenges in Large-scale Environmental Modelling I. Dimov n Great challenges in environmental modelling n Impact of climatic changes.
Initialization Issues of Coupled Ocean-atmosphere Prediction System Climate and Environment System Research Center Seoul National University, Korea In-Sik.
EARS1160 – Numerical Methods notes by G. Houseman
Chapter 1 Computing Tools Data Representation, Accuracy and Precision Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction.
Engineering Optimization – Concepts and Applications Engineering Optimization Concepts and Applications Fred van Keulen Matthijs Langelaar CLA H21.1
280 SYSTEM IDENTIFICATION The System Identification Problem is to estimate a model of a system based on input-output data. Basic Configuration continuous.
1 EE 616 Computer Aided Analysis of Electronic Networks Lecture 12 Instructor: Dr. J. A. Starzyk, Professor School of EECS Ohio University Athens, OH,
Gradient Methods May Preview Background Steepest Descent Conjugate Gradient.
A Concept of Environmental Forecasting and Variational Organization of Modeling Technology Vladimir Penenko Institute of Computational Mathematics and.
1 EE 616 Computer Aided Analysis of Electronic Networks Lecture 12 Instructor: Dr. J. A. Starzyk, Professor School of EECS Ohio University Athens, OH,
Validation and intercomparation discussion Items Size of assimilation ensembles. Is it to be determined only by numerical stability of algorithms? (O.
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
Chapter 16 Integration of Ordinary Differential Equations.
Ordinary Differential Equations (ODEs)
Numerical Solution of Ordinary Differential Equation
MATH 685/ CSI 700/ OR 682 Lecture Notes Lecture 10. Ordinary differential equations. Initial value problems.
1 Chapter 6 Numerical Methods for Ordinary Differential Equations.
Ordinary Differential Equations (ODEs) 1Daniel Baur / Numerical Methods for Chemical Engineers / Explicit ODE Solvers Daniel Baur ETH Zurich, Institut.
Ch 8.1 Numerical Methods: The Euler or Tangent Line Method
Ch 8.3: The Runge-Kutta Method
Introduction to variable selection I Qi Yu. 2 Problems due to poor variable selection: Input dimension is too large; the curse of dimensionality problem.
Lecture 22 MA471 Fall Advection Equation Recall the 2D advection equation: We will use a Runge-Kutta time integrator and spectral representation.
CSDA Conference, Limassol, 2005 University of Medicine and Pharmacy “Gr. T. Popa” Iasi Department of Mathematics and Informatics Gabriel Dimitriu University.
Environmental Modelling, Security Measures and Decision Making Zahari Zlatev National Environmental Research Institute Frederiksborgvej 399, P. O. Box.
Using Partitioning in the Numerical Treatment of ODE Systems with Applications to Atmospheric Modelling Zahari Zlatev National Environmental Research Institute.
Zorica Stanimirović Faculty of Mathematics, University of Belgrade
1 Spring 2003 Prof. Tim Warburton MA557/MA578/CS557 Lecture 31.
Geographic Information Science
Increasing asymptotic stability of Crank-Nicolson method Alexei A. Medovikov Vyacheslav I. Lebedev.
Integration of 3-body encounter. Figure taken from
Mean Field Variational Bayesian Data Assimilation EGU 2012, Vienna Michail Vrettas 1, Dan Cornford 1, Manfred Opper 2 1 NCRG, Computer Science, Aston University,
Analysis of TraceP Observations Using a 4D-Var Technique
Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005.
Georgia Institute of Technology Initial Application of the Adaptive Grid Air Quality Model Dr. M. Talat Odman, Maudood N. Khan Georgia Institute of Technology.
Satellite-based inversion of NOx emissions using the adjoint of CMAQ Amir Hakami, John H. Seinfeld (Caltech) Qinbin Li (JPL) Daewon W. Byun, Violeta Coarfa,
Quadrature rules 1Michael Sokolov / Numerical Methods for Chemical Engineers / Numerical Quadrature Michael Sokolov ETH Zurich, Institut für Chemie- und.
Large Timestep Issues Lecture 12 Alessandra Nardi Thanks to Prof. Sangiovanni, Prof. Newton, Prof. White, Deepak Ramaswamy, Michal Rewienski, and Karen.
CS Statistical Machine learning Lecture 24
Quality of model and Error Analysis in Variational Data Assimilation François-Xavier LE DIMET Victor SHUTYAEV Université Joseph Fourier+INRIA Projet IDOPT,
Circuits Theory Examples Newton-Raphson Method. Formula for one-dimensional case: Series of successive solutions: If the iteration process is converged,
Recap Cubic Spline Interpolation Multidimensional Interpolation Curve Fitting Linear Regression Polynomial Regression The Polyval Function The Interactive.
1 EE 616 Computer Aided Analysis of Electronic Networks Lecture 12 Instructor: Dr. J. A. Starzyk, Professor School of EECS Ohio University Athens, OH,
Ch 8.2: Improvements on the Euler Method Consider the initial value problem y' = f (t, y), y(t 0 ) = y 0, with solution  (t). For many problems, Euler’s.
Lecture 40 Numerical Analysis. Chapter 7 Ordinary Differential Equations.
ECE 576 – Power System Dynamics and Stability Prof. Tom Overbye Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
Optimization of Nonlinear Singularly Perturbed Systems with Hypersphere Control Restriction A.I. Kalinin and J.O. Grudo Belarusian State University, Minsk,
CS Statistical Machine learning Lecture 25 Yuan (Alan) Qi Purdue CS Nov
Efficient Method of Solution of Large Scale Engineering Problems with Interval Parameters Based on Sensitivity Analysis Andrzej Pownuk Silesian University.
1 Radiative Transfer Models and their Adjoints Paul van Delst.
Solving Ordinary Differential Equations
EEE 431 Computational Methods in Electrodynamics
Chapter 7. Classification and Prediction
Kabanikhin S. I., Krivorotko O. I.
MANE 4240 & CIVL 4240 Introduction to Finite Elements
Digital Control Systems
Class Notes 19: Numerical Methods (2/2)
Hidden Markov Models Part 2: Algorithms
CSE 245: Computer Aided Circuit Simulation and Verification
2. University of Northern British Columbia, Prince George, Canada
NONLINEAR AND ADAPTIVE SIGNAL ESTIMATION
MATH 175: Numerical Analysis II
Sarah Dance DARC/University of Reading
NONLINEAR AND ADAPTIVE SIGNAL ESTIMATION
EE 616 Computer Aided Analysis of Electronic Networks Lecture 12
Presentation transcript:

Variational data assimilation: examination of results obtained by different combinations of numerical algorithms and splitting procedures Zahari Zlatev and Jørgen Brandt National Environmental Research Institute Frederiksborgvej 399, P. O. Box 358 DK-4000 Roskilde, Denmark

CONTENTS n Some basic ideas n Optimization issues: calculation of the gradient of the object function n Algorithmic representation of the variational data assimilation n Tools: optimization methods, numerical algorithms and splitting procedures n Performance of the combination of the tools n Some conclusions

BASIC IDEAS - 1 An attempt to adjust globally the results of the model to the complete set of available observations (Talagrand and Courtier, 1987) Consistency between the dynamics of the model and the final results of the assimilation. (Talagrand and Courtier, 1987)

BASIC IDEAS - 2 Assumption: the variational data assimilation is used to improve the initial values of the resolved problem Assumption: the variational data assimilation is used to improve the initial values of the resolved problem Variational data assimilation can be used for several other purposes (as, for example, to improve the quality of the emission fields).

Calculation of the gradient Assume that five fields (i.e. N=5) of observations are available

Calculation of the gradient

Finishing the forward-backward calculations

Calculation of the gradient

Adjoint equations 1. Linear operators 2. Non-linear operators

Algorithmic representation INITIALIZE SCALAR VARIABLES, VECTORS AND ARRAYS; SET THE GRADIENT TO ZERO DO ITERATIONS = 1, MAX_ITERATIONS DO LARGE_STEPS = 1, P_STEP DO FORWARD_STEPS = (LARGE_STEPS – 1)*P_LENGTH + 1, LARGE_STEPS*P_LENGTH Perform a forward step with the model END DO FORWARD_STEPS DO BACKWARD_STEPS = LARGE_STEPS*P_LENGTH, 1, -1 Perform a backward step with the adjoint equation END DO BACKWARD_STEPS UPDATE THE GRADIENT; COMPUTE THE VALUE OF THE OBJECT FUNCTION END DO LARGE_STEPS COMPUTE AN APPROXIMATION OF PARAMETER RHO UPDATE THE INITIAL VALUE FIELD (NEW FIELD = OLD FIELD - RHO*GRADIENT) CHECK THE STOPPING CRITERIA; IF SATISFIED EXIT FROM LOOP DO ITERATIONS END DO ITERATIONS PERFORM OUTPUT OPERATIONS AND STOP THE COMPUTATIONS

Applying splitting procedures Model Model splitting Adjoint equation Adjoint splitting

Computational tools A data assimilation code can be considered as a combination of three kinds of computational tools: u optimization methods, u numerical algorithms and u splitting procedures. It is important to understand that the choice of one of the tools is not independent of the choice of the others and the choice depends also on what is wanted in the particular study. Finding the optimal (or even only a good) combination of computational tools is a great challenge.

Splitting versus numerical errors Order of the numerical method: p Order of the splitting procedure: q Order of the combined methods: r = min(p,q) Synchronizing the choice of splitting procedures and numerical methods

Atmospheric chemical scheme n A chemical scheme containing 56 species has been used in the experiment n Species SO2, SO4, O3, NO, NO3, HNO3 PAN, NH3, NH4, OH and many hydrocarbons n Mathematical description: dc/dt = f(t,c) n Properties: u stiff u badly scaled u the solution varies in very wide range

Treatment of the chemical scheme n Six numerical methods u Backward Euler u Implicit Mid-point Rule u Two-stage Runge-Kutta u Three-stage Runge-Kutta u Two-stage Rosenbrock u Trapezoidal Rule n Five splittings u No splitting u Sequential splitting u Symmetric Splitting u Weighted sequential splitting u Weighted symmetric splitting

Some conclusions from the runs n The Backward Euler method is very robust for such problems, but might be expensive because its order of accuracy is only one. n The Implicit Mid-point Rule, the Trapezoidal Rule and the Three-stage Runge-Kutta method have difficulties. n The Two-stage Runge-Kutta Method and the Two-stage Rosenbrock Method are robust, but perform as first-order methods in spite of the fact that their actual order is two. n Major conclusion: It is not sufficient to have numerical methods of high order, it is also necessary to select methods with good stability properties (L-stability is actually needed).

Need for good stability properties Euler Mid-point Euler Mid-point Time-steps Error Rate Error Rate E E E E E E E E E E E E E E E E E E E E E E E E n Assimilation window: 6: :00, observations at the end of every hour n Random perturbations of 25% are introduced in the ozone concentrations. n Data assimilation was applied using “exact” solutions as observations. n After the data assimilation procedure a forward run with the improved solution was performed on the interval from 6:00 to 12:00

Need for good stability properties-cont. Euler Mid-point Euler Mid-point Time-steps Error Rate Error Rate E E E E E E E E E E E E E E E E E E E E E E E E n Assimilation window: 6: :00, observations at the end of every hour n Random perturbations of 25% are introduced in the ozone concentrations. n Data assimilation was applied using “exact” solutions as observations. n After the data assimilation procedure a forward run with the improved solution was performed on the interval from 6:00 to 48:00

General conclusions n When will the variational data assimilation not work? u the discretization of the model is crude u the number of observations is very small (???) n When will the variational data assimilation work well? u there are sufficiently many observations u interpolation rules (or other similar devices) are used u the number of time-points at which observations are available is perhaps not very important n How to continue this research? u two-dimensional and three dimensional problems u more about the effect of splitting on data assimilation u order of accuracy of the data assimilation routines u interplay between ensembles and data assimilation