Balance and 4D-Var Saroja Polavarapu Meteorological Research Division Environment Canada, Toronto WWRP-THORPEX Workshop on 4D-Var and EnsKF intercomparisons.

Slides:



Advertisements
Similar presentations
Elias Holm – slides courtesy Mike Fisher
Advertisements

© Crown copyright Met Office Implementing a diurnal model at the Met Office James While, Matthew Martin.
Ross Bannister Balance & Data Assimilation, ECMI, 30th June 2008 page 1 of 15 Balance and Data Assimilation Ross Bannister High Resolution Atmospheric.
Introduction to Data Assimilation NCEO Data-assimilation training days 5-7 July 2010 Peter Jan van Leeuwen Data Assimilation Research Center (DARC) University.
ECMWF flow dependent workshop, June Slide 1 of 14. A regime-dependent balanced control variable based on potential vorticity Ross Bannister, Data.
Page 1 of 26 A PV control variable Ross Bannister* Mike Cullen *Data Assimilation Research Centre, Univ. Reading, UK Met Office, Exeter, UK.
Introduction to Data Assimilation Peter Jan van Leeuwen IMAU.
The Inverse Regional Ocean Modeling System:
Status and performance of HIRLAM 4D-Var Nils Gustafsson.
© Crown copyright Met Office Does the order of the horizontal and vertical transforms matter in the representation of an operational static covariance.
Incorporation of dynamic balance in data assimilation and application to coastal ocean Zhijin Li and Kayo Ide SAMSI, Oct. 5, 2005,
Background and Observation Errors:
Polly Smith, Alison Fowler, Amos Lawless School of Mathematical and Physical Sciences, University of Reading Exploring coupled data assimilation using.
30 th September 2010 Bannister & Migliorini Slide 1 of 9 High-resolution assimilation and weather forecasting Ross Bannister and Stefano Migliorini (NCEO,
Balance in the EnKF Jeffrey D. Kepert Centre for Australian Weather and Climate Research A partnership between the Australian Bureau of Meteorology and.
Using global models and chemical observations to diagnose eddy diffusion.
ECMWF CO 2 Data Assimilation at ECMWF Richard Engelen European Centre for Medium-Range Weather Forecasts Reading, United Kingdom Many thanks to Phil Watts,
Data assimilation of trace gases in a regional chemical transport model: the impact on model forecasts E. Emili 1, O. Pannekoucke 1,2, E. Jaumouillé 2,
Data assimilation schemes in numerical weather forecasting and their link with ensemble forecasting Gérald Desroziers Météo-France, Toulouse, France.
How to move the gravity-wave parameterization problem forward? Some thoughts Ted Shepherd Department of Physics University of Toronto NCAR TIIMES Gravity-Wave.
Consideration of Dynamical Balances Ronald M. Errico Global Modeling and Assimilation Office, NASA Goddard Earth Sciences and Technology Center, UMBC A.
Advanced data assimilation methods with evolving forecast error covariance Four-dimensional variational analysis (4D-Var) Shu-Chih Yang (with EK)
WWRP/THORPEX WORKSHOP on 4D-VAR and ENSEMBLE KALMAN FILTER INTER-COMPARISONS BUENOS AIRES - ARGENTINA, NOVEMBER 2008 Topics for Discussion in Session.
To understand the differing localization strength, consider two grid points, observation at grid point 1. K for grid point 2: (d 12 = distance between.
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
1 NGGPS Dynamic Core Requirements Workshop NCEP Future Global Model Requirements and Discussion Mark Iredell, Global Modeling and EMC August 4, 2014.
Two Methods of Localization  Model Covariance Matrix Localization (B Localization)  Accomplished by taking a Schur product between the model covariance.
Exploring strategies for coupled 4D-Var data assimilation using an idealised atmosphere-ocean model Polly Smith, Alison Fowler & Amos Lawless School of.
Numerical Weather Prediction Division The usage of the ATOVS data in the Korea Meteorological Administration (KMA) Sang-Won Joo Korea Meteorological Administration.
COST workshop, 12th March Assimilation of stratospheric ozone and water vapour at DARC Alan Geer, Carole Peubey, Ross Bannister, Roger Brugge, William.
Introduction to Data Assimilation: Lecture 2
The Inverse Regional Ocean Modeling System: Development and Application to Data Assimilation of Coastal Mesoscale Eddies. Di Lorenzo, E., Moore, A., H.
ECMWF Slide 1 ECMWF Data Assimilation Training Course - Background Error Covariance Modelling Mike Fisher.
Computing a posteriori covariance in variational DA I.Gejadze, F.-X. Le Dimet, V.Shutyaev.
Lars Isaksen, ECMWF, March 2006 Data assimilation and use of satellite data1 Control of Gravity Waves Gravity waves and divergent flow in the atmosphere.
Combining measurements and models in atmospheric physics U Toronto Physics Colloquium, 10 Jan Saroja Polavarapu Data Assimilation and Satellite Meteorology.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
« Data assimilation in isentropic coordinates » Which Accuracy can be achieved using an high resolution transport model ? F. FIERLI (1,2), A. HAUCHECORNE.
Ocean Data Variational Assimilation with OPA: Ongoing developments with OPAVAR and implementation plan for NEMOVAR Sophie RICCI, Anthony Weaver, Nicolas.
Tbilisi, GGSWBS'14 Optimization for inverse modelling Ketevan Kasradze 1 Hendrik Elbern 1,2
The General Data Assimilation Problem Ronald Errico Goddard Earth Sciences Technology and Research Center at Morgan State University and Global Modeling.
Data Assimilation Working Group Dylan Jones (U. Toronto) Kevin Bowman (JPL) Daven Henze (CU Boulder) 1 IGC7 4 May 2015.
Data Assimilation Using Modulated Ensembles Craig H. Bishop, Daniel Hodyss Naval Research Laboratory Monterey, CA, USA September 14, 2009 Data Assimilation.
HIRLAM 3/4D-Var developments Nils Gustafsson, SMHI.
The I nverse R egional O cean M odeling S ystem Development and Application to Variational Data Assimilation of Coastal Mesoscale Eddies. Di Lorenzo, E.
Research Vignette: The TransCom3 Time-Dependent Global CO 2 Flux Inversion … and More David F. Baker NCAR 12 July 2007 David F. Baker NCAR 12 July 2007.
11 Background Error Daryl T. Kleist* National Monsoon Mission Scoping Workshop IITM, Pune, India April 2011.
Data assimilation, short-term forecast, and forecasting error
Dynamics and Data Assimilation
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
Covariance Modeling “Where America’s Climate, Weather, Ocean and Space Weather Services Begin” JCSDA Summer Colloquium July 27, 2015 Presented by John.
Deutscher Wetterdienst Vertical localization issues in LETKF Breogan Gomez, Andreas Rhodin, Hendrik Reich.
Errors, Uncertainties in Data Assimilation François-Xavier LE DIMET Université Joseph Fourier+INRIA Projet IDOPT, Grenoble, France.
Page 1© Crown copyright 2004 SRNWP Lead Centre Report on Data Assimilation 2005 for EWGLAM/SRNWP Annual Meeting October 2005, Ljubljana, Slovenia.
BE, gen_be and Single ob experiments Syed RH Rizvi National Center For Atmospheric Research NCAR/MMM, Boulder, CO-80307, USA Syed.
Use ensemble error covariance information in GRAPES 3DVAR Jiandong GONG, Ruichun WANG NWP center of CMA Oct 27, 2015.
Hou/JTST NASA GEOS-3/TRMM Re-Analysis: Capturing Observed Rainfall Variability in Global Analysis Arthur Hou NASA Goddard Space Flight Center 2.
10-11 October 2006HYMN kick-off TM3/4/5 Modeling at KNMI HYMN Hydrogen, Methane and Nitrous oxide: Trend variability, budgets and interactions with the.
Forecasts & their Errors Ross Bannister 7th October / 23 PDFsAssimilationMeasuringModellingRefiningChallenges Forecasts & their Errrors Ross Bannister.
Implementation and Testing of 3DEnVAR and 4DEnVAR Algorithms within the ARPS Data Assimilation Framework Chengsi Liu, Ming Xue, and Rong Kong Center for.
The I nverse R egional O cean M odeling S ystem Development and Application to Variational Data Assimilation of Coastal Mesoscale Eddies. Di Lorenzo, E.
Governing Equations II
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course Mar 2016.
Class Meeting Nov. 26, 2:00pm-4:45pm
Gleb Panteleev (IARC) Max Yaremchuk, (NRL), Dmitri Nechaev (USM)
Weak constraint 4D-Var at ECMWF
The ECMWF weak constraint 4D-Var formulation
FSOI adapted for used with 4D-EnVar
Sarah Dance DARC/University of Reading
Presentation transcript:

Balance and 4D-Var Saroja Polavarapu Meteorological Research Division Environment Canada, Toronto WWRP-THORPEX Workshop on 4D-Var and EnsKF intercomparisons Nov , 2008, Buenos Aires, Argentina

Topics Combining analysis and initialization steps Choosing a control variable Impacts of imbalance –Filtering of GWs in troposphere impacts mesopause temperatures and tides –Noisy wind analyses impact tracer transport

Combining Analysis and Initialization steps Doing an analysis brings you close to the data. Doing an initialization moves you farther from the data. Daley (1986) N Gravity modes Rossby modes N Subspace of reduced dimension

Variational Normal Mode Initialization Daley (1978), Tribbia (1982), Fillion and Temperton (1989), etc. Daley (1986) 1.NNMI from A to 1 2.Minimize distance to A holding G fixed (1 to 2) 3.NNMI from 2 to 3 4.Minimize distance to A holding G fixed (3 to C’)

4D-Var with strong constraints Minimize J(x 0 ) subject to the constraints: Necessary and sufficient conditions for x 0 to be a minimum are: Gill, Murray, Wright (1981) Projection onto constraint tangent Hessian of constraints

4D-Var with weak constraints Penalty Methods: Minimize Small  Large 

4D-Var with NNMI constraints …owing to the iterative and approximate character of the initialization algorithm, the condition || dG/dt || = 0 cannot in practice be enforced as an exact constraint. Courtier and Talagrand (1990) Weak constraint Courtier and Talagrand (1990) Strong constraint A’

Fillion et al. (1995) N=12,  t=30 min T c =8 h T c =6 h Digital Filter Initialization Lynch and Huang (1992)

4D-Var with DFI constraints Because filter is not perfect, some inversion of intermediate scale noise occurs, but DFI as a strong constraint suppresses small scale noise. (Polavarapu et al. 2000) Introduced by Gustafsson (1993) Weak constraint can control small scale noise (Polavarapu et al. 2000) Implemented operationally at Météo-France (Gauthier and Thépaut 2001) Weak Constraint Strong Constraint

Recent approaches Early work on incorporating balance constraints in 4D- Var used a balance on the full state Since Courtier et al. (1994), most groups use an incremental approach so balance should be applied to analysis increments Even without penalty terms, background error covariances can be used to create balanced increments. So what is the best choice of analysis variables ?

Choice of control variable If obs and representativeness errors are spatially uncorrelated, R is diagonal so R -1 is easy To avoid inverse computation of full matrix, B, use a change of control variable, L  =( x 0 - x b ) for B =LL T. Then J(  )= ½    + J obs. –Note L is not stored as a matrix but a sequence of operations –If no obs, this is a perfect preconditioner since Hessian = I L can include a change of variable. Is there a natural, physical choice for control variable?

Choice of control variable - 2 Balanced and unbalanced variables are uncorrelated (Daley 1991) Consider change of control variable, x =K x u Then B =K B u K T. Background error covariances are defined in terms of uncorrelated variables. Original 3D-Var implementation of Parrish and Derber (1992) used geostrophic departure and divergence (both unbalanced) and vorticity (balanced) (  u, D u,  )

NNMI and balance constraints Leith (1980) f-plane, Boussinesq (small vert scales) Order012 Mass-windGeostrophyNonlinear balance Divergence or vert velocity Non DivergenceQG omega eq. Gravity modes Rotational modes Nondivergent geostrophic PV constrained, Nonlinear balance, QG omega eq. Parrish and Derber (1992) use div, geostr imbalance as control variables Fisher (2003) uses departure from nonlinear balance, QG omega eq. for control variables Fillion et al. (2007), Kleist et al. (2008) use INMI as strong constraint on increments Physical space Normal mode approach Parrish (1988), Heckley et al. (1992) use normal mode amp. as control variables

 T 228 hPa  D 228 hPa Nonlinear balanced variables require linearization around background state and introduce flow dependence of increments Nonlinear balance Statistical balance Impact expected where curvature of background flow is high or in dynamically active regions Fisher (2003, ECMWF) Analysis increments from single  obs at 300 hPa with 4D-Var grey  250

The balanced control variable Bannister et al. (2008), Bannister and Cullen (2007)… 1. Balanced state preserves streamfunction.  b  L<<L R (tropics, small hor scales, large vert scales ) ECMWF, NCEP, Met Office, Meteo-France, CMC, HIRLAM… 2. Balanced state preserves mass field. L>> L R (large hor scales, small vert scales) 3. Balanced state preserves potential vorticity. Accommodates different dynamical regimes Allows for unbalanced vorticity as in Normal mode approach Control variables only weakly correlated Requires solving two elliptical eq simultaneously for  b,  P b May be practical but more work is needed (Cullen 2002)

PV based control variables  b, , h u ) Correlation between balanced wind and unbalanced height errors for 1D shallow water equations PV dominated by vorticityPV dominated by mass Bannister et al. (2008)

Insufficient filtering of spurious waves can lead to global temperature bias More waves  more damping  more heating Sankey et al. (2007) Global mean T profiles at SABER locations on Jan. 25, 2002 No obs obs sponge

Sankey et al. (2007) Filtering scheme can enhance or wipe out the diurnal tide

Implications for tracer transport Assimilated winds are often used to drive chemistry- transport models If the transport is well represented, then modeled species can be compared with observations to assess photochemical processes “…current DAS products will not give realistic trace gas distributions for long integrations” – Schoeberl et al. (2003) Vertical motion is noisy, horizontal motion is noisy in tropics. Leads to too rapid tracer transport (Weaver et al. 1993, Douglas et al. 2003, Schoeberl et al. 2003, …)

Stratospheric Age of air Measurements: –Use long-lived tracers with linear trends e.g. SF 6 or annual mean CO 2. Ozone from OSIRIS for March 2004 Shaw and Shepherd (2008)

Douglass et al. (2003) Assimilated winds produce much younger ages than GCM winds when used to drive CTMs Note the weak latitudinal gradients

The End

NNMI and balance constraints Leith (1980) f-plane, Boussinesq (small vert scales) Order012 Mass-windGeostrophyNonlinear balance Divergence or vert velocity Non DivergenceQG omega eq. Gravity modes Rotational modes Nondivergent geostrophic PV constrained, Nonlinear balance, QG omega eq. Physical space Normal mode approach

NNMI and balance constraints Leith (1980) f-plane, Boussinesq (small vert scales) Order012 Mass-windGeostrophyNonlinear balance Divergence or vert velocity Non DivergenceQG omega eq. Gravity modes Rotational modes Nondivergent geostrophic PV constrained, Nonlinear balance, QG omega eq. Parrish and Derber (1992) use div, geostr imbalance as control variables Physical space Normal mode approach

NNMI and balance constraints Leith (1980) f-plane, Boussinesq (small vert scales) Order012 Mass-windGeostrophyNonlinear balance Divergence or vert velocity Non DivergenceQG omega eq. Gravity modes Rotational modes Nondivergent geostrophic PV constrained, Nonlinear balance, QG omega eq. Parrish and Derber (1992) use div, geostr imbalance as control variables Physical space Normal mode approach Parrish (1988), Heckley et al. (1992) use normal mode amp. as control variables

NNMI and balance constraints Leith (1980) f-plane, Boussinesq (small vert scales) Order012 Mass-windGeostrophyNonlinear balance Divergence or vert velocity Non DivergenceQG omega eq. Gravity modes Rotational modes Nondivergent geostrophic PV constrained, Nonlinear balance, QG omega eq. Parrish and Derber (1992) use div, geostr imbalance as control variables Fisher (2003) uses departure from nonlinear balance, QG omega eq. for control variables Physical space Normal mode approach Parrish (1988), Heckley et al. (1992) use normal mode amp. as control variables