The Importance of Atmospheric Variability for Data Requirements, Data Assimilation, Forecast Errors, OSSEs and Verification Rod Frehlich and Robert Sharman.

Slides:



Advertisements
Similar presentations
Variational data assimilation and forecast error statistics
Advertisements

Introduction to data assimilation in meteorology Pierre Brousseau, Ludovic Auger ATMO 08,Alghero, september 2008.
Lwando Kondlo Supervisor: Prof. Chris Koen University of the Western Cape 12/3/2008 SKA SA Postgraduate Bursary Conference Estimation of the parameters.
Outline input analysis input analyzer of ARENA parameter estimation
1 High resolution SST products for 2001 Satellite SST products and coverage In situ observations, coverage Quality control procedures Satellite error statistics.
3.11 Adaptive Data Assimilation to Include Spatially Variable Observation Error Statistics Rod Frehlich University of Colorado, Boulder and RAL/NCAR Funded.
Design and Validation of Observing System Simulation Experiments (OSSEs) Ronald Errico Goddard Earth Sciences Technology and Research Center at Morgan.
Empirical Localization of Observation Impact in Ensemble Filters Jeff Anderson IMAGe/DAReS Thanks to Lili Lei, Tim Hoar, Kevin Raeder, Nancy Collins, Glen.
Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft NDACC H2O workshop, Bern, July 2006 Water vapour profiles by ground-based FTIR Spectroscopy:
Statistics, data, and deterministic models NRCSE.
Brian Ancell, Cliff Mass, Gregory J. Hakim University of Washington
Validation and intercomparation discussion Items Size of assimilation ensembles. Is it to be determined only by numerical stability of algorithms? (O.
UNBIASED ESTIAMTION OF ANALYSIS AND FORECAST ERROR VARIANCES
Filtering of variances and correlations by local spatial averaging Loïk Berre Météo-France.
A comparison of hybrid ensemble transform Kalman filter(ETKF)-3DVAR and ensemble square root filter (EnSRF) analysis schemes Xuguang Wang NOAA/ESRL/PSD,
Chapter 13 – Weather Analysis and Forecasting. The National Weather Service The National Weather Service (NWS) is responsible for forecasts several times.
Standard error of estimate & Confidence interval.
“1995 Sunrise Fire – Long Island” Using an Ensemble Kalman Filter to Explore Model Performance on Northeast U.S. Fire Weather Days Michael Erickson and.
Statistical Methods For Engineers ChE 477 (UO Lab) Larry Baxter & Stan Harding Brigham Young University.
How to use CFD (RANS or LES) models for urban parameterizations – and the problem of averages Alberto Martilli CIEMAT Madrid, Spain Martilli, Exeter, 3-4.
Oceanography 569 Oceanographic Data Analysis Laboratory Kathie Kelly Applied Physics Laboratory 515 Ben Hall IR Bldg class web site: faculty.washington.edu/kellyapl/classes/ocean569_.
Lidar Working Group on Space-Based Winds, Snowmass, Colorado, July 17-21, 2007 A study of range resolution effects on accuracy and precision of velocity.
Stephan F.J. De Wekker S. Aulenbach, B. Sacks, D. Schimel, B. Stephens, National Center for Atmospheric Research, Boulder CO; T. Vukicevic,
V Gorin and M Tsyrulnikov Can model error be perceived from routine observations?
June, 2003EUMETSAT GRAS SAF 2nd User Workshop. 2 The EPS/METOP Satellite.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
Potential benefits from data assimilation of carbon observations for modellers and observers - prerequisites and current state J. Segschneider, Max-Planck-Institute.
Overview of Techniques for Deriving Emission Inventories from Satellite Observations Frascati, November 2009 Bas Mijling Ronald van der A.
Vaisala/University of Washington Real-observation Experiments Vaisala/University of Washington Real-observation Experiments Clifford Mass, Gregory Hakim,
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
2004 SIAM Annual Meeting Minisymposium on Data Assimilation and Predictability for Atmospheric and Oceanographic Modeling July 15, 2004, Portland, Oregon.
Accounting for Uncertainties in NWPs using the Ensemble Approach for Inputs to ATD Models Dave Stauffer The Pennsylvania State University Office of the.
Cooperative Research Programs (CoRP) Satellite Climate Studies Branch (SCSB) 1 1 Reconstruction of Near-Global Precipitation Variations Thomas Smith 1.
Update on Hybrid Detection DWL Study* G. D. Emmitt WG on Space-based Lidar Winds Oxnard, CA 7-9 February, 2001 *funded by the IPO.
Global Observing System Simulation Experiments (Global OSSEs) How It Works Nature Run 13-month uninterrupted forecast produces alternative atmosphere.
Development of an EnKF to estimate CO 2 fluxes from realistic distributions of X CO2 Liang Feng, Paul Palmer
11 Background Error Daryl T. Kleist* National Monsoon Mission Scoping Workshop IITM, Pune, India April 2011.
Rod Frehlich University of Colorado, Boulder, CO RAL/NCAR, Boulder, CO
Data assimilation, short-term forecast, and forecasting error
2nd GODAE Observing System Evaluation Workshop - June Ocean state estimates from the observations Contributions and complementarities of Argo,
Retrieval of Ozone Profiles from GOME (and SCIAMACHY, and OMI, and GOME2 ) Roeland van Oss Ronald van der A and Johan de Haan, Robert Voors, Robert Spurr.
Session 3, Unit 5 Dispersion Modeling. The Box Model Description and assumption Box model For line source with line strength of Q L Example.
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
6/29/2010 Wan-Shu Wu1 GSI Tutorial 2010 Background and Observation Error Estimation and Tuning.
The Application of Observation Adjoint Sensitivity to Satellite Assimilation Problems Nancy L. Baker Naval Research Laboratory Monterey, CA.
Local Predictability of the Performance of an Ensemble Forecast System Liz Satterfield and Istvan Szunyogh Texas A&M University, College Station, TX Third.
LWG, Destin (Fl) 27/1/2009 Observation representativeness error ECMWF model spectra Application to ADM sampling mode and Joint-OSSE.
Ocean Surface Current Observations in PWS Carter Ohlmann Institute for Computational Earth System Science, University of California, Santa Barbara, CA.
ICDC7, Boulder September 2005 Estimation of atmospheric CO 2 from AIRS infrared satellite radiances in the ECMWF data assimilation system Richard.
The Orbiting Carbon Observatory (OCO) Mission: Retrieval Characterisation and Error Analysis H. Bösch 1, B. Connor 2, B. Sen 1, G. C. Toon 1 1 Jet Propulsion.
The application of ensemble Kalman filter in adaptive observation and information content estimation studies Junjie Liu and Eugenia Kalnay July 13th, 2007.
Demonstration and Comparison of Sequential Approaches for Altimeter Data Assimilation in HYCOM A. Srinivasan, E. P. Chassignet, O. M. Smedstad, C. Thacker,
Lec. 19 – Hypothesis Testing: The Null and Types of Error.
Computacion Inteligente Least-Square Methods for System Identification.
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
Early VALIDAR Case Study Results Rod Frehlich: RAL/NCAR Grady Koch: NASA Langley.
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course Mar 2016.
Carbon Cycle Data Assimilation with a Variational Approach (“4-D Var”) David Baker CGD/TSS with Scott Doney, Dave Schimel, Britt Stephens, and Roger Dargaville.
Regression Analysis Part D Model Building
Aircraft weather observations: Impacts for regional NWP models
New developments in the Graphical Turbulence Guidance (GTG) product
Statistical Methods For Engineers
OSSEs for Pacific Predictability Josh Hacker, NCAR
FSOI adapted for used with 4D-EnVar
Initialization of Numerical Forecast Models with Satellite data
Error statistics in data assimilation
Statistical tests for replicated experiments
Data Assimilation Initiative, NCAR
Forecast system development activities
Status of the Regional OSSE for Space-Based LIDAR Winds – Feb01
Presentation transcript:

The Importance of Atmospheric Variability for Data Requirements, Data Assimilation, Forecast Errors, OSSEs and Verification Rod Frehlich and Robert Sharman University of Colorado, Boulder RAP/NCAR Boulder Funded by NSF (Lydia Gates) and FAA/AWRP

In Situ Aircraft Data Highest resolution data Many flights provide robust statistical description (GASP, MOZAIC) Reference for “truth”

Spatial Spectra Robust description in troposphere Power law scaling Valid almost everywhere

Structure Functions Alternate spatial statistic Interpretation is simple (no aliasing) Also has power law scaling Structure functions (and spectra) from model output are filtered Corrections possible by comparisons with in situ data Produce local estimates of turbulence defined by ε or C T 2 over LxL domain

RUC20 Analysis RUC20 model structure function In situ “truth” from GASP data Effective spatial filter (3Δ) determined by agreement with theory

UKMO 0.5 o Global Model Effective spatial filter (5Δ) larger than RUC The s 2 scaling implies only linear spatial variations of the field

DEFINITION OF TRUTH For forecast error, truth is defined by the spatial filter of the model numerics For the initial field (analysis) truth should have the same definition for consistency Measurement error What are optimal numerics?

Observation Sampling Error Truth is the average of the variable x over the LxL effective grid cell Total observation error Instrument error =  x Sampling error =  x The instrument sampling pattern and turbulence determines the sampling error

Sampling Error for Velocity and Temperature Rawinsonde in center of square effective grid cell of length L

UKMO Global Model Rawinsonde in center of grid cell Large variations in sampling error Dominant component of total observation error in high turbulence regions Very accurate observations in low turbulence regions

Optimal Data Assimilation Optimal assimilation requires estimation of total observation error covariance Requires calculation of instrument error which may depend on local turbulence (profiler, coherent Doppler lidar) Requires climatology of turbulence Correct calculation of analysis error

Adaptive Data Assimilation Assume locally homogeneous turbulence around analysis point r forecast observations

Optimal Analysis Error Analysis error depends on forecast error and effective observation error forecast error effective observation error (local turbulence)

Analysis Error for 0.5 o Global Model Instrument error is 0.5 m/s Large reduction in analysis error for  b =3 m/s

Implications for OSSE’s Synthetic data requires local estimates of turbulence and climatology Optimal data assimilation using local estimates of turbulence Improved background error covariance based on improved analysis Resolve fundamental issues of observation error statistics (coverage vs accuracy) Determine effects of sampling error (rawinsonde vs lidar)

Implications for NWP Models Include realistic variations in observation error in initial conditions of ensemble forecasts Determine contribution of forecast error from sampling error Include climatology of sampling error in performance metrics

Future Work Determine global climatology and universal scaling of small scale turbulence Calculate total observation error for critical data (rawinsonde, ACARS, profiler, lidar) Determine optimal model numerics Determine optimal data assimilation, OSSE’s, model parameterization, and ensemble forecasts Coordinate all the tasks since they are iterative

Estimates of Small Scale Turbulence Calculate structure functions locally over LxL square Determine best-fit to empirical model Estimate in situ turbulence level and ε ε 1/3

Climatology of Small Scale Turbulence Probability Density Function (PDF) of ε Good fit to the Log Normal model Parameters of Log Normal model depends on domain size L Consistent with large Reynolds number turbulence

Scaling Laws for Log Normal Parameters Power law scaling for the mean and standard deviation of log ε Consistent with high Reynolds number turbulence