GSI Hybrid EnKF-3DVAR Upgrade Components –GPS RO bending angle rather than refractivity –Inclusion of compressibility factors for atmosphere –Retune SBUV.

Slides:



Advertisements
Similar presentations
Assimilation of T-TREC-retrieved wind data with WRF 3DVAR for the short-Term forecasting of Typhoon Meranti (2010) at landfall Xin Li 1, Yuan Wang 1, Jie.
Advertisements

Numerical Weather Prediction Readiness for NPP And JPSS Data Assimilation Experiments for CrIS and ATMS Kevin Garrett 1, Sid Boukabara 2, James Jung 3,
Xuguang Wang, Xu Lu, Yongzuo Li, Ting Lei
© The Aerospace Corporation 2014 Observation Impact on WRF Model Forecast Accuracy over Southwest Asia Michael D. McAtee Environmental Satellite Systems.
Background and Observation Errors:
Data Assimilation Andrew Collard. Overview Introduction to Atmospheric Data Assimilation Control Variables Observations Background Error Covariance Summary.
Hybrid variational-ensemble data assimilation for the NCEP GFS Tom Hamill, for Jeff Whitaker NOAA Earth System Research Lab, Boulder, CO, USA
1 Hybrid variational-ensemble data assimilation (HVEDAS) High Impact Weather Working Group Workshop 24 February, 2011 – Norman, OK Daryl T. Kleist 1,3.
Ensemble-4DVAR for NCEP hybrid GSI- EnKF data assimilation system 1 5 th EnKF workshop, New York, May 22, 2012 Xuguang Wang, Ting Lei University of Oklahoma,
Improving High Resolution Tropical Cyclone Prediction Using a Unified GSI-based Hybrid Ensemble-Variational Data Assimilation System for HWRF Xuguang Wang.
Implementation plans of Hybrid 4D EnVar for the NCEP GFS
Convection-permitting forecasts initialized with continuously-cycling limited-area 3DVAR, EnKF and “hybrid” data assimilation systems Craig Schwartz and.
1/20 Accelerating minimizations in ensemble variational assimilation G. Desroziers, L. Berre Météo-France/CNRS (CNRM/GAME)
Initializing a Hurricane Vortex with an EnKF Yongsheng Chen Chris Snyder MMM / NCAR.
Brian Ancell, Cliff Mass, Gregory J. Hakim University of Washington
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
Progress in Cloudy Microwave Satellite Data Assimilation at NCEP Andrew Collard 1, Emily Liu 4, Yanqiu Zhu 1, John Derber 2, Daryl Kleist 3, Rahul Mahajan.
Background and Status of Q1FY16 Global Implementation
1 NGGPS Dynamic Core Requirements Workshop NCEP Future Global Model Requirements and Discussion Mark Iredell, Global Modeling and EMC August 4, 2014.
Presented by: Mark Iredell based on work done by Global Climate and Weather Modeling Branch 2014 NCEP Production Suite Review GLOBAL MODELING 1.
Current Status of the Development of the Local Ensemble Transform Kalman Filter at UMD Istvan Szunyogh representing the UMD “Chaos-Weather” Group Ensemble.
Slide 1 Evaluation of observation impact and observation error covariance retuning Cristina Lupu, Carla Cardinali, Tony McNally ECMWF, Reading, UK WWOSC.
Numerical Weather Prediction Division The usage of the ATOVS data in the Korea Meteorological Administration (KMA) Sang-Won Joo Korea Meteorological Administration.
Comparison of hybrid ensemble/4D- Var and 4D-Var within the NAVDAS- AR data assimilation framework The 6th EnKF Workshop May 18th-22nd1 Presenter: David.
UKmet February Hybrid Ensemble-Variational Data Assimilation Development A partnership to develop and implement a hybrid 3D-VAR system –Joint venture.
Operational Global Model Plans John Derber. Timeline July 25, 2013: Completion of phase 1 WCOSS transition August 20, 2013: GDAS/GFS model/analysis upgrade.
Introduction to Data Assimilation: Lecture 2
MIIDAPS Status – 13 th JCSDA Technical Review and Science Workshop, College Park, MD Quality Control-Consistent algorithm for all sensors to determine.
An OSSE-based evaluation of 4D-Ensemble- Var (and hybrid variants) for the NCEP GFS Daryl Kleist 1,2 and Kayo Ide 2 1 CMOS 2012 Congress AMS 21 st NWP.
Different options for the assimilation of GPS Radio Occultation data within GSI Lidia Cucurull NOAA/NWS/NCEP/EMC GSI workshop, Boulder CO, 28 June 2011.
1 NCEP data assimilation systems status and plans John C. Derber Environmental Modeling Center NCEP/NWS/NOAA With input from: Many others.
GSI-based Hybrid Data Assimilation:
MPO 674 Lecture 20 3/26/15. 3d-Var vs 4d-Var.
Data assimilation and observing systems strategies Pierre Gauthier Data Assimilation and Satellite Meteorology Division Meteorological Service of Canada.
Hybrid Variational/Ensemble Data Assimilation for the NCEP GFS Tom Hamill, for Jeff Whitaker NOAA Earth System Research Lab, Boulder, CO, USA
Development of an EnKF/Hybrid Data Assimilation System for Mesoscale Application with the Rapid Refresh Ming Hu 1,2, Yujie Pan 3, Kefeng Zhu 3, Xuguang.
Hybrid Variational/Ensemble Data Assimilation
11 th JCSDA Science Workshop on Satellite Data Assimilation Latest Developments on the Assimilation of Cloud-Affected Satellite Observations Tom Auligné.
14 th Annual WRF Users’ Workshop. June 24-28, 2013 Improved Initialization and Prediction of Clouds with Satellite Observations Tom Auligné Gael Descombes,
Research and development on satellite data assimilation at the Canadian Meteorological Center L. Garand, S. K. Dutta, S. Heilliette, M. Buehner, and S.
11 Background Error Daryl T. Kleist* National Monsoon Mission Scoping Workshop IITM, Pune, India April 2011.
1 EMC’s Current and future GSI development John C. Derber Environmental Modeling Center NCEP/NWS/NOAA With input from: Many others.
Data assimilation, short-term forecast, and forecasting error
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
6/29/2010 Wan-Shu Wu1 GSI Tutorial 2010 Background and Observation Error Estimation and Tuning.
Covariance Modeling “Where America’s Climate, Weather, Ocean and Space Weather Services Begin” JCSDA Summer Colloquium July 27, 2015 Presented by John.
Retrieval of Moisture from GPS Slant-path Water Vapor Observations using 3DVAR and its Impact on the Prediction of Convective Initiation and Precipitation.
AIRS Radiance and Geophysical Products: Methodology and Validation Mitch Goldberg, Larry McMillin NOAA/NESDIS Walter Wolf, Lihang Zhou, Yanni Qu and M.
Application of COSMIC refractivity in Improving Tropical Analyses and Forecasts H. Liu, J. Anderson, B. Kuo, C. Snyder, and Y. Chen NCAR IMAGe/COSMIC/MMM.
Local Predictability of the Performance of an Ensemble Forecast System Liz Satterfield and Istvan Szunyogh Texas A&M University, College Station, TX Third.
Use ensemble error covariance information in GRAPES 3DVAR Jiandong GONG, Ruichun WANG NWP center of CMA Oct 27, 2015.
Statistical Post Processing - Using Reforecast to Improve GEFS Forecast Yuejian Zhu Hong Guan and Bo Cui ECM/NCEP/NWS Dec. 3 rd 2013 Acknowledgements:
July, 2009 WRF-Var Tutorial Syed RH Rizvi 0 WRFDA Background Error Estimation Syed RH Rizvi National Center For Atmospheric Research NCAR/ESSL/MMM, Boulder,
Implementation and Testing of 3DEnVAR and 4DEnVAR Algorithms within the ARPS Data Assimilation Framework Chengsi Liu, Ming Xue, and Rong Kong Center for.
The Infrastructure, Design and Applications of Observing System Simulation Experiments at NASA's Global Modeling and Assimilation Office By Ronald M. Errico.
DRAFT – Page 1 – January 14, 2016 Development of a Convective Scale Ensemble Kalman Filter at Environment Canada Luc Fillion 1, Kao-Shen Chung 1, Monique.
Preliminary results from assimilation of GPS radio occultation data in WRF using an ensemble filter H. Liu, J. Anderson, B. Kuo, C. Snyder, A. Caya IMAGe.
MIIDAPS Application to GSI for QC and Dynamic Emissivity in Passive Microwave Data Assimilation.
Cloudy GOES-Imager assimilation with hydrometeor control variable Byoung-Joo JUNG NCAR/MMM Student presentation at JCSDA Summer Colloquium on Satellite.
University of Oklahoma, Norman, OK
Current modification gridinfo.f90Add new subroutine: getgridinfo_reg --- calculate the pressure in each sigma level and the virture temperature gridio.f90Add.
Page 1 Developments in regional DA Oct 2007 © Crown copyright 2007 Mark Naylor, Bruce Macpherson, Richard Renshaw, Gareth Dow Data Assimilation and Ensembles,
Assimilation of GPM satellite radiance in improving hurricane forecasting Zhaoxia Pu and ChauLam (Chris) Yu Department of Atmospheric Sciences University.
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course Mar 2016.
Indirect impact of ozone assimilation using Gridpoint Statistical Interpolation (GSI) data assimilation system for regional applications Kathryn Newman1,2,
Hybrid Data Assimilation
Impact of Traditional and Non-traditional Observation Sources using the Grid-point Statistical Interpolation Data Assimilation System for Regional Applications.
FSOI adapted for used with 4D-EnVar
Comparison of different combinations of ensemble-based and variational data assimilation approaches for deterministic NWP Mark Buehner Data Assimilation.
Presentation transcript:

GSI Hybrid EnKF-3DVAR Upgrade Components –GPS RO bending angle rather than refractivity –Inclusion of compressibility factors for atmosphere –Retune SBUV ob errors – fix bug at top –Update radiance usage flags –Prepare for monitoring NPP and Metop-B (Use of data?) –Add GOES-13 data –Add Severi CSBT radiance product –Satellite monitoring stats code included in Ops. –New Sat wind data and QC –EnKF hybrid system –Update to current version of trunk –New version of Forecast model Restructured to include options for Semi-Lagrangian & NSST Model Updated postprocessor CAPE, CIN, & Lifted Index calculated from virtual temperature Ability to output GRIB2 directly Ability to read GFS spectral coefficient file which will be exercised during this implementation to save post run time 4 new variables for Fire Wx, 8 for Wind Energy, 3 for severe weather Switch to use CRTM lib and coefficient files

2 Motivation from Var Current background error covariance (applied operationally) in VAR –Isotropic recursive filters –Poor handle on cross-variable covariance –Minimal flow-dependence added Implicit flow-dependence through linearization in normal mode constraint (Kleist et al. 2009) Flow-dependent variances (only for wind, temperature, and pressure) based on background tendencies –Tuned NMC-based estimate (lagged forecast pairs)

3 EnKF/3DVar hybrid J : Penalty (Fit to background + Fit to observations + Constraints) x’ : Analysis increment (x a – x b ) ; where x b is a background B Var : Background error covariance H : Observations (forward) operator R : Observation error covariance (Instrument + representativeness) y o ’ : Observation innovations J c : Constraints (physical quantities, balance/noise, etc.) B is typically static and estimated a-priori/offline

4 Current background error for GFS Although flow-dependent variances are used, confined to be a rescaling of fixed estimate based on time tendencies –No multivariate or length scale information used –Does not necessarily capture ‘errors of the day’ Plots valid 00 UTC 12 September 2008

5 Why Hybrid? VAR (3D, 4D) EnKFHybridReferences Benefit from use of flow dependent ensemble covariance instead of static B xx Hamill and Snyder 2000; Wang et al. 2007b,2008ab, 2009b, Wang 2011; Buehner et al. 2010ab Robust for small ensemble x Wang et al. 2007b, 2009b; Buehner et al. 2010b Better localization for integrated measure, e.g. satellite radiance x Campbell et al Easy framework to add various constraints xx Framework to treat non- Gaussianity xx Use of various existing capabilities in VAR xx

6 Hybrid Variational-Ensemble Incorporate ensemble perturbations directly into variational cost function through extended control variable –Lorenc (2003), Buehner (2005), Wang et. al. (2007), etc.  f &  e : weighting coefficients for fixed and ensemble covariance respectively x t : (total increment) sum of increment from fixed/static B (x f ) and ensemble B  k : extended control variable; :ensemble perturbation L: correlation matrix [localization on ensemble perturbations]

7 Hybrid with (global) GSI Control variable has been implemented into GSI 3DVAR* –Full B preconditioning Working on extensions to B 1/2 preconditioned minimization options –Spectral filter for horizontal part of A Eventually replace with (anisotropic) recursive filters –Recursive filter used for vertical –Dual resolution capability Ensemble can be from different resolution than background/analysis (vertical levels are the exception) –Various localization options for A Grid units or scale height Level dependent (plans to expand) –Option to apply TLNMC (Kleist et al. 2009) to analysis increment *Acknowledgement: Dave Parrish for original implementation of extended control variable

8 Single Observation Single 850mb Tv observation (1K O-F, 1K error)

9 Single Observation Single 850mb zonal wind observation (3 m/s O-F, 1m/s error) in Hurricane Ike circulation

EnKF member update member 2 analysis high res forecast GSI Hybrid Ens/Var high res analysis member 1 analysis member 2 forecast member 1 forecast recenter analysis ensemble Dual-Res Coupled Hybrid member 3 forecast member 3 analysis Previous CycleCurrent Update Cycle

Status Coding/parallel scripting completed –Except possible changes due to NPP and GOES-15 data Optimized version of post being used – so no delay in delivery of post fields expected. Some data handling issues being worked. Parallel without relocation and ozone hybrid from June 1, Oct. 7, 2011 –Problems with extrapolation of ozone into data void regions (South Pole) –Initial hurricane location degraded (forecast improved) 11

Status Modification to system –Reinstate hurricane relocation –Uncouple ozone analysis from hybrid New parallels started –Rerun beginning June 1, 2011 (will start when backup machine returns) –Real time catch up starting Nov. 1, 2011 (up to Nov. 15, 2011) Results that follow are from previous parallel –Significant changes to meteorological fields not expected (except hurricane relocation) 12

500mb Anomaly Correlation 13

1000mb Anomaly Correlation 14

200mb Tropical winds 15

850mb Tropical winds 16

12-36 hour precipitation scores 17

36-60 hour precipitation scores 18

60-84 hour precipitation scores 19

20

21

22

Hurricane track 23

More complete diagnostics 24 prd12q3h/vsdb/ prd12q3r/vsdb/ Retrospective Real Time catch up

25 Cost Analysis/GSI side –Minimal additional cost (~2 nodes) Reading in ensemble (3-9 hour forecast from previous cycle) Some additional computations in J calculations 1 additional field Coding complete/in place Additional “GDAS” Ensemble (T254L64 GDAS) –EnKF-based perturbation update Cost comparable to current analysis [ 8-10 nodes, <40 minutes] –Includes ensemble of GSI runs to get O-F and actual ensemble update step Work ongoing to optimize coding and scripting –9hr forecasts, needs to be done only in time for next (not current) cycle

Concerns Rain/no-rain for hour forecast (spin-up?) Changes in initial clouds –Part of spin-up? Tasked to attempt to incorporate NPP data. Biggest concern is computer resources to catch up to real time. 26

NPP ATMS data available –Needs some development because of different size FOVs for different channels (code change or preprocessor) –Quality control check out –Bias correction spin up CrIS instrument to be turned on in Dec. –Major calibration of CrIS – Jan. 15 –Should be similar to AIRS and IASI – significant development (code changes) unlikely –Quality control check out –Bias correction spin up 27

NPP Tentative Schedule –RFC to NCO 1/3/12 –Complete development for ATMS ~1/15/12 –Major calibration update for CrIS 1/15/12 –Check out quality control/bias correction 2/6/12 –Short off-line test ends 2/16/12 –NCO parallel testing begins 2/16/12 –Implementation 4/1/12 –Any unexpected finding that delays the schedule will stop the implementation of NPP. No chance for completion of NPP impact studies prior to NCO parallel. (JCSDA) 28