Diagnostics and Verification of the Tropical Cyclone Environment in Regional Models Brian McNoldy 1*, Kate Musgrave 1, Mark DeMaria 2 1 CIRA, Colorado.

Slides:



Advertisements
Similar presentations
Coastal Ocean Impact on Hurricane Irene (2011) Intensity 1. BACKGROUND 2. HYPOTHESIS 3. OBSERVATIONS & MODEL 6. FUTURE WORK5. CONCLUSIONS 4. RESULTS Acknowledgements:
Advertisements

Improvements in Statistical Tropical Cyclone Forecast Models: A Year 2 Joint Hurricane Testbed Project Update Mark DeMaria 1, Andrea Schumacher 2, John.
Impact of cumulus parameterization on motion, structure, intensity: preliminary results Robert Fovell and Yizhe Peggy Bu University of California, Los.
Tropical Cyclone Intrinsic Variability & Predictability Gregory J. Hakim University of Washington 67th IHC/Tropical Cyclone Research Forum 6 March 2013.
Improving Tropical Cyclone Intensity Forecasting with Theoretically-Based Statistical Models Co-PI’s: Wayne Schubert 1 Mark DeMaria 2 Buck Sampson 3 Jim.
Operational Hurricane Model Diagnostics at EMC Hurricane Diagnostics and Verification Workshop NHC, Miami, FL 4 May 2009 – 6 May 2009 Vijay Tallapragada,
Frank Marks NOAA/AOML/Hurricane Research Division 11 February 2011 Frank Marks NOAA/AOML/Hurricane Research Division 11 February 2011 Hurricane Research.
Geophysical Fluid Dynamics Laboratory Review June 30 - July 2, 2009 Geophysical Fluid Dynamics Laboratory Review June 30 - July 2, 2009.
Further Development of a Statistical Ensemble for Tropical Cyclone Intensity Prediction Kate D. Musgrave 1 Mark DeMaria 2 Brian D. McNoldy 3 Yi Jin 4 Michael.
Creation of a Statistical Ensemble for Tropical Cyclone Intensity Prediction Kate D. Musgrave 1, Brian D. McNoldy 1,3, and Mark DeMaria 2 1 CIRA/CSU, Fort.
Applications of Ensemble Tropical Cyclone Products to National Hurricane Center Forecasts and Warnings Mark DeMaria, NOAA/NESDIS/STAR, Ft. Collins, CO.
Demonstration Testbed for the Evaluation of Experimental Models for Tropical Cyclone Forecasting in Support of the NOAA Hurricane Forecast Improvement.
2013 Upgrades to the Operational GFDL/GFDN Hurricane Model Morris A. Bender, Timothy Marchok Geophysical Fluid Dynamics Laboratory, NOAA Isaac Ginis, BijuThomas,
HFIP Ensemble Products Subgroup Sept 2, 2011 Conference Call 1.
Geostationary Lightning Mapper (GLM) 1 Near uniform spatial resolution of approximately 10 km. Coverage up to 52 deg latitude % flash detection day.
Predictability of Tropical Cyclone Intensity Forecasting Mark DeMaria NOAA/NESDIS/StAR, Fort Collins, CO CoRP Science Symposium Fort Collins, CO August.
An Investigation of Cool Season Extratropical Cyclone Forecast Errors Within Operational Models Brian A. Colle 1 and Michael Charles 1,2 1 School of Marine.
Realtime Analysis of Model ICs Wallace Hogsett, NHC 1.
4-6 May 2009 Co-hosted by Naomi Surgi, Mark DeMaria, Richard Pasch, Frank Marks 4-6 May 2009 Co-hosted by Naomi Surgi, Mark DeMaria, Richard Pasch, Frank.
1 Short term plan to assist 2011 HWRF implementation HFIP Stream 1 Regional Hurricane Model Diagnostics Planning Meeting, 11/08/2010.
The Hurricane Weather Research & Forecasting (HWRF) Prediction System Next generation non-hydrostatic weather research and hurricane prediction system.
Advanced Applications of the Monte Carlo Wind Probability Model: A Year 1 Joint Hurricane Testbed Project Update Mark DeMaria 1, Stan Kidder 2, Robert.
Advanced Applications of the Monte Carlo Wind Probability Model: A Year 2 Joint Hurricane Testbed Project Update Mark DeMaria 1, Robert DeMaria 2, Andrea.
USE OF A MODIFIED SHIPS ALGORITHM FOR HURRICANE INTENSITY FORECASTS
Development of a Probabilistic Tropical Cyclone Genesis Prediction Scheme Jason Dunion1, John Kaplan2, Andrea Schumacher3, Joshua Cossuth4, & Mark DeMaria5.
ATMS 373C.C. Hennon, UNC Asheville Tropical Cyclone Forecasting Where is it going and how strong will it be when it gets there.
Applications of ATMS/CrIS to Tropical Cyclone Analysis and Forecasting Mark DeMaria and John A. Knaff NOAA/NESDIS/STAR Fort Collins, CO Andrea Schumacher,
Improvements in Deterministic and Probabilistic Tropical Cyclone Wind Predictions: A Joint Hurricane Testbed Project Update Mark DeMaria and Ray Zehr NOAA/NESDIS/ORA,
OPERATIONAL IMPLEMENTATION OF AN OBJECTIVE ANNULAR HURRICANE INDEX ANDREA B. SCHUMACHER 1, JOHN A. KNAFF 2, THOMAS A. CRAM 1, MARK DEMARIA 2, JAMES P.
Andrea Schumacher 1, Mark DeMaria 2, John Knaff 3, Liqun Ma 4 and Hazari Syed 5 1 CIRA, Colorado State University, Fort Collins, Colorado 2 NOAA/NWS/NHC,
The Impact of Satellite Data on Real Time Statistical Tropical Cyclone Intensity Forecasts Joint Hurricane Testbed Project Mark DeMaria, NOAA/NESDIS/ORA,
Improved Statistical Intensity Forecast Models: A Joint Hurricane Testbed Project Update Mark DeMaria, NOAA/NESDIS, Fort Collins, CO John A. Knaff, CIRA/CSU,
Development of a Real-Time Automated Tropical Cyclone Surface Wind Analysis: Development of a Real-Time Automated Tropical Cyclone Surface Wind Analysis:
Improvements in Deterministic and Probabilistic Tropical Cyclone Surface Wind Predictions Joint Hurricane Testbed Project Status Report Mark DeMaria NOAA/NESDIS/ORA,
An Improved Wind Probability Program: A Year 2 Joint Hurricane Testbed Project Update Mark DeMaria and John Knaff, NOAA/NESDIS, Fort Collins, CO Stan Kidder,
An Improved Wind Probability Program: A Joint Hurricane Testbed Project Update Mark DeMaria and John Knaff, NOAA/NESDIS, Fort Collins, CO Stan Kidder,
Statistical Evaluation of the Response of Intensity to Large-Scale Forcing in the 2008 HWRF model Mark DeMaria, NOAA/NESDIS/RAMMB Fort Collins, CO Brian.
A Comparison of Two Microwave Retrieval Schemes in the Vicinity of Tropical Storms Jack Dostalek Cooperative Institute for Research in the Atmosphere,
NHC Activities, Plans, and Needs HFIP Diagnostics Workshop August 10, 2012 NHC Team: David Zelinsky, James Franklin, Wallace Hogsett, Ed Rappaport, Richard.
Computing Deep-Tropospheric Vertical Wind Shear Analyses for TC Applications: Does the Methodology Matter? Christopher Velden and John Sears Univ. Wisconsin.
Upgrades to the GFDL/GFDN Operational Hurricane Models Planned for 2015 (A JHT Funded Project) Morris A. Bender, Matthew Morin, and Timothy Marchok (GFDL/NOAA)
Page 1© Crown copyright 2006 Matt Huddleston With thanks to: Frederic Vitart (ECMWF), Ruth McDonald & Met Office Seasonal forecasting team 14 th March.
Ligia Bernardet 1*, E. Uhlhorn 2, S. Bao 1* & J. Cione 2 1 NOAA ESRL Global Systems Division, Boulder CO 2 NOAA AOML Hurricane Research Division, Miami.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Image: MODIS Land Group, NASA GSFC March 2000 Improving Hurricane Intensity.
Statistical Typhoon Intensity Prediction Scheme John Knaff CIRA/Colorado State Univerisity In Partnership with Mark DeMaria NOAA/NESDIS.
John Kaplan (NOAA/HRD), J. Cione (NOAA/HRD), M. DeMaria (NOAA/NESDIS), J. Knaff (NOAA/NESDIS), J. Dunion (U. of Miami/HRD), J. Solbrig (NRL), J. Hawkins(NRL),
Ligia Bernardet, S. Bao, C. Harrop, D. Stark, T. Brown, and L. Carson Technology Transfer in Tropical Cyclone Numerical Modeling – The Role of the DTC.
Hurricane Forecast Improvement Project (HFIP): Where do we stand after 3 years? Bob Gall – HFIP Development Manager Fred Toepfer—HFIP Project manager Frank.
A Global Tropical Cyclone Formation Probability Product Andrea Schumacher, CIRA/CSU Mark DeMaria and John Knaff, NOAA/NESDIS/StAR Daniel Brown, NHC 64.
Evaluation of Experimental Models for Tropical Cyclone Forecasting in Support of the NOAA Hurricane Forecast Improvement Project (HFIP) Barbara G. Brown,
The Impact of Lightning Density Input on Tropical Cyclone Rapid Intensity Change Forecasts Mark DeMaria, John Knaff and Debra Molenar, NOAA/NESDIS, Fort.
New Tropical Cyclone Intensity Forecast Tools for the Western North Pacific 1 John Knaff and Mark DeMaria, NOAA/NESDIS/STAR Fort Collins, CO Joint Typhoon.
Atlantic Simplified Track Model Verification 4-year Sample ( ) OFCL shown for comparison Forecast Skill Mean Absolute Error.
Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,
Improvements to Statistical Forecast Models and the Satellite Proving Ground for 2013 Mark DeMaria, John Knaff, NOAA/NESDIS/STAR John Kaplan, Jason Dunion,
Tie Yuan and Haiyan Jiang Department of Earth & Environment, FIU, Miami, Florida Margie Kieper Private Consultant 65 th Interdepartmental Hurricane Conference.
Tropical Cyclone Rapid Intensity Change Forecasting Using Lightning Data during the 2010 GOES-R Proving Ground at the National Hurricane Center Mark DeMaria.
John Kaplan (NOAA/HRD), J. Cione (NOAA/HRD), M. DeMaria (NOAA/NESDIS), J. Knaff (NOAA/NESDIS), J. Dunion (U. of Miami/HRD), J. Solbrig (NRL), J. Hawkins(NRL),
Development of a Rapid Intensification Index for the Eastern Pacific Basin John Kaplan NOAA/AOML Hurricane Research Division Miami, FL and Mark DeMaria.
Improved Statistical Intensity Forecast Models: A Joint Hurricane Testbed Year 2 Project Update Mark DeMaria, NOAA/NESDIS, Fort Collins, CO John A. Knaff,
Transition of a Revised Dynamical Model Track Prediction Evaluation Expert System (DYMES) Mark Boothe Department of Meteorology Naval Postgraduate School.
Enhancement of SHIPS Using Passive Microwave Imager Data—2005 Testing Dr. Daniel J. Cecil Dr. Thomas A. Jones University of Alabama in Huntsville
Verification of model wind structure and rainfall forecasts for 2008 Atlantic storms Tim Marchok NOAA / GFDL Collaborators: Rob Rogers (NOAA / AOML / HRD)
Analysis of Typhoon Tropical Cyclogenesis in an Atmospheric General Circulation Model Suzana J. Camargo and Adam H. Sobel.
New Tropical Cyclone Intensity Forecast Tools for the Western North Pacific Mark DeMaria and John Knaff NOAA/NESDIS/RAMMB Andrea Schumacher, CIRA/CSU.
Andrea Schumacher, CIRA/CSU, Fort Collins, CO Mark DeMaria and John Knaff, NOAA/NESDIS/StAR, Fort Collins, CO NCAR/NOAA/CSU Tropical Cyclone Workshop 16.
Andrea Schumacher1, M. DeMaria2, and R. DeMaria1
Kate Musgrave1, Christopher Slocum2, and Andrea Schumacher1
Mark DeMaria and John A. Knaff - NOAA/NESDIS/RAMMB, Fort Collins, CO
Statistical Evaluation of the Response of Intensity
Presentation transcript:

Diagnostics and Verification of the Tropical Cyclone Environment in Regional Models Brian McNoldy 1*, Kate Musgrave 1, Mark DeMaria 2 1 CIRA, Colorado State University, Fort Collins CO 2 NOAA/NESDIS/STAR, Fort Collins CO * Current affiliation: RSMAS, University of Miami, Miami FL Also a special thanks to the COAMPS-TC modeling team at NRL for extensive collaboration and feedback AMS 30 th Conf. on Hurricanes and Tropical Meteorology AMS 30 th Conf. on Hurricanes and Tropical Meteorology Ponte Vedra Beach FL · April 2012 · 15A.3

2 Diagnostic Files ◦ Condense model run down to 20 kb text file ◦ Contains analysis and forecast of key vortex-scale data as well as a vertical profile of large-scale environmental data ◦ Produced and made available in near-real-time since 2008 at CIRA for HWRF and GFDL ◦ Five-page document made available that details file naming convention, field calculations, etc. ◦ Uniform format across all models, flexible enough to accommodate different temporal and vertical resolutions, and to include additional custom fields

3 Diagnostic Files, con't ◦ From , code only existed in IDL ◦ In mid 2011, CIRA developed and shared Fortran code with interested modeling groups who also produced these files (NRL-Monterey, Univ at Albany, EMC, GFDL, ESRL, DTC, Univ of Wisconsin) – Part of HFIP Stream 1.5 effort... SPICE (SPC3) utilizes these files in real-time ◦ Updated versions of this code are easy to distribute and implement ◦ Multi-model collection of these files facilitates convenient comparison of track, intensity, environment over a storm or entire season – ~8 Mb / model / season

4 Standard SHIPS Parameters Sea surface temp (RSST) mb shear (SHDC) 200 mb zonal wind (U20C) 200 mb temp (T200) mb RH (RHLO) mb RH (RHMD) mb RH (RHHI) 200 mb divergence (D200) 850 mb vorticity (Z850) Key parameters are calculated in prescribed areas from regional model... This is already done with GFS output to create SHIPS “predictor” files available on NHC's FTP server

5 * HWRF * * AL09 IRENE * STORM DATA NTIME 022 DELTAT 006 TIME (HR) LAT (DEG) LON (DEG) MAXWIND (KT) RMW (KM) MIN_SLP (MB) SHR_MAG (KT) SHR_DIR (DEG) STM_SPD (KT) STM_HDG (DEG) SST (10C) OHC (KJ/CM2) TPW (MM) LAND (KM) TANG (10M/S) VORT (/S) DVRG (/S) SOUNDING DATA NLEV 020 SURF TIME (HR) T_SURF (10C) R_SURF (%) P_SURF (MB) U_SURF (10KT) V_SURF (10KT) T_1000 (10C) R_1000 (%) Z_1000 (DM) U_1000 (10KT) V_1000 (10KT) T_0100 (10C) R_0100 (%) Z_0100 (DM) U_0100 (10KT) V_0100 (10KT) CUSTOM DATA NVAR 004 GRDWIND GRD_SLP CAPE VERTVEL GRDWIND (KT) GRD_SLP (MB) CAPE (J/KG) VERTVEL (100M/S) COMMENTS * SST, OHC averaged in five closest points under storm center [x10 C, kJ/cm2] * * RMW, TPW, GRDWIND, GRD_SLP within 0-200km around storm center [km, mm, kt, mb] * * U, V, SHR averaged from 0-500km around storm center [x10 kt, x10 kt, kt] * * 850VORT, 200DVRG averaged from km around storm center [x10^7 /s, x10^7 /s] * * 850TANG is 0-600km average symmetric wind [x10 m/s] * * T, R, Z, P averaged from km around storm center [x10 C, %, dm, mb] * * HWRF * * AL09 IRENE * --- STORM DATA SOUNDING DATA CUSTOM DATA COMMENTS ---

6 Post-season Environmental Verification ◦ 2011 Atlantic season ◦ Storms of at least TD intensity ◦ Bias (dotted) and MAE (solid) plotted as function of forecast hour ◦ Homogeneous sample size shown below forecast hour ◦ 308 HWRF/GFDL/COTC cases at t=0 (60 at t=120h)

7 Post-season Environmental Verification For intensity, “BTRK” is NHC's best-track... But in the remainder of fields, “BTRK” refers to GFS analysis

8 Sea Surface Temperature ◦ Slight cool bias, more so in COTC (2 deg by 120h) ◦ Intimately linked to track errors

9 Vertical Shear ◦ ~5kt error at 36h, then GFS reaches 11kt at 120h while GFDL reaches 6.5kt at 120h

10 850mb Vorticity ◦ Similar errors among all models, most bias in HWRF

mb RH ∘ Fairly persistent and constant low-level RH errors ∘ GFDL too dry (3-7%)

mb RH ∘ Mid-level RH errors increase slightly with time ∘ GFDL drier again (5-13%)

mb RH ◦ Persistent dry bias in HWRF & GFDL upper-level RH ◦ GFDL 7-14% too dry

14 200mb Zonal Wind ◦ Similar errors among all models, most bias in COTC

15 200mb Divergence ◦ Significant error in COTC

16 200mb Temperature ◦ Significant error (all positive) in GFDL's 200mb temp – This can have large impact on intensity

17 Real-time Environmental Diagnostics

18 Real-time Environmental Diagnostics

19 HWRF 2011 vs HWRF 2012 ◦ Pre-implementation evaluation of model environment Sample of results from retrospective Atlantic storms

20 Wrap-Up & Future Plans ◦ Create uniform summaries of model runs that contain key vortex and environmental data, including full vertical profile – Easy to compare different models, different versions of same model, impact of model upgrades – Allows for pre-implementation, real-time, and post- season evaluation of significant environmental parameters beyond intensity and track ◦ Improve efficiency of code, involve more modelers ◦ Allow for wider range of input data formats ◦ Centrally house files from many models/groups at DTC

21 Environment vs. Vortex ◦ Both are important for intensity prediction – Environment is modeled fairly well – Vortex has lots of room for improvement Statistical-dynamical models (e.g. SHIPS, LGEM, SPICE) commonly show higher intensity forecast skill than high-resolution regional models... using only the large-scale environment from those same models

22 A Healthy Environment If the synoptics are right, the track forecast will be better... resulting in a more accurate forecast of the cyclone's large-scale environment and its intensity If the synoptics are right, the track forecast will be better... resulting in a more accurate forecast of the cyclone's large-scale environment and its intensity If large-scale environment and track forecasts are perfect, additional significant improvements can be realized in statistical- dynamical models

23 Regional Models in Study ∘ HWRF (2011 Operational Model) – Includes major bug fix (deep convection parameterization) made mid-season on August 3 during TS Emily (AL) and Hurricane Eugene (EP) ∘ GFDL (2011 Operational Model) – Includes known SAS -> microphysics bug ∘ COAMPS-TC (2011 Model) ∘ GFS operational analyses used as “truth” for verification

24 Intensity ∘ COTC: Minimal bias and less error beyond 72h ∘ HWRF and GFDL: larger errors, larger positive bias

25 Latitude/Longitude ∘ All models bring storms poleward too quickly ∘ HWRF and COTC have very slight eastward bias, GFDL a slight westward bias ∘ Resultant track error is comparable among the models: n mi at 48h, and n mi at 120h

26 Track/DTL