Improving forecasts through rapid updating of temperature trajectories and statistical post-processing Nina Schuhen, Thordis L. Thorarinsdottir and Alex.

Slides:



Advertisements
Similar presentations
Zentralanstalt für Meteorologie und Geodynamik Calibrating the ECMWF EPS 2m Temperature and 10m Wind Speed for Austrian Stations Sabine Radanovics.
Advertisements

A unified linear Model Output Statistics scheme for both deterministic and ensemble forecasts S. Vannitsem Institut Royal Météorologique de Belgique Monterey,
The Canadian Climate Impacts Scenarios (CCIS) Project is funded by the Climate Change Action Fund and provides climate change scenarios and related information.
Matthew Hendrickson, and Pascal Storck
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Improving COSMO-LEPS forecasts of extreme events with.
Gridded OCF Probabilistic Forecasting For Australia For more information please contact © Commonwealth of Australia 2011 Shaun Cooper.
A community statistical post-processing system Thomas Nipen and Roland Stull University of British Columbia.
Instituting Reforecasting at NCEP/EMC Tom Hamill (ESRL) Yuejian Zhu (EMC) Tom Workoff (WPC) Kathryn Gilbert (MDL) Mike Charles (CPC) Hank Herr (OHD) Trevor.
Data assimilation of trace gases in a regional chemical transport model: the impact on model forecasts E. Emili 1, O. Pannekoucke 1,2, E. Jaumouillé 2,
MOS Developed by and Run at the NWS Meteorological Development Lab (MDL) Full range of products available at:
Statistics, data, and deterministic models NRCSE.
MOS Performance MOS significantly improves on the skill of model output. National Weather Service verification statistics have shown a narrowing gap between.
¿How sensitive are probabilistic precipitation forecasts to the choice of the ensemble generation method and the calibration algorithm? Juan J. Ruiz 1,2.
Ensemble Post-Processing and it’s Potential Benefits for the Operational Forecaster Michael Erickson and Brian A. Colle School of Marine and Atmospheric.
Robert LaPlante NOAA/NWS Cleveland, OH David Schwab Jia Wang NOAA/GLERL Ann Arbor, MI 22 March 2011.
1 FPAW Fall Meeting, October 22, Develop an analytical model that explicitly incorporates weather forecasts, and their uncertainty, in estimating.
A Regression Model for Ensemble Forecasts David Unger Climate Prediction Center.
NCAR Efficient Production of High Quality, Probabilistic Weather Forecasts F. Anthony Eckel National Weather Service Office of Science and Technology,
Chapter 13 – Weather Analysis and Forecasting. The National Weather Service The National Weather Service (NWS) is responsible for forecasts several times.
Probabilistic forecasts of (severe) thunderstorms for the purpose of issuing a weather alarm Maurice Schmeits, Kees Kok, Daan Vogelezang and Rudolf van.
Performance of the MOGREPS Regional Ensemble
ESA DA Projects Progress Meeting 2University of Reading Advanced Data Assimilation Methods WP2.1 Perform (ensemble) experiments to quantify model errors.
Applications of Bayesian sensitivity and uncertainty analysis to the statistical analysis of computer simulators for carbon dynamics Marc Kennedy Clive.
Observing Strategy and Observation Targeting for Tropical Cyclones Using Ensemble-Based Sensitivity Analysis and Data Assimilation Chen, Deng-Shun 3 Dec,
Exploring sample size issues for 6-10 day forecasts using ECMWF’s reforecast data set Model: 2005 version of ECMWF model; T255 resolution. Initial Conditions:
“High resolution ensemble analysis: linking correlations and spread to physical processes ” S. Dey, R. Plant, N. Roberts and S. Migliorini NWP 4: Probabilistic.
STEPS: An empirical treatment of forecast uncertainty Alan Seed BMRC Weather Forecasting Group.
© British Crown copyright 2014 Met Office A comparison between the Met Office ETKF (MOGREPS) and an ensemble of 4DEnVars Marek Wlasak, Stephen Pring, Mohamed.
Celeste Saulo and Juan Ruiz CIMA (CONICET/UBA) – DCAO (FCEN –UBA)
Exploiting Context Analysis for Combining Multiple Entity Resolution Systems -Ramu Bandaru Zhaoqi Chen Dmitri V.kalashnikov Sharad Mehrotra.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Accounting for Change: Local wind forecasts from the high-
Short-Range Ensemble Prediction System at INM José A. García-Moya SMNT – INM 27th EWGLAM & 12th SRNWP Meetings Ljubljana, October 2005.
Model Post Processing. Model Output Can Usually Be Improved with Post Processing Can remove systematic bias Can produce probabilistic information from.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Local Probabilistic Weather Predictions for Switzerland.
18 September 2009: On the value of reforecasts for the TIGGE database 1/27 On the value of reforecasts for the TIGGE database Renate Hagedorn European.
Statistical Post Processing - Using Reforecast to Improve GEFS Forecast Yuejian Zhu Hong Guan and Bo Cui ECM/NCEP/NWS Dec. 3 rd 2013 Acknowledgements:
An Investigation of the Mesoscale Predictability over the Northeast U.S.        Brian A. Colle, Matthew Jones, and Joseph Olson Institute for Terrestrial.
Strategic Intervention A novel use of Ensembles in Forecast Guidance
11th EMS & 10th ECAM Berlin, Deutschland The influence of the new ECMWF Ensemble Prediction System resolution on wind power forecast accuracy and uncertainty.
Short-Range Ensemble Prediction System at INM García-Moya, J.A., Santos, C., Escribà, P.A., Santos, D., Callado, A., Simarro, J. (NWPD, INM, SPAIN) 2nd.
A study on the spread/error relationship of the COSMO-LEPS ensemble Purpose of the work  The spread-error spatial relationship is good, especially after.
Development of a 1D ensemble forecast System with variational assimilation Mathias D. Müller Institute of Meteorology, Climatology & Remote Sensing University.
National Oceanic and Atmospheric Administration’s National Weather Service Colorado Basin River Forecast Center Salt Lake City, Utah 11 The Hydrologic.
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course Mar 2016.
Application of object-oriented verification techniques to ensemble precipitation forecasts William A. Gallus, Jr. Iowa State University June 5, 2009.
Data Assimilation Training
Course Evaluation Now online You should have gotten an with link.
Tom Hopson, Jason Knievel, Yubao Liu, Gregory Roux, Wanli Wu
Question 1 Given that the globe is warming, why does the DJF outlook favor below-average temperatures in the southeastern U. S.? Climate variability on.
Model Post Processing.
S.Alessandrini, S.Sperati, G.Decimi,
CHAPTER 29: Multiple Regression*
Course Evaluation Now online You should have gotten an with link.
MOS Developed by and Run at the NWS Meteorological Development Lab (MDL) Full range of products available at:
Post Processing.
Post Processing.
Predictability of Indian monsoon rainfall variability
The Importance of Reforecasts at CPC
Xiefei Zhi, Yongqing Bai, Chunze Lin, Haixia Qi, Wen Chen
PEHRPP Error Metrics WG Summary
Verification of Tropical Cyclone Forecasts
MOS What does acronym stand for ?
MOGREPS developments and TIGGE
Atmospheric Sciences 452 Spring 2019
Verification of probabilistic forecasts: comparing proper scoring rules Thordis L. Thorarinsdottir and Nina Schuhen
the performance of weather forecasts
Rapid Adjustment of Forecast Trajectories: Improving short-term forecast skill through statistical post-processing Nina Schuhen, Thordis L. Thorarinsdottir.
Strategic Intervention A novel use of Ensembles in Forecast Guidance
Power Regression & Regression estimation of event probabilities (REEP)
Exponential Smoothing
Presentation transcript:

Improving forecasts through rapid updating of temperature trajectories and statistical post-processing Nina Schuhen, Thordis L. Thorarinsdottir and Alex Lenkoski 09.04.2018

Status quo Forecasts are not revisited once issued Newest forecast run is usually the best Idea: correct a forecast trajectory while it verifies

More skill!

Data set: UK Met Office MOGREPS-UK 2.2 km 70 Levels 36 hourly forecast 4 times/day 12 members Interpolated to 149 observation sites in UK and Ireland Training period: Jan to Dec 2014 Evaluation period: Jan 2015 to Jul 2016 Surface temperature

EMOS / NGR Raw ensemble output is calibrated using EMOS (NGR) Removal of deterministic and probabilistic biases Performed after the ensemble run is completed, based on a rolling training period Gneiting, T., A.E. Raftery, A.H. Westveld, and T. Goldman, 2005: Calibrated Probabilistic Forecasting Using Ensemble Model Output Statistics and Minimum CRPS Estimation. Mon. Wea. Rev., 133, 1098–1118

Previous results for EMOS

EMOS / NGR Raw ensemble output is calibrated using EMOS (NGR) Removal of deterministic and probabilistic biases Performed after the ensemble run is completed, based on a rolling training period 16% reduction in CRPS Here: correct EMOS mean, keep calibrated EMOS spread Gneiting, T., A.E. Raftery, A.H. Westveld, and T. Goldman, 2005: Calibrated Probabilistic Forecasting Using Ensemble Model Output Statistics and Minimum CRPS Estimation. Mon. Wea. Rev., 133, 1098–1118

Correction of forecast trajectories We allow for 1 hour delay for measurements to be transmitted, processed, quality-controlled, etc. Here: 03 UTC run at Heathrow Airport Data analysis shows no systematic trend in forecast error Strong connection to diurnal cycle Regression approach is the most appropriate

Framework At any time a new forecast is issued for the next 36 hours: with Observations become available while this forecast trajectory is valid Compute forecast error at : Correct the next forecast(s) using a function of this error:

Forecast error correlation matrix

Regression method Estimate future errors by linear regression Previous forecasts’ errors as predictors: Correct forecasts by adding the estimated error: Find earliest lead time, where is significantly different from 0

Length of error correction period

Development of forecast error

Development of forecast error

Development of forecast error

Extension to multiple sites

Conclusions Strong correlation between error at different lead times Predictability depends heavily on the time of day Regression model reduces forecast error overall Big margin for short-term corrections Might prefer corrected forecasts from a previous model run to the first forecasts from the current one

Future work Investigate relationship between forecast runs Develop rules for combining forecast runs to one «best» trajectory Take into account seasonal effects Kriging to spread regression parameters spatially? Extend to other weather parameters

Example