Juan Ruiz 1,2, Celeste Saulo 1,2, Soledad Cardazzo 1, Eugenia Kalnay 3 1 Departamento de Cs. de la Atmósfera y los Océanos (FCEyN-UBA), 2 Centro de Investigaciones.

Slides:



Advertisements
Similar presentations
Medium-range Ensemble Streamflow forecast over France F. Rousset-Regimbeau (1), J. Noilhan (2), G. Thirel (2), E. Martin (2) and F. Habets (3) 1 : Direction.
Advertisements

When Efficient Model Averaging Out-Perform Bagging and Boosting Ian Davidson, SUNY Albany Wei Fan, IBM T.J.Watson.
“A LPB demonstration project” Celeste Saulo CIMA and Dept. of Atmos. and Ocean Sciences University of Buenos Aires Argentina Christopher Cunningham Center.
Caio A. S. Coelho Centro de Previsão de Tempo e Estudos Climáticos (CPTEC) Instituto Nacional de Pesquisas Espaciais (INPE) 1 st EUROBRISA.
5-16 AUGUST - BUENOS AIRES - ARGENTINA Organized by: Dpto de ciencias de la atmósfera y los océanos – UBA WMO – World weather research program Servicio.
A Brief Guide to MDL's SREF Winter Guidance (SWinG) Version 1.0 January 2013.
How do model errors and localization approaches affects model parameter estimation Juan Ruiz, Takemasa Miyoshi and Masaru Kunii
Statistical post-processing using reforecasts to improve medium- range renewable energy forecasts Tom Hamill and Jeff Whitaker NOAA Earth System Research.
Details for Today: DATE:3 rd February 2005 BY:Mark Cresswell FOLLOWED BY:Assignment 2 briefing Evaluation of Model Performance 69EG3137 – Impacts & Models.
Gridded OCF Probabilistic Forecasting For Australia For more information please contact © Commonwealth of Australia 2011 Shaun Cooper.
Validation of the Ensemble Tropical Rainfall Potential (eTRaP) for Landfalling Tropical Cyclones Elizabeth E. Ebert Centre for Australian Weather and Climate.
Improving Probabilistic Ensemble Forecasts of Convection through the Application of QPF-POP Relationships Christopher J. Schaffer 1 William A. Gallus Jr.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Quantitative precipitation forecasts in the Alps – first.
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
Univ of AZ WRF Model Verification. Method NCEP Stage IV data used for precipitation verification – Stage IV is composite of rain fall observations and.
Summary The CLASS U3M 1D (Unsaturated Moisture Movement Model) was used to simulate water content of 4 soil levels at Diamante, Entre Rios. Hydraulic parameters.
¿How sensitive are probabilistic precipitation forecasts to the choice of the ensemble generation method and the calibration algorithm? Juan J. Ruiz 1,2.
Ensemble Post-Processing and it’s Potential Benefits for the Operational Forecaster Michael Erickson and Brian A. Colle School of Marine and Atmospheric.
Comparison of hybrid ensemble/4D- Var and 4D-Var within the NAVDAS- AR data assimilation framework The 6th EnKF Workshop May 18th-22nd1 Presenter: David.
Multi-Model Ensembling for Seasonal-to-Interannual Prediction: From Simple to Complex Lisa Goddard and Simon Mason International Research Institute for.
1 LAM EPS Workshop, Madrid, 3-4 October 2002 Ken Mylne and Kelvyn Robertson Met Office Poor Man's EPS experiments and LAMEPS plans at the Met Office.
Copyright 2012, University Corporation for Atmospheric Research, all rights reserved Verifying Ensembles & Probability Fcsts with MET Ensemble Stat Tool.
ESA DA Projects Progress Meeting 2University of Reading Advanced Data Assimilation Methods WP2.1 Perform (ensemble) experiments to quantify model errors.
WWOSC 2014, Aug 16 – 21, Montreal 1 Impact of initial ensemble perturbations provided by convective-scale ensemble data assimilation in the COSMO-DE model.
ISDA 2014, Feb 24 – 28, Munich 1 Impact of ensemble perturbations provided by convective-scale ensemble data assimilation in the COSMO-DE model Florian.
Tutorial. Other post-processing approaches … 1) Bayesian Model Averaging (BMA) – Raftery et al (1997) 2) Analogue approaches – Hopson and Webster, J.
Intraseasonal TC prediction in the southern hemisphere Matthew Wheeler and John McBride Centre for Australia Weather and Climate Research A partnership.
How can LAMEPS * help you to make a better forecast for extreme weather Henrik Feddersen, DMI * LAMEPS =Limited-Area Model Ensemble Prediction.
STEPS: An empirical treatment of forecast uncertainty Alan Seed BMRC Weather Forecasting Group.
EUROBRISA Workshop – Beyond seasonal forecastingBarcelona, 14 December 2010 INSTITUT CATALÀ DE CIÈNCIES DEL CLIMA Beyond seasonal forecasting F. J. Doblas-Reyes,
WORKSHOP ON SHORT-RANGE ENSEMBLE PREDICTION USING LIMITED-AREA MODELS Instituto National de Meteorologia, Madrid, 3-4 October 2002 Limited-Area Ensemble.
SOME EXPERIENCES ON SATELLITE RAINFALL ESTIMATION OVER SOUTH AMERICA. Daniel Vila 1, Inés Velasco 2 1 Sistema de Alerta Hidrológico - Instituto Nacional.
Celeste Saulo and Juan Ruiz CIMA (CONICET/UBA) – DCAO (FCEN –UBA)
1 An overview of the use of reforecasts for improving probabilistic weather forecasts Tom Hamill NOAA / ESRL, Physical Sciences Div.
Real-time Verification of Operational Precipitation Forecasts using Hourly Gauge Data Andrew Loughe Judy Henderson Jennifer MahoneyEdward Tollerud Real-time.
Hydrometeorological Prediction Center HPC Experimental PQPF: Method, Products, and Preliminary Verification 1 David Novak HPC Science and Operations Officer.
Probabilistic Forecasting. pdfs and Histograms Probability density functions (pdfs) are unobservable. They can only be estimated. They tell us the density,
Short-Range Ensemble Prediction System at INM José A. García-Moya SMNT – INM 27th EWGLAM & 12th SRNWP Meetings Ljubljana, October 2005.
Plans for Short-Range Ensemble Forecast at INM José A. García-Moya SMNT – INM Workshop on Short Range Ensemble Forecast Madrid, October,
. Outline  Evaluation of different model-error schemes in the WRF mesoscale ensemble: stochastic, multi-physics and combinations thereof  Where is.
Retrospective Evaluation of the Performance of Experimental Long-Lead Columbia River Streamflow Forecasts Climate Forecast and Estimated Initial Soil Moisture.
Huiling Yuan 1, Xiang Su 1, Yuejian Zhu 2, Yan Luo 2, 3, Yuan Wang 1 1. Key Laboratory of Mesoscale Severe Weather/Ministry of Education and School of.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss A more reliable COSMO-LEPS F. Fundel, A. Walser, M. A.
Typhoon Forecasting and QPF Technique Development in CWB Kuo-Chen Lu Central Weather Bureau.
An Examination Of Interesting Properties Regarding A Physics Ensemble 2012 WRF Users’ Workshop Nick P. Bassill June 28 th, 2012.
Generate ξ m,i for each direction i given H, σ 1 and m (Eq. 2) calculate X’ m,i for each direction i (Eq. 1) given ξ m,i and X m, which corresponds for.
Exploring Multi-Model Ensemble Performance in Extratropical Cyclones over Eastern North America and the Western Atlantic Ocean Nathan Korfe and Brian A.
Nathalie Voisin 1, Florian Pappenberger 2, Dennis Lettenmaier 1, Roberto Buizza 2, and John Schaake 3 1 University of Washington 2 ECMWF 3 National Weather.
Common verification methods for ensemble forecasts
A Random Subgrouping Scheme for Ensemble Kalman Filters Yun Liu Dept. of Atmospheric and Oceanic Science, University of Maryland Atmospheric and oceanic.
DOWNSCALING GLOBAL MEDIUM RANGE METEOROLOGICAL PREDICTIONS FOR FLOOD PREDICTION Nathalie Voisin, Andy W. Wood, Dennis P. Lettenmaier University of Washington,
VERIFICATION OF A DOWNSCALING SEQUENCE APPLIED TO MEDIUM RANGE METEOROLOGICAL PREDICTIONS FOR GLOBAL FLOOD PREDICTION Nathalie Voisin, Andy W. Wood and.
Probabilistic Forecasts Based on “Reforecasts” Tom Hamill and Jeff Whitaker and
Predicting Intense Precipitation Using Upscaled, High-Resolution Ensemble Forecasts Henrik Feddersen, DMI.
Figures from “The ECMWF Ensemble Prediction System”
Application of the CRA Method Application of the CRA Method William A. Gallus, Jr. Iowa State University Beth Ebert Center for Australian Weather and Climate.
LEPS VERIFICATION ON MAP CASES
BACY = Basic Cycling A COSMO Data Assimilation Testbed for Research and Development Roland Potthast, Hendrik Reich, Christoph Schraff, Klaus.
Verifying and interpreting ensemble products
Arpae Hydro-Meteo-Climate Service, Bologna, Italy
Nathalie Voisin, Andy W. Wood and Dennis P. Lettenmaier
Probabilistic forecasts
Comparison of different combinations of ensemble-based and variational data assimilation approaches for deterministic NWP Mark Buehner Data Assimilation.
Christoph Gebhardt, Zied Ben Bouallègue, Michael Buchhold
Lightning Assimilation Techniques
Verification of Tropical Cyclone Forecasts
the performance of weather forecasts
New PP: Consolidation of COSMO ensemble (CONSENS)
Short Range Ensemble Prediction System Verification over Greece
Presentation transcript:

Juan Ruiz 1,2, Celeste Saulo 1,2, Soledad Cardazzo 1, Eugenia Kalnay 3 1 Departamento de Cs. de la Atmósfera y los Océanos (FCEyN-UBA), 2 Centro de Investigaciones del Mar y la Atmósfera (CONICET-UBA), 3 University of Maryland GOAL The aim of this work is to quantify the improvement in forecasts due to the implementation of a short range regional ensemble system over South America. The focus is in the probabilistic quantitative precipitation forecast (PQPF) where different methodologies are tested in order to improve forecast reliability. Although these methodologies have been applied to short range forecasts, they can be easily applied to longer range forecasts and to other variables as well. ENSEMBLE GENERATION Several techniques have been tested for ensemble generation: Ensembles based on initial and boundary condition perturbation: In this case we selected methods to generate perturbations with information of the “errors of the day” in order to represent the uncertainty in the initial and boundary conditions. We used SLAF (Scaled Lagged Averaged Forecast) (Dalcher et. al. 1988) and Breeding of the Growing Modes (Toth and Kalnay 1993). Both of them were implemented in the WRF regional model. Ensemble based on combination of different models: The MASTER Laboratory Super Model Ensemble (SMES) has been used. (Silva Dias et. al. 2006). ( The SMES combines the operational forecasts available over South America. Regional and global models are included in this ensemble as well as forecasts started from different data assimilation systems. In all cases the 24 and 48 ensemble forecasts were verified and calibrated. PQPF CALIBRATION ¿Why we need to calibrate?: Because probabilities estimated directly from the ensemble are not reliable. This is because the different members of the ensemble have biases which should be corrected before the computation of the probabilities. ¿How do we calibrate the probabilities?: There are several methodologies but most of them use a dataset composed of forecasts and its verification to quantify model biases and to construct an statistical model to remove those errors from the forecasted probabilities. Tested methodologies: Calibration based in the rank histogram: Hamill y Colucci (1998) –HC98- Calibration using the a conditional probability approach: Gallus and Seagal RESULTS: SLAF AND SMES (October – December 2006) Southern Region (South of 20º S), Northern Region (north of 20º S). Red: Uncalibrated Blue: Rank histogram calibration. Circles: Conditional probability calibration for the ensemble mean. Triangles: Conditional probability calibration for the control forecast. SLAF(left) and SMES(rigth) Brier Skill Score The results show that: SLAF seems to be better over the southern region. A single forecast can achieve results which are similar to the ones obtained with the ensemble for very short forecast lead times. (i.e. less than 24 hours). Calibration significantly improve forecast reliability RESULTS: BREEDING (summer SALLJEX) The SALLEX and ANA (Agencia Nacional del Agua, Brasil) rain gauge network data is used for the verification and calibration of the breeding ensemble (11 members and 40 km horizontal resolution). Forecast verification / calibration is performed independently over 3 different regions 24 hour forecasts (BSS decomposition) : Uncalibrated (dark red) and its confidence limits (bootstrap). Grey (control forecast) Violet (ensemble mean) Green (HC98) Blue (HC98 with bias correction) Yellow (Modified HC98). The calibration applied to the ensemble mean and the control forecast shows the best results. 48 hour forecasts (region 1) In this case the ensemble mean is significantly better than the control forecast. Forecast value ( 2.5 mm threshold) Forecast value is computed using a very simple decision making model. The score shows the relative increment in the forecast value over the climatology. The value is plotted as a function of the cost / loss ratio (i.e. the ratio between the cost of protection and the loss produced by the unexpected occurrence of a particular phenomena) Forecast calibration increases forecast value over all regions and mainly in cases where the cost / loss relation is high. Operational implementation The calibrated and uncalibrated PQPF obtained from the SMES ensemble and from the WRF-CIMA forecasts are being computed every day. These experimental products are available at CIMA web page: