5.5.20031 The development of statistical interpretation and adaptation of NWP at FMI Juha Kilpinen, Ahti Sarvi and Mikael Jokimäki Finnish Meteorological.

Slides:



Advertisements
Similar presentations
Chapter 13 – Weather Analysis and Forecasting
Advertisements

6th WMO tutorial Verification Martin GöberContinuous 1 Good afternoon! नमस्कार नमस्कार Guten Tag! Buenos dias! до́брый день! до́брыйдень Qwertzuiop asdfghjkl!
Willem A. Landman & Francois Engelbrecht.  Nowcasting: A description of current weather parameters and 0 to 2 hours’ description of forecast weather.
PRESENTS: FORECASTING FOR OPERATIONS AND DESIGN February 16 th 2011 – Aberdeen.
Open data based RWIS for mobile devices Mikael Holmström, Intrinsic Oy.
Multiple Linear Regression Model
MOS Performance MOS significantly improves on the skill of model output. National Weather Service verification statistics have shown a narrowing gap between.
A Regression Model for Ensemble Forecasts David Unger Climate Prediction Center.
Chapter 13 – Weather Analysis and Forecasting. The National Weather Service The National Weather Service (NWS) is responsible for forecasts several times.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Slides by JOHN LOUCKS & Updated by SPIROS VELIANITIS.
COSMO General Meeting Zurich, 2005 Institute of Meteorology and Water Management Warsaw, Poland- 1 - Verification of the LM at IMGW Katarzyna Starosta,
“1995 Sunrise Fire – Long Island” Using an Ensemble Kalman Filter to Explore Model Performance on Northeast U.S. Fire Weather Days Michael Erickson and.
Dr Mark Cresswell Model Assimilation 69EG6517 – Impacts & Models of Climate Change.
Regression Method.
Multiple Regression. In the previous section, we examined simple regression, which has just one independent variable on the right side of the equation.
Details for Today: DATE:18 th November 2004 BY:Mark Cresswell FOLLOWED BY:Literature exercise Model Assimilation 69EG3137 – Impacts & Models of Climate.
© 2002 Prentice-Hall, Inc.Chap 14-1 Introduction to Multiple Regression Model.
Diploma in Statistics Introduction to Regression Lecture 2.21 Introduction to Regression Lecture Review of Lecture 2.1 –Homework –Multiple regression.
Improvements in Deterministic and Probabilistic Tropical Cyclone Wind Predictions: A Joint Hurricane Testbed Project Update Mark DeMaria and Ray Zehr NOAA/NESDIS/ORA,
Application of low- resolution ETA model data to provide guidance to high impact weather in complex terrain Juha Kilpinen Finnish Meteorological Institute.
P. Ñurmi / WWRP QPF Verification - Prague 1 Operational QPF Verification of End Products and NWP Pertti Nurmi Finnish Meteorological Institute.
1 1 Slide © 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole.
Verification methods - towards a user oriented verification WG5.
The Examination of Residuals. Examination of Residuals The fitting of models to data is done using an iterative approach. The first step is to fit a simple.
Chapter 11 Linear Regression Straight Lines, Least-Squares and More Chapter 11A Can you pick out the straight lines and find the least-square?
Regression Models Residuals and Diagnosing the Quality of a Model.
LAPS __________________________________________ Analysis and nowcasting system for Finland/Scandinavia Finnish Meteorological Institute Erik Gregow.
Diploma in Statistics Introduction to Regression Lecture 3.11 Lecture 3.1 Multiple Regression (continued) Review Homework Review Analysis of Variance Review.
Latest results in verification over Poland Katarzyna Starosta, Joanna Linkowska Institute of Meteorology and Water Management, Warsaw 9th COSMO General.
Quality control of daily data on example of Central European series of air temperature, relative humidity and precipitation P. Štěpánek (1), P. Zahradníček.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Accounting for Change: Local wind forecasts from the high-
Multivariate Models Analysis of Variance and Regression Using Dummy Variables.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Verification results of COSMO at MeteoSwiss in the year.
26 th EWGLAM & 11 th SRNWP meetings, Oslo, Norway, 4 th - 7 th October 2004 Stjepan Ivatek-Šahdan RC LACE Data Manager Croatian Meteorological and Hydrological.
Model Post Processing. Model Output Can Usually Be Improved with Post Processing Can remove systematic bias Can produce probabilistic information from.
Deutscher Wetterdienst Bootstrapping – using different methods to estimate statistical differences between model errors Ulrich Damrath COSMO GM Rome 2011.
Bangladesh Short term Discharge Forecasting time series forecasting Tom Hopson A project supported by USAID.
Assimilation of Satellite Radiances into LM with 1D-Var and Nudging Reinhold, Christoph, Francesca, Blazej, Piotr, Iulia, Michael, Vadim DWD, ARPA-SIM,
Application of Numerical Weather Prediction Prognoses to Operational Weather Forecasting in Hong Kong Pre-CAS Technical Conference on "Environmental Prediction.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss WG4 activities Pierre Eckert, MeteoSwiss, Geneva.
Weather forecasting by computer Michael Revell NIWA
Status and Plans of the Global Precipitation Climatology Centre (GPCC) Bruno Rudolf, Tobias Fuchs and Udo Schneider (GPCC) Overview: Introduction to the.
WWRP_WSN05, Toulouse, 5-9 September 2005 / 1 Pertti Nurmi Juha Kilpinen Sigbritt Näsman Annakaisa Sarkanen ( Finnish Meteorological.
Linear Optimization as a Solution to Improve the Sky Cover Guess, Forecast Jordan Gerth Cooperative Institute for Meteorological Satellite Studies University.
EMS 2013 (Reading UK) Verification techniques for high resolution NWP precipitation forecasts Emiel van der Plas Kees Kok Maurice.
Verification tools at the Norwegian Meteorological Institute By Helen Korsmo EGOWS 2004.
Statistical Post Processing - Using Reforecast to Improve GEFS Forecast Yuejian Zhu Hong Guan and Bo Cui ECM/NCEP/NWS Dec. 3 rd 2013 Acknowledgements:
The LAMP/HRRR MELD FOR AVIATION FORECASTING Bob Glahn, Judy Ghirardelli, Jung-Sun Im, Adam Schnapp, Gordana Rancic, and Chenjie Huang Meteorological Development.
Overview of WG5 activities and Conditional Verification Project Adriano Raspanti - WG5 Bucharest, September 2006.
Kalman filtering at HNMS Petroula Louka Hellenic National Meteorological Service
10th COSMO General Meeting, Cracow, Poland Verification of COSMOGR Over Greece 10 th COSMO General Meeting Cracow, Poland.
Verification methods - towards a user oriented verification The verification group.
Département fédéral de l‘intérieur DFI Office fédéral de météorologie et de climatologie MétéoSuisse Postprocessing methods Pierre Eckert MeteoSwiss, Geneva.
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
Daiwen Kang 1, Rohit Mathur 2, S. Trivikrama Rao 2 1 Science and Technology Corporation 2 Atmospheric Sciences Modeling Division ARL/NOAA NERL/U.S. EPA.
of Temperature in the San Francisco Bay Area
Analysis and forecasting system for Finland/Scandinavia
Correlation and Simple Linear Regression
Plans for Met Office contribution to SMOS+STORM Evolution
Update on the Northwest Regional Modeling System 2013
of Temperature in the San Francisco Bay Area
Correlation and Simple Linear Regression
Post Processing.
Statistical vs. Physical Adaptation
Correlation and Simple Linear Regression
Simple Linear Regression and Correlation
Multivariate Models Regression.
Seasonal Forecasting Using the Climate Predictability Tool
Correlation and Simple Linear Regression
Correlation and Simple Linear Regression
Presentation transcript:

The development of statistical interpretation and adaptation of NWP at FMI Juha Kilpinen, Ahti Sarvi and Mikael Jokimäki Finnish Meteorological Institute Past operational methods: –Perfect Prognosis (with multiple regression) –Kalman filtering –Decision threes Present pre-operational methods: –Fuzzy systems for points –Perfect Prognosis for grid points

The development of statistical interpretation and adaptation of NWP at FMI Past operational methods: –Perfect Prognosis (with multiple regression) for three stations, several parameters –Kalman filtering temperature, min/max temperatute, off shore winds, PoP tests, for stations –Decision threes several parameters, for grid data

The development of statistical interpretation and adaptation of NWP at FMI Present pre-operational methods: –Fuzzy systems for points ECMWF temperature –Perfect Prognosis for grid data temperature/ground temperature/Min-Max HIRLAM and ECMWF data to be used within the grid editing process

and editing of Real time database: observations numerical forecasts final forecasts interpretations Climatological database Post processing: creates customer products from the data edited by forecasters; texts, graphics, etc. Customers: Observations: satellites weather radars surface observations soundings Numerical weather forecast models (by supercomputers) Forecasting process at FMI Visualisation and Editing by Forecaster (interpretations) Old Vax workstation Old manual process

Observations (Global & Local) Customers: Public Web Business: Media Aviation Industry Security: General public Authorities Editing by forecasters (FMI) Post processing Production Servers (FMI) Real time Database (FMI) Post processing (e.g. statistical adaptation) HIRLAM model (CSC) Climate database (FMI) Forecasts Observations Boundaries Forecasts Graphics text forecasts etc. ECMWF Monitoring SMS(FMI) Forecasters: Manual products Forecasting process at FMI

The Grid Editor Smart Tools: ability to make Scripts to perform more Complicated and often Repeated editing actions in A more easy manner (suitable Also for adaptation purposes) IF (N>5) T=T+3

MAE of temperature forecasts (3 stations, 9 seasons, days) Centralized editing on commercial side

HIRLAM DMO and Obs ( )HIRLAM PPM and Obs ( ) Error ~ 5-9 degrees max error 10 degrees Error ~ degrees max error -20 degrees

Perfect Prognosis method for temperature forecasting Juha Kilpinen 2100 grid points, HIRLAM and ECMWF models applies same models for both data sources (HIRLAM/ECMWF) developmental data from TEMP’s of Jokioinen (02935) and Sodankylä (02836), 20 years of data separate models for 00UTC, 03UTC, 06UTC, 09UTC, 12UTC, 15UTC, 18UTC and 21 UTC (see Fig.) over sea or lakes DMO is used data stratification for four seasons, overlap of seasons 1 month (see Fig.) TEMP data from surface up to 500 HPa used, also derived new predictors used multiple linear regression (Systat 10) forward selection of predictors, a new predictor should increase the reduction of variance of the model by at least 0.5%.

Derived predictors for PPM FF850 = SQRT(ABS(V850*U850)) TYPE_PRHFF = (P_P0H-949)/15.6+(24-FF850)/3.93+(100-RH850)/28 CL_MAX = MAX(RH500*RH500/100,RH700*RH700/100,RH850*RH850/100) TYPE_PCLFF = (P_P0H-949)/15.6+(100-CL_MAX)/28.2+(24- FF850)/3.93 P_P0H2 = P_P0H-1013 Z8502 = Z Z7002 = Z Z5002 = Z COSINUS = COS(2*3.1417*JUL/360) SINUS = SIN(2*3.1417*JUL/360)

Estimation error of dependent PPM model UTC

Estimation error of dependent PPM model UTC

UTC TEMP 00 UTC TEMP SYNOP UTC Connections of TEMP and SYNOP data in estimation

Winter (5 months) Spring (3 months) Summer (5 months) Autumn (3 months) Winter (5 months) Data stratification and overlap of seasonal models overlap 1 month

Perfect Prognosis for temperature forecasts: A typical model Data for the following results were selected according to: (SEASON_SF= 2) AND (HH= 12) 4 case(s) deleted due to missing data. Dep Var: T2M_P0H N: 548 Multiple R: Squared multiple R: Adjusted squared multiple R: Standard error of estimate: Effect Coefficient Std Error Std Coef Tolerance t P(2 Tail) CONSTANT Z T RH T E COSINUS Z P_P0H E Analysis of Variance Source Sum-of-Squares df Mean-Square F-ratio P Regression E E E Residual E Durbin-Watson D Statistic First Order Autocorrelation

Perfect Prognosis for temperature forecasts: A typical model Data for the following results were selected according to: (SEASON_WS= 2) AND (HH= 00) 4 case(s) deleted due to missing data. Dep Var: T2M_P0H N: 3335 Multiple R: Squared multiple R: Adjusted squared multiple R: Standard error of estimate: Effect Coefficient Std Error Std Coef Tolerance t P(2 Tail) CONSTANT T COSINUS Z P_P0H RH SINUS TYPE_PNFFP0H Analysis of Variance Source Sum-of-Squares df Mean-Square F-ratio P Regression Residual *** WARNING *** Case has large leverage (Leverage = 0.012) Durbin-Watson D Statistic First Order Autocorrelation 0.165

Perfect Prognosis for temperature forecasts: The models of Jokioinen (02935) used south of Jokioinen, the models of Sodankylä (02836) used north of Sodankylä and interpolation between these stations PPM calculated after every HIRLAM run (4 times a day) and for ECMWF data once a day to a grid Verification results available for stations (ME, MAE,...) Verification results available for grid (based on MESAN analysis) Timeseries of forecasts and observations for stations

Location of Jokioinen and Sodankylä; ECWMF PPM and DMO

Verification results of PPM: Mean Error ME (bias) Mean Absolute Error MAE HIRLAM 00 UTC analysis ECMWF 12 UTC corresponding to the same valid time +06h +48h 18h

ECMWF MAE Summer 2002

Error of HIRLAM (and PPM) temperature forecasts (summer stations) Forecast length (hours)

Error of ECMWF (and PPM) temperature forecasts (summer stations) Forecast length (hours)

Dep Var: T2M_09UTC N: 3290 Multiple R: Squared multiple R: Adjusted squared multiple R: Standard error of estimate: Effect Coefficient Std Error Std Coef Tolerance t P(2 Tail) CONSTANT V T COSINUS CL_MAX Z P_P0H Dep Var: T2M_12UTC N: 3289 Multiple R: Squared multiple R: Adjusted squared multiple R: Standard error of estimate: Effect Coefficient Std Error Std Coef Tolerance t P(2 Tail) CONSTANT V T COSINUS CL_MAX Z P_P0H Jokioinen Summer 12 UTC TEMP PPM Models for 09 UTC and 12 UTC

Error of HIRLAM (and PPM) temperature forecasts (autumn stations) Forecast length (hours)

Temperature error of HIRLAM (and PPM) at Jokioinen (02935) summer 2002 Forecast length (hours)

Temperature error of ECMWF (and PPM) at Jokioinen (02935) summer 2002 Forecast length (hours)

Temperature error of HIRLAM (and PPM) at Sodankylä (02836) summer 2002 Forecast length (hours)

Temperature error of ECMWF (and PPM) at Sodankylä (02836) summer 2002 Forecast length (hours)

Error of ECMWF (and PPM) temperature forecasts (autumn stations) Forecast length (hours)

Error of HIRLAM (and PPM) temperature forecasts (spring stations) Forecast length (hours)

Error of ECMWF (and PPM) temperature forecasts (spring stations) Forecast length (hours)

Error of HIRLAM (and PPM) temperature forecasts (winter stations) Forecast length (hours)

Error of ECMWF (and PPM) temperature forecasts (winter stations) Forecast length (hours)

Residuals versus Estimates Sodankylä PPM model in Winter (00 UTC)

Error of ECMWF (and PPM) temperature forecasts (summer stations) Forecast length (hours)

Error of ECMWF (and PPM) temperature forecasts (winter stations) Forecast length (hours)

Error of HIRLAM and ECMWF (& PPM) temperature forecasts in Finland (one year, 30 stations) Forecast length (hours)

A Fuzzy system for adaptation of ECMWF T2m forecasts Ahti Sarvi Fuzzy system has been applied to correct the temperature (T 2m ) forecasts of ECMWF. These forecasts as well as HIRLAM forecasts have errors (systematic) typically in stable conditions (inversions). The objective of fuzzy system approach has been to utilize the information included in forecasts and corresponding observations by constructing a set of 2m temperature estimators based on the verifications of the most recent 27 successive 10 day forecasts. The set of estimates given by these estimators may involve missing values and outliers, but in fuzzy set approach these contradictions in the data do not cause problems provided that the amount of the information included in the set of estimates input to the system is sufficient.

A Fuzzy system for adaptation of ECMWF T2m forecasts In an iterative solution process of fuzzy system a membership function, the values of which are normalized between zero and one, assigns the grade of membership for each estimate and zero for messy data and thus excludes the messy data from the solution and prevents it from corrupting the final estimate given by the system. The verification results for a short test period are presented

Error of temperature forecasts (ECMWF/FUZZY_system 1-10 days mean) winter stations

Concluding remarks PPM system needs some tuning After that it may be useful in editor environment –As a new SmartTool-script –As a method within the editor Fuzzy system has to be studied further but the preliminary results look promising; However, Fuzzy system needs a lot of work compared to other methods

Reference Glahn, H.R.,1985: Statistical Weather Forecasting. Probability, Statistics and Decision Making in the Atmospheric Sciences, A.H. Murphy and R.W. Katz, Eds., Westview Press, R