Daily Stew Kickoff – 27. January 2011 First Results of the Daily Stew Project Ralf Lindau.

Slides:



Advertisements
Similar presentations
Spatial point patterns and Geostatistics an introduction
Advertisements

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Surrogates and Kriging Part I: Kriging Ralf Lindau.
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
3.2 OLS Fitted Values and Residuals -after obtaining OLS estimates, we can then obtain fitted or predicted values for y: -given our actual and predicted.
Budapest May 27, 2008 Unifying mixed linear models and the MASH algorithm for breakpoint detection and correction Anders Grimvall, Sackmone Sirisack, Agne.
Prediction, Correlation, and Lack of Fit in Regression (§11. 4, 11
SPATIAL DATA ANALYSIS Tony E. Smith University of Pennsylvania Point Pattern Analysis Spatial Regression Analysis Continuous Pattern Analysis.
Break Position Errors in Climate Records Ralf Lindau & Victor Venema University of Bonn Germany.
Metrics, Algorithms & Follow-ups Profile Similarity Measures Cluster combination procedures Hierarchical vs. Non-hierarchical Clustering Statistical follow-up.
Lecture 9 Inexact Theories. Syllabus Lecture 01Describing Inverse Problems Lecture 02Probability and Measurement Error, Part 1 Lecture 03Probability and.
Linear Methods for Regression Dept. Computer Science & Engineering, Shanghai Jiao Tong University.
Diplomanden-Doktoranden-Seminar Bonn – 23 June 2008 LandCaRe 2020 Dynamical and Statistical Downscaling Ralf Lindau.
Diplomanden-Doktoranden-Seminar Bonn, now Cologne – 8 Januar 2007 CMSAF water vapour in comparison to radiosondes and CHAMP Ralf Lindau.
Chapter 13 Forecasting.
Measuring Soil Water Contents at Different Scales – FZ Jülich – 17 th November 2005 Global estimation of the 1-m soil water content using microwave measurements.
Diplomanden-Doktoranden-Seminar Bonn – 18. Mai 2008 LandCaRe 2020 Temporal downscaling of heavy precipitation and some general thoughts about downscaling.
Prediction and model selection
CMSAF 2 nd CMSAF U&T Workshop – Nürnberg, 30. August 2005 Optimal Merging of Water Vapour Retrievals from Different Instruments Ralf Lindau Bonn University.
Ordinary Kriging Process in ArcGIS
7. Homogenization Seminar Budapest – October 2011 What is the correct number of break points hidden in a climate record? Ralf Lindau Victor Venema.
Diplomanden-Doktoranden-Seminar Bonn – 18. Januar 2010 Kriging Connection between Stepwise Kriging and Data Construction and Stepwise Kriging of Victorian.
Lecture II-2: Probability Review
Constant process Separate signal & noise Smooth the data: Backward smoother: At any give T, replace the observation yt by a combination of observations.
Two and a half problems in homogenization of climate series concluding remarks to Daily Stew Ralf Lindau.
Geo479/579: Geostatistics Ch13. Block Kriging. Block Estimate  Requirements An estimate of the average value of a variable within a prescribed local.
Understanding Multivariate Research Berry & Sanders.
CPE 619 Simple Linear Regression Models Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The University of Alabama.
Nynke Hofstra and Mark New Oxford University Centre for the Environment Trends in extremes in the ENSEMBLES daily gridded observational datasets for Europe.
Spatial Interpolation of monthly precipitation by Kriging method
Detection of inhomogeneities in Daily climate records to Study Trends in Extreme Weather Detection of Breaks in Random Data, in Data Containing True Breaks,
Instrumentation (cont.) February 28 Note: Measurement Plan Due Next Week.
Time Series Data Analysis - I Yaji Sripada. Dept. of Computing Science, University of Aberdeen2 In this lecture you learn What are Time Series? How to.
On the multiple breakpoint problem and the number of significant breaks in homogenisation of climate records Separation of true from spurious breaks Ralf.
DDS – 12. December 2011 What is the correct number of break points hidden in a climate record?
Various topics Petter Mostad Overview Epidemiology Study types / data types Econometrics Time series data More about sampling –Estimation.
Breaks in Daily Climate Records Ralf Lindau University of Bonn Germany.
Time Series Analysis and Forecasting
By: Amani Albraikan.  Pearson r  Spearman rho  Linearity  Range restrictions  Outliers  Beware of spurious correlations….take care in interpretation.
Lesson Multiple Regression Models. Objectives Obtain the correlation matrix Use technology to find a multiple regression equation Interpret the.
Quality control and homogenization of the COST benchmark dataset Petr Štěpánek Pavel Zahradníček Czech Hydrometeorological Institute, regional office Brno.
Quality control of daily data on example of Central European series of air temperature, relative humidity and precipitation P. Štěpánek (1), P. Zahradníček.
Interpreting Principal Components Simon Mason International Research Institute for Climate Prediction The Earth Institute of Columbia University L i n.
Wobbles, humps and sudden jumps1 Transitions in time: what to look for and how to describe them …
7. Homogenization Seminar Budapest – 24. – 27. October 2011 What is the correct number of break points hidden in a climate record? Ralf Lindau Victor Venema.
Winter-Quiz- Intermezzo On each slide you will find a screenshot from R-studio / or some previous theoretical statistical class material. You can find.
D11 Summary: The need for downscaling of extremes: An evaluation of interannual variations in the NCEP reanalysis over European regions.
On the reliability of using the maximum explained variance as criterion for optimum segmentations Ralf Lindau & Victor Venema University of Bonn Germany.
1  The Problem: Consider a two class task with ω 1, ω 2   LINEAR CLASSIFIERS.
Time Series Analysis and Forecasting. Introduction to Time Series Analysis A time-series is a set of observations on a quantitative variable collected.
Local Predictability of the Performance of an Ensemble Forecast System Liz Satterfield and Istvan Szunyogh Texas A&M University, College Station, TX Third.
1 BABS 502 Moving Averages, Decomposition and Exponential Smoothing Revised March 14, 2010.
Correction of spurious trends in climate series caused by inhomogeneities Ralf Lindau.
1 Detection of discontinuities using an approach based on regression models and application to benchmark temperature by Lucie Vincent Climate Research.
The joint influence of break and noise variance on break detection Ralf Lindau & Victor Venema University of Bonn Germany.
Computacion Inteligente Least-Square Methods for System Identification.
Measures of Dispersion Advanced Higher Geography Statistics.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
Geology 5670/6670 Inverse Theory 6 Feb 2015 © A.R. Lowry 2015 Read for Mon 9 Feb: Menke Ch 5 (89-114) Last time: The Generalized Inverse; Damped LS The.
CPH Dr. Charnigo Chap. 11 Notes Figure 11.2 provides a diagram which shows, at a glance, what a neural network does. Inputs X 1, X 2,.., X P are.
Forecasting. Model with indicator variables The choice of a forecasting technique depends on the components identified in the time series. The techniques.
Lecture 9 Forecasting. Introduction to Forecasting * * * * * * * * o o o o o o o o Model 1Model 2 Which model performs better? There are many forecasting.
Break and Noise Variance
The break signal in climate records: Random walk or random deviations
Adjustment of Temperature Trends In Landstations After Homogenization ATTILAH Uriah Heat Unavoidably Remaining Inaccuracies After Homogenization Heedfully.
Interpreting Principal Components
Dipdoc Seminar – 15. October 2018
Simple Linear Regression
OVERVIEW OF LINEAR MODELS
Computing and Statistical Data Analysis / Stat 7
Seasonal Forecasting Using the Climate Predictability Tool
Presentation transcript:

Daily Stew Kickoff – 27. January 2011 First Results of the Daily Stew Project Ralf Lindau

Daily Stew Kickoff – 27. January 2011 First Steps Data: Climate stations of DWD with daily data (or even 7, 14, 21 h) Although the project is focused on weather indices and extremes, we consider initially a much easier parameter: Monthly mean temperature Derive and test methods to: Create reference time series Differences between a station and its reference are expected be zero Detect breaks Maximize the external variance by a minimum of breaks

Daily Stew Kickoff – 27. January 2011 DWD Climate Stations Stations in total, but not coexistent. 1900: : : : 600

Daily Stew Kickoff – 27. January 2011 Kriging Approach n observations x i at the locations P i are given. Perform a prediction x 0 for the location P 0, where no obs is available. Construct the prediction by a weighted average of the observations x i. Take into account the observation errors  x i. Determine the weights i.

Daily Stew Kickoff – 27. January 2011 Matrix and Input Correlations The spatial autocorrelation is dervided from all available data for each of the 12 months. High correlations for monthly mean temperature.

Daily Stew Kickoff – 27. January 2011 Potsdam and Reference A reference for each station is created by kriging of the surrounding 16 stations. Normalized temperature anomaly in January for station Potsdam. Station and Reference seems to be nearly identical.

Daily Stew Kickoff – 27. January 2011 Potsdam and Reference A reference for each station is created by kriging of the surrounding 16 stations. Normalized temperature anomaly in January for station Potsdam. Station and Reference seems to be nearly identical. However, there is a difference showing a positive trend from 1930 to 2000

Daily Stew Kickoff – 27. January 2011 Defining breaks Breaks are defined by abrupt changes in the station-reference time series. Internal variance within the subperiods External variance between the means of different subperiods Maximize the external variance by a minimum number of breaks

Daily Stew Kickoff – 27. January 2011 Decomposition of Variance m years N subperiods n k members The external variance is a weighted measure for the variability of the subperiods‘ means. The internal variance contains information about the error of the subperiods‘ means. The seeming external variance has to be diminished by this error to obtain the true external variance.

Daily Stew Kickoff – 27. January 2011 Break Criterion The true external variance is used as criterion for breaks.

Daily Stew Kickoff – 27. January 2011 The first break The difference time series increase from 1930 to 2000 (as already shown) Between 1965 and 1985 the criterion reaches maximum values. More than 20% of the total variance can be explained by a break in one of these years criterion time series

Daily Stew Kickoff – 27. January 2011 Break Searching Method Now the first break is not simply fixed where the maximum criterion occured (1970). But combinations of two breaks are tested which contain one of the 10 best first-break candidates (10 times 100 permutations). The 10 best two-breaks combinations are used as seed for the search of three-breaks combinations.

Daily Stew Kickoff – 27. January The second break

Daily Stew Kickoff – 27. January Break

Daily Stew Kickoff – 27. January Breaks

Daily Stew Kickoff – 27. January Breaks

Daily Stew Kickoff – 27. January Breaks Where to stop? The searching method is applied to a random time series to define a stop criterion

Daily Stew Kickoff – 27. January 2011 Random Time Series 2 breaks 30 breaks

Daily Stew Kickoff – 27. January 2011 Decreasing of internal variance 1 to 400 breaks within 1000 years 1 to 50 breaks within 100 years The remaining internal variance shrinks rather smoothly for a 1000 years time series. Actually, we are dealing with only a 100 years time series. Similar behaviour, but less regular. Repeat the procedure 500 times and consider the change in variance for each added break.

Daily Stew Kickoff – 27. January 2011 Many Breaks for many random time series In average 6% of the variance is gained by the first breaks. The 50th break gains only 0.3% The 90 and the 95 percentile remain nearly constant at a few percent. The first step is an exception as here only 100 possibilities are tested, whereas further breaks are searched from 1000 possibilities (10 candidates times 100 years). Median 90% 95%

Daily Stew Kickoff – 27. January 2011 Observations vs Random After 4 breaks the gained variance of the observations is comparable to that found for random time series. 4 breaks are realistic for the considered station. 95% Random 90% 50% Observations

Daily Stew Kickoff – 27. January 2011 Leaving out one station January February Reference from nearest 16 stations Reference without Berlin-Dahlem

Daily Stew Kickoff – 27. January 2011 Conclusion For monthly mean temperatures of DWD climate stations A method to create reference time series is derived. A method to detect breaks in difference time series is derived.