Inhomogeneities in temperature records deceive long-range dependence estimators Victor Venema Olivier Mestre Henning W. Rust Presentation is based on:

Slides:



Advertisements
Similar presentations
The new German project KLIWEX-MED: Changes in weather and climate extremes in the Mediterranean basin Andreas Paxian, University of Würzburg MedCLIVAR.
Advertisements

Biomedical Signal Processing
On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series A new application of HHT.
The Implementation of the Cornell Ionospheric Scintillation Model into the Spirent GNSS Simulator Marcio Aquino, Zeynep Elmas,
Data assimilation for validation of climate modeling systems Pierre Gauthier Department of Earth and Atmospheric Sciences Université du Québec à Montréal.
Fault-Tolerant Target Detection in Sensor Networks Min Ding +, Dechang Chen *, Andrew Thaeler +, and Xiuzhen Cheng + + Department of Computer Science,
The evaluation and optimisation of multiresolution FFT Parameters For use in automatic music transcription algorithms.
« هو اللطیف » By : Atefe Malek. khatabi Spring 90.
Statistical properties of Random time series (“noise”)
Break Position Errors in Climate Records Ralf Lindau & Victor Venema University of Bonn Germany.
A brief PPT-Introduction: Using PDFA, a novel change- point detection method, to extract sleep stage information from the heart beat statistics during.
Aspects of Conditional Simulation and estimation of hydraulic conductivity in coastal aquifers" Luit Jan Slooten.
LINEAR REGRESSION: Evaluating Regression Models Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: Evaluating Regression Models. Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: Evaluating Regression Models. Overview Standard Error of the Estimate Goodness of Fit Coefficient of Determination Regression Coefficients.
Benchmark database based on surrogate climate records Victor Venema.
1 17. Long Term Trends and Hurst Phenomena From ancient times the Nile river region has been known for its peculiar long-term behavior: long periods of.
Overview of Non-Parametric Probability Density Estimation Methods Sherry Towers State University of New York at Stony Brook.
Analyzing stochastic time series Tutorial
Tracking using the Kalman Filter. Point Tracking Estimate the location of a given point along a sequence of images. (x 0,y 0 ) (x n,y n )
TR32 time series comparison Victor Venema. Content  Jan Schween –Wind game: measurement and synthetic –Temporal resolution of 0.1 seconds  Heye Bogena.
Beyond fractals: surrogate time series and fields Victor Venema and Clemens Simmer Meteorologisches Institut, Universität Bonn, Germany Cloud measurements:
Benchmark database inhomogeneous data, surrogate data and synthetic data Victor Venema.
Statistical characteristics of surrogate data based on geophysical measurements Victor Venema 1, Henning W. Rust 2, Susanne Bachner 1, and Clemens Simmer.
On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series.
What controls the shape of a real Doppler spectrum?
Benchmark database inhomogeneous data, surrogate data and synthetic data Victor Venema.
Two and a half problems in homogenization of climate series concluding remarks to Daily Stew Ralf Lindau.
Dr. Richard Young Optronic Laboratories, Inc..  Uncertainty budgets are a growing requirement of measurements.  Multiple measurements are generally.
Critical behaviour and dynamics of Ising spin glasses Ian Campbell LCVN Universite Montpellier II Collaborations with - Helmut Katzgraber, ETH Zurich and.
10 IMSC, August 2007, Beijing Page 1 An assessment of global, regional and local record-breaking statistics in annual mean temperature Eduardo Zorita.
Soft Sensor for Faulty Measurements Detection and Reconstruction in Urban Traffic Department of Adaptive systems, Institute of Information Theory and Automation,
1 FARIMA(p,d,q) Model and Application n FARIMA Models -- fractional autoregressive integrated moving average n Generating FARIMA Processes n Traffic Modeling.
Ekapol Chuangsuwanich and James Glass MIT Computer Science and Artificial Intelligence Laboratory,Cambridge, Massachusetts 02139,USA 2012/07/2 汪逸婷.
Regional climate prediction comparisons via statistical upscaling and downscaling Peter Guttorp University of Washington Norwegian Computing Center
On the multiple breakpoint problem and the number of significant breaks in homogenisation of climate records Separation of true from spurious breaks Ralf.
Applications of Neural Networks in Time-Series Analysis Adam Maus Computer Science Department Mentor: Doctor Sprott Physics Department.
An Estimate of Contrail Coverage over the Contiguous United States David Duda, Konstantin Khlopenkov, Thad Chee SSAI, Hampton, VA Patrick Minnis NASA LaRC,
Correction of daily values for inhomogeneities P. Štěpánek Czech Hydrometeorological Institute, Regional Office Brno, Czech Republic
On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series Norden E. Huang Research Center for Adaptive Data Analysis National.
Wobbles, humps and sudden jumps1 Transitions in time: what to look for and how to describe them …
Environment Canada Environnement Canada Effects of elevated CO 2 on modelled ENSO variability Bill Merryfield Canadian Centre for Climate Modelling and.
Discussion Peter Guttorp Norwegian Computing Center University of Washington.
On the reliability of using the maximum explained variance as criterion for optimum segmentations Ralf Lindau & Victor Venema University of Bonn Germany.
Benchmark database inhomogeneous data, surrogate data and synthetic data Victor Venema.
Introduction to cloud structure generators Victor Venema — Clemens Simmer.
Local Predictability of the Performance of an Ensemble Forecast System Liz Satterfield and Istvan Szunyogh Texas A&M University, College Station, TX Third.
CHAPTER 5: Data sampling design, data quality, calibration, presentation Sampling Physical variables are continuous, but samples (water samples) and digital.
Evaluation of gene-expression clustering via mutual information distance measure Ido Priness, Oded Maimon and Irad Ben-Gal BMC Bioinformatics, 2007.
WCRP Extremes Workshop Sept 2010 Detecting human influence on extreme daily temperature at regional scales Photo: F. Zwiers (Long-tailed Jaeger)
Developing long-term homogenized climate Data sets Olivier Mestre Météo-France Ecole Nationale de la Météorologie Université Paul Sabatier, Toulouse.
ECE-7000: Nonlinear Dynamical Systems 2. Linear tools and general considerations 2.1 Stationarity and sampling - In principle, the more a scientific measurement.
Correction of spurious trends in climate series caused by inhomogeneities Ralf Lindau.
Search for bursts with the Frequency Domain Adaptive Filter (FDAF ) Sabrina D’Antonio Roma II Tor Vergata Sergio Frasca, Pia Astone Roma 1 Outlines: FDAF.
The joint influence of break and noise variance on break detection Ralf Lindau & Victor Venema University of Bonn Germany.
Quantifying efficiency of homogenisation methods Dr. Peter Domonkos COST HOME ES0601.
Testbeam analysis Lesya Shchutska. 2 beam telescope ECAL trigger  Prototype: short bars (3×7.35×114 mm 3 ), W absorber, 21 layer, 18 X 0  Readout: Signal.
Analyzing circadian expression data by harmonic regression based on autoregressive spectral estimation Rendong Yang and Zhen Su Division of Bioinformatics,
APPLICATION OF CLUSTER ANALYSIS AND AUTOREGRESSIVE NEURAL NETWORKS FOR THE NOISE DIAGNOSTICS OF THE IBR-2M REACTOR Yu. N. Pepelyshev, Ts. Tsogtsaikhan,
Wu, Z. , N. E. Huang, S. R. Long and C. K
Break and Noise Variance
The break signal in climate records: Random walk or random deviations
Volume 89, Issue 2, Pages (August 2005)
Standard Deviation and Standard Error of the Mean
LOCATION AND IDENTIFICATION OF DAMPING PARAMETERS
Adjustment of Temperature Trends In Landstations After Homogenization ATTILAH Uriah Heat Unavoidably Remaining Inaccuracies After Homogenization Heedfully.
Statistical Methods For Engineers
Modelling Pliocene warmth: how far have we come and what can we do next? Alan Haywood, Aisling Dolan, Stephen Hunter, Daniel Hill, Ulrich Salzmann, Harry.
Volume 89, Issue 2, Pages (August 2005)
Combination of Feature and Channel Compensation (1/2)
Presentation transcript:

Inhomogeneities in temperature records deceive long-range dependence estimators Victor Venema Olivier Mestre Henning W. Rust Presentation is based on: Henning Rust, Olivier Mestre, and Victor Venema. Fewer jumps, less memory: homogenized temperature records and long memory Submitted to JGR-Atmospheres

Content  Long range dependence (LRD) –What it is? –Short range dependence –Why is it important  Estimating long range dependence –FARIMA modelling, Fourier analysis –Detrended Fluctuation Analysis (DFA)  The influence of inhomogeneities on LRD –Comparison of raw and homogenised data  Homogenisation produces no artefacts –Validation on artificial data

Autocorrelation function – SRD vs. LRD

Long range dependence (LRD)  Autocorrelation function  LRD: –   (  ) =  –  (  )   -α   (2-2H),  –0.5 < H < 1  Short range dependence (SRD) –   (  ) <  –  (  )  e - ,   Spectral density  LRD: –S(  )  |  | - , |  |  0 –  = 2H - 1 –0 <  < 1 –d = H - 0.5

Example long range dependence Demetris Koutsoyiannis, The Hurst phenomenon and fractional Gaussian noise made easy, Hydrological Sciences, 47(4) August 2002.

Uncertainty in trend estimate

Inhomogeneous data and trends  LRD may lead to a higher false alarm rate (FAR) in homogenisation algorithms –Depends on physical cause of LRD  Inhomogeneities can be mistaken for a climate change signal  Inhomogeneities lead to overestimates of LRD –Artificially increase estimates of natural variability –Artificially increase the uncertainty of trend estimates

Inhomogeneous data and LRD  Most people working on LRD do not report whether their data was homogenised –Literature search: 24 articles –18 gave no information on quality –Two articles: high quality data or selected homogeneous stations –One article partially inhomogeneous –Two articles partially homogenised –One article homogenised

FARIMA - power spectrum

DFA algorithm  Cumulative sum or profile:  X t is divided in samples of length L  For every sample a linear trend is estimated and subtracted  F(L) is variance of the remaining anomaly

DFA example for one scale Peng C-K, Hausdorff JM, Goldberger AL. Fractal mechanisms in neural control: Human heartbeat and gait dynamics in health and disease. In: Walleczek J, ed. Nonlinear Dynamics, Self-Organization, and Biomedicine. Cambridge: Cambridge University Press, 1999.

DFA spectrum

Problems with DFA  H depends on subjective scaling range  No criterion for goodness of fit for DFA spectrum  Heuristic: no error estimate for H  Not robust against non-stationarities

H-estimates: raw vs. homogenised

Simulation experiment  LRD regional climate data  Added noise to obtain station data  Added inhomogeneities  Caussinus-Mestre to correct  Compared H before and after

FARIMA simulation experiment: original vs. perturbed

DFA simulation experiment: original vs. perturbed

DFA simulation experiment: original vs. homogenised

Conclusions  Inhomogeneities increase estimates of LRD –Studies on LRD should report on homogeneity –As well as other studies on slow cycles, low-frequency variability, etc.  LRD increases uncertainty of trend estimates –As well as other parameters related on slow cycles, low- frequency variability, etc.  DFA is not robust against inhomogeneities  Manuscript: venema/articles/