Wu, Z. , N. E. Huang, S. R. Long and C. K

Slides:



Advertisements
Similar presentations
On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series A new application of HHT.
Advertisements

OSE meeting GODAE, Toulouse 4-5 June 2009 Interest of assimilating future Sea Surface Salinity measurements.
An Introduction to HHT: Instantaneous Frequency, Trend, Degree of Nonlinearity and Non-stationarity Norden E. Huang Research Center for Adaptive Data Analysis.
Norden E. Huang Research Center for Adaptive Data Analysis
Quantification of Nonlinearity and Nonstionarity Norden E. Huang With collaboration of Zhaohua Wu; Men-Tzung Lo; Wan-Hsin Hsieh; Chung-Kang Peng; Xianyao.
Properties of EMD Basis The Adaptive Basis based on and derived from the data by the empirical method satisfy nearly all the traditional requirements for.
Nonstationary Signal Processing Hilbert-Huang Transform Joseph DePasquale 22 Mar 07.
A Plea for Adaptive Data Analysis: An Introduction to HHT for Nonlinear and Nonstationary Data Norden E. Huang Research Center for Adaptive Data Analysis.
Stationarity and Degree of Stationarity
Outline Further Reading: Detailed Notes Posted on Class Web Sites Natural Environments: The Atmosphere GE 101 – Spring 2007 Boston University Myneni L29:
A Plea for Adaptive Data Analysis: Instantaneous Frequencies and Trends For Nonstationary Nonlinear Data Norden E. Huang Research Center for Adaptive Data.
The Empirical Mode Decomposition Method Sifting. Goal of Data Analysis To define time scale or frequency. To define energy density. To define joint frequency-energy.
Using observations to reduce uncertainties in climate model predictions Maryland Climate Change Workshop Prof. Daniel Kirk-Davidoff.
A Confidence Limit for Hilbert Spectrum Through stoppage criteria.
Cross-spectral analysis on Net Ecosystem Exchange: Dominant timescale and correlations among key ecosystem variables over the Ameriflux Harvard forest.
Zhaohua Wu and N. E. Huang:
Using wavelet tools to estimate and assess trends in atmospheric data NRCSE.
MATH 3290 Mathematical Modeling
What role does the Ocean play in Global Climate Change?
Global analysis of recent frequency component changes in interannual climate variability Murray Peel 1 & Tom McMahon 1 1 Civil & Environmental Engineering,
On the Marginal Hilbert Spectrum. Outline Definitions of the Hilbert Spectrum (HS) and the Marginal Hilbert Spectrum (MHS). Computation of MHS The relation.
The Analytic Function from the Hilbert Transform and End Effects Theory and Implementation.
On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series.
ENSEMBLE EMPIRICAL MODE DECOMPOSITION Noise Assisted Signal Analysis (nasa) Part II EEMD Zhaohua Wu and N. E. Huang: Ensemble Empirical Mode Decomposition:
Protecting our Health from Climate Change: a Training Course for Public Health Professionals Chapter 2: Weather, Climate, Climate Variability, and Climate.
Uncertainty of sea level rise, rankings etc. First some results on the temperature hiatus.
Paleoclimatology Why is it important? Angela Colbert Climate Modeling Group October 24, 2011.
TIME SERIES by H.V.S. DE SILVA DEPARTMENT OF MATHEMATICS
El Niño-Southern Oscillation in Tropical Column Ozone and A 3.5-year signal in Mid-Latitude Column Ozone Jingqian Wang, 1* Steven Pawson, 2 Baijun Tian,
1 Hadley Centre The Atlantic Multidecadal Oscillation: A signature of persistent natural thermohaline circulation cycles in observed climate Jeff Knight,
On the relationship between C n 2 and humidity Carlos O. Font, Mark P. J. L. Chang, Erick A. Roura¹, Eun Oh and Charmaine Gilbreath² ¹Physics Department,
Metrics for quantification of influence on climate Ayite-Lo Ajovan, Paul Newman, John Pyle, A.R. Ravishankara Co-Chairs, Science Assessment Panel July.
Influence of space climate and space weather on the Earth Tamara Kuznetsova IZMIRAN Russia Heliophysical phenomena and Earth's environment, 7-13 September.
Cooperative Research Programs (CoRP) Satellite Climate Studies Branch (SCSB) 1 1 Reconstruction of Near-Global Precipitation Variations Thomas Smith 1.
On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series Norden E. Huang Research Center for Adaptive Data Analysis National.
1 Motivation Motivation SST analysis products at NCDC SST analysis products at NCDC  Extended Reconstruction SST (ERSST) v.3b  Daily Optimum Interpolation.
Components of the Global Climate Change Process IPCC AR4.
Instrumental Surface Temperature Record Current Weather Data Sources Land vs. Ocean Patterns Instrument Siting Concerns Return Exam II For Next Class:
Wavelet Spectral Analysis Ken Nowak 7 December 2010.
Exploring the Possibility to Forecast Annual Mean Temperature with IPCC and AMIP Runs Peitao Peng Arun Kumar CPC/NCEP/NWS/NOAA Acknowledgements: Bhaskar.
Of what use is a statistician in climate modeling? Peter Guttorp University of Washington Norwegian Computing Center
Stats Term Test 4 Solutions. c) d) An alternative solution is to use the probability mass function and.
Ensemble Empirical Mode Decomposition Zhaohua Wu Center for Ocean-Land-Atmosphere Studies And Norden E Huang National Central University.
Detecting Signal from Data with Noise Xianyao Chen Meng Wang, Yuanling Zhang, Ying Feng Zhaohua Wu, Norden E. Huang Laboratory of Data Analysis and Applications,
The Empirical Mode Decomposition Method Sifting. Goal of Data Analysis To define time scale or frequency. To define energy density. To define joint frequency-energy.
ENVIRONMENTAL SCIENCE TEACHERS’ CONFERENCE ENVIRONMENTAL SCIENCE TEACHERS’ CONFERENCE, Borki Molo, Poland, 7-10 February 2007 Extreme Climatic and atmospheric.
Inhomogeneities in temperature records deceive long-range dependence estimators Victor Venema Olivier Mestre Henning W. Rust Presentation is based on:
ENSEMBLE EMPIRICAL MODE DECOMPOSITION Noise Assisted Signal Analysis (nasa) Part II EEMD Zhaohua Wu and N. E. Huang: Ensemble Empirical Mode Decomposition:
Analyzing circadian expression data by harmonic regression based on autoregressive spectral estimation Rendong Yang and Zhen Su Division of Bioinformatics,
Decadal Variability in the Southern Hemisphere Xiaojun Yuan 1 and Emmi Yonekura 2 1 Lamont-Doherty Earth Observatory Columbia University 2 Department Environment.
Zachos et al., 2001 CHALLENGE ONE Background: Global deep-sea oxygen (δ 18 O) and carbon (δ 13 C) isotopes from sediment cores taken from the bottom of.
Energy Consumption Forecast Using JMP® Pro 11 Time Series Analysis
Lecture 16: Hilbert-Huang Transform Background:
Global Impacts and Consequences of Climate Change
Assembled by Brenda Ekwurzel
Correlations between Atlantic SST and drought conditions
Instrumental Surface Temperature Record
The Pacific Decadal Oscillation, or PDO, is a long-lived El Niño-like pattern of Pacific climate variability. The PDO pattern [is] marked by widespread.
Dynamics of ENSO Complexity and Sensitivity
Intergovernmental Panel on Climate Change
Workshop 1: GFDL (Princeton), June 1-2, 2006
Instrumental Surface Temperature Record
Atlantic Ocean Forcing of North American and European Summer Climate
20th Century Sahel Rainfall Variability in IPCC Model Simulations and Future Projection Mingfang Ting With Yochanan Kushnir, Richard Seager, Cuihua Li,
Globale Mitteltemperatur
Slides for GGR 314, Global Warming Chapter 4: Climate Models and Projected Climatic Change Course taught by Danny Harvey Department of Geography University.
Globale Mitteltemperatur
Instrumental Surface Temperature Record
Korea Ocean Research & Development Institute, Ansan, Republic of Korea
Globale Mitteltemperatur
Presentation transcript:

On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series

Wu, Z. , N. E. Huang, S. R. Long and C. K Wu, Z., N. E. Huang, S. R. Long and C. K. Peng: On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series. Proc. Natl Acad. Sci. 140, 14,889-14,894, 2007.

Satellite Altimeter Data : Greenland

Two Sets of Data

The Need for HHT HHT is an adaptive (local, intrinsic, and objective) method to find the intrinsic local properties of the given data set, therefore, it is ideal for defining the trend and variability.

Traditional detrending Differencing, or differentiating Regression Filtering

The Residue from EMD The residue is the overall trend. The trend is derived through removal of all the oscillatory modes, not through averaging or regression, which is ad hoc and arbitrary. Trend of other time scales could be defined.

An Example of EMD Application Global Warming

IPCC Global Mean Temperature Trend

How are GSTA data derived? Noise Reduction Using Global Surface Temperature Anomaly data 1856 to 2008

Jones (2003) Monthly GSTA Data

Jones (2003) 12 Monthly GSTA Data

Jones (2003) 12 Monthly GSTA Data

Jones (2003) GSTA Data Seasonal Variation

Jones (2003) GSTA Data Seasonal Variance

Jones Monthly GSTA Data : Fourier Spectrum

Observations Annual data is actually the mean of 12:1 down sample set of the original monthly data. In spite of the removal of climatologic mean, there still is a seasonal peak (1 cycle / year). Seasonal Variation and Variance are somewhat irregular. Data contain no information beyond yearly frequency, for higher frequency part of the Fourier spectrum is essentially flat. Decide to filtered the Data with HHT before down sample.

Need a Filter to Remove Alias Traditional Fourier filter is inadequate: Removal of Harmonics will distort the fundaments Noise spikes are local in time; signals local in time have broad spectral band HHT is an adaptive filter working in time space rather than frequency space.

Jones Monthly GSTA Data : IMF

Jones Monthly GSTA Data : IMF Smoothed

Jones Monthly GSTA Data & HHT Smoothed

Jones Monthly GSTA Data : Fourier Spectrum Data & Smoothed

12 Monthly GSTA Data HHT Smoothed

Jones (2003) 12 Monthly GSTA Data

GSTA : Annual Data Jones and HHT Smoothed For the Difference : Mean = - 0.082; STD = 0.01974

GSTA : Annual Variance Jones and HHT Smoothed Mean HHT = 0 GSTA : Annual Variance Jones and HHT Smoothed Mean HHT = 0.0750; Jones = 0.1158

GSTA : HHT Smoothed Seasonal Variation

GSTA : HHT Smoothed Seasonal Variance

Summary Global Surface Temperature Anomaly should not be derived from simple annual average, because there are noises in the data. Noise with period shorter than one year could have caused alias in down sampling. Smoothing the data by removing any data with a period shorter than 8 months should improved the annual mean.

Global Climate Changes

Oxygen and Carbon records Deep sea foraminifera isotope records :Zachos et al., 2001,Science Note the Carbon concentration is not the highest during EECO!

Land Mass Distribution Geological time scale changes

J. Zachos, et al., 2001 Science, 292, 686-693.

Earth Orbital Parameters Milankovitch time scales

102 Years Our life time scale Instrument measured data, The base of IPCC AAR4 report

GSTA

IPCC Global Mean Temperature Trend

IPCC 4th Assessment Report 2007 “Note that for shorter recent periods, the slope is greater, indicating accelerated warming.” IPCC 4th Assessment Report 2007

Slope computation

Regression method is arbitrary and ad hoc. The State-of-the arts: Trend “One economist’s trend is another economist’s cycle” Engle, R. F. and Granger, C. W. J. 1991 Long-run Economic Relationships. Cambridge University Press. Regression method is arbitrary and ad hoc.

Philosophical Problem Anticipated 名不正則言不順 言不順則事不成                        ——孔夫子

On Definition Without a proper definition, On Definition Without a proper definition, logic discourse would be impossible. Without logic discourse, nothing can be accomplished. Confucius

Definition of the Trend Huang et al, Proc. Roy. Soc. Lond Definition of the Trend Huang et al, Proc. Roy. Soc. Lond., 1998 Wu et al. PNAS 2007 Within the given data span, the trend is an intrinsically fitted monotonic function, or a function in which there can be at most one extremum. The trend should be an intrinsic and local property of the data; it is determined by the same mechanisms that generate the data. Being local, it has to associate with a local length scale, and be valid only within that length span, and be part of a full wave length. The method determining the trend should be intrinsic. Being intrinsic, the method for defining the trend has to be adaptive. All traditional trend determination methods are extrinsic.

Let us use EMD to extract the trend and examine some relevant data Trend should not be determined by regressions (parametric or non-parametric), but should be determined by successively removal of oscillations. Let us use EMD to extract the trend and examine some relevant data

GSTA

AMO

Atlantic Multi-decadal Oscillation : AMO

Nature Article 1994

IMFs of GSTA

Significance Test of GSTA

IMFs of AMO

Significance Test of AMO

Mean Instantaneous Periods of IMF4 of GSTA

Mean Instantaneous Periods of IMF4 of AMO

Cross-Correlation between IMFs 4 of AMO and GSTA Blue line: correlation of annual mean of GSTA and AMO Red line: mean of correlation of each downsample of GSTA and AMO Gray line: correlation of each downsample of GSTA and AMO

Global Surface Regressions

Detailed Comparisons between GSTA and AMO Even on the noise level

Detrended GSTA

Detrended AMO

Fourier Spectra of Residues

Autocorr : Residues AMO

Autocorr : Residues GSTA

Cross-Correlation between IMFs 1-3 of AMO and GSTA (noise part) Blue line: correlation of annual mean of GSTA and AMO Red line: mean of correlation of each downsample of GSTA and AMO Gray line: correlation of each downsample of GSTA and AMO

Global Ocean Surface Regressions

The true trend with all the cycles removed The Warming Trend The true trend with all the cycles removed

Analysis of trend, rate, and acceleration of global warming Blue line is downsampling-mean of non-linear trend, i.e., last IMF. Shadow area is the STD of the non-linear trend of all downsamples.

IPCC Global Mean Temperature Trend

Comparison between non-linear rate with multi-rate of IPCC Blue shadow and blue line are the warming rate of non-linear trend. Magenta shadow and magenta line are the rate of combination of non-linear trend and AMO-like components. Dashed lines are IPCC rates.

Observations There indeed is a cycle (MDV) and a trend (ST) co-existing. The trend with ST+MDV is the same as IPCC. The true trend, ST, is not accelerating recently; the true rate is only half of what IPCC claimed. The peak of the warming wave (~ 2005) seems to be over; the temperature should decrease over the next couple of decades gradually.

The rate of warming (oC/decade) over different temporal span. Last 150 years Last 100 years Last 50 years Last 25 years AR4 0.04 0.07 0.13 0.18 ST and MDV 0.05 0.09 0.12 0.15 ST 0.08

GSAT Data and Various Trends

Annual Temperature Ranking : 2008 GISS NCDC CRU Rank 2005 1998 1 2 2002 2003 3 2007 4 2006 2004 5 6 2001 7 8 2008 1997 9 19

Summary A working definition for the trend is established; it is a function of the local time scale. Need adaptive method to analysis nonstationary and nonlinear data for trend and variability. Various definitions for variability should be compared in details to determine their significance. Predictions should be made based on processes driven models, not on data.

Conclusion Trend is a local property of the data; it should associate with a length scale. Trend should be determined adaptively; therefore, we should not pre-select the functional form of the trend. Variability should have a reference; the trend is a good reference.

Global Climate Change GCC is a scientific problem. GCC is a political problem. GCC is an economic problem. GCC is a societal problem. Let us work hard to understand it before it becomes a religious problem.

Observations The most recent 150 years climate changes could only caused partially by CO2, and partially by natural fluctuations. The recent global temperature is warming up, but the rate is only half of the alarming rate posted by IPCC in AR4. Oceans seem to play a dominate and control role for climate change with 10-103 years periods. Meanwhile, we should do our best to increase energy efficiency and reduce carbon consumption for economy and national development.