Properties of EMD Basis The Adaptive Basis based on and derived from the data by the empirical method satisfy nearly all the traditional requirements for.

Slides:



Advertisements
Similar presentations
On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series A new application of HHT.
Advertisements

An Introduction to HHT: Instantaneous Frequency, Trend, Degree of Nonlinearity and Non-stationarity Norden E. Huang Research Center for Adaptive Data Analysis.
Norden E. Huang Research Center for Adaptive Data Analysis
Quantification of Nonlinearity and Nonstionarity Norden E. Huang With collaboration of Zhaohua Wu; Men-Tzung Lo; Wan-Hsin Hsieh; Chung-Kang Peng; Xianyao.
What is Frequency? Norden E. Huang Research Center for Adaptive Data Analysis Center for Dynamical Biomarkers and translational Medicine National Central.
DFT/FFT and Wavelets ● Additive Synthesis demonstration (wave addition) ● Standard Definitions ● Computing the DFT and FFT ● Sine and cosine wave multiplication.
Time-Frequency Analysis of Non-stationary Phenomena in Electrical Engineering Antonio Bracale, Guido Carpinelli Universita degli Studi di Napoli “Federico.
Digital Signal Processing
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: The FIR Adaptive Filter The LMS Adaptive Filter Stability and Convergence.
AMI 4622 Digital Signal Processing
Data mining and statistical learning - lecture 6
Nonstationary Signal Processing Hilbert-Huang Transform Joseph DePasquale 22 Mar 07.
A Plea for Adaptive Data Analysis: An Introduction to HHT for Nonlinear and Nonstationary Data Norden E. Huang Research Center for Adaptive Data Analysis.
The Hilbert Transform and Empirical Mode Decomposition: Suz Tolwinski University of Arizona Program in Applied Mathematics Spring 2007 RTG Powerful Tools.
An Adaptive Data Analysis Method with Some Biomedical Applications Norden E. Huang Research Center for Adaptive Data Analysis National Central University.
Stationarity and Degree of Stationarity
G O D D A R D S P A C E F L I G H T C E N T E R Upconversion Study with the Hilbert-Huang Transform Jordan Camp Kenji Numata John Cannizzo Robert Schofield.
A Plea for Adaptive Data Analysis An Introduction to HHT Norden E. Huang Research Center for Adaptive Data Analysis National Central University.
An Introduction to HHT for Nonlinear and Nonstationary Time Series Analysis: A Plea for Adaptive Data Analysis Norden E. Huang Research Center for Adaptive.
Curve-Fitting Regression
A Plea for Adaptive Data Analysis: Instantaneous Frequencies and Trends For Nonstationary Nonlinear Data Norden E. Huang Research Center for Adaptive Data.
The Empirical Mode Decomposition Method Sifting. Goal of Data Analysis To define time scale or frequency. To define energy density. To define joint frequency-energy.
A Confidence Limit for Hilbert Spectrum Through stoppage criteria.
Paradoxes on Instantaneous Frequency a la Leon Cohen Time-Frequency Analysis, Prentice Hall, 1995 Chapter 2: Instantaneous Frequency, P. 40.
Introduction : Time-Frequency Analysis HHT, Wigner-Ville and Wavelet.
An Introduction to Hilbert-Huang Transform: A Plea for Adaptive Data Analysis Norden E. Huang Research Center for Adaptive Data Analysis National Central.
Basic Concepts and Definitions Vector and Function Space. A finite or an infinite dimensional linear vector/function space described with set of non-unique.
Multi-Resolution Analysis (MRA)
On the Marginal Hilbert Spectrum. Outline Definitions of the Hilbert Spectra (HS) and the Marginal Hilbert Spectra (MHS). Computation of MHS The relation.
ECE Spring 2010 Introduction to ECE 802 Selin Aviyente Associate Professor.
Zhaohua Wu and N. E. Huang:
MATH 3290 Mathematical Modeling
On the Marginal Hilbert Spectrum. Outline Definitions of the Hilbert Spectrum (HS) and the Marginal Hilbert Spectrum (MHS). Computation of MHS The relation.
Frequency and Instantaneous Frequency A Totally New View of Frequency.
The Analytic Function from the Hilbert Transform and End Effects Theory and Implementation.
On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series.
ENSEMBLE EMPIRICAL MODE DECOMPOSITION Noise Assisted Signal Analysis (nasa) Part II EEMD Zhaohua Wu and N. E. Huang: Ensemble Empirical Mode Decomposition:
Frequency and Instantaneous Frequency A Totally New View of Frequency.
Chapter 5 Solutions for Interacting Waves Using A MCM 5.1 Governing Equations and Hierarchy Eq.s 5.2 An Example of Applying A Mode Coupling Method (MCM)
Statistical Methods for long-range forecast By Syunji Takahashi Climate Prediction Division JMA.
Ensemble Empirical Mode Decomposition
Sep.2008DISP Time-Frequency Analysis 時頻分析  Speaker: Wen-Fu Wang 王文阜  Advisor: Jian-Jiun Ding 丁建均 教授   Graduate.
Time Series Data Analysis - I Yaji Sripada. Dept. of Computing Science, University of Aberdeen2 In this lecture you learn What are Time Series? How to.
On the relationship between C n 2 and humidity Carlos O. Font, Mark P. J. L. Chang, Erick A. Roura¹, Eun Oh and Charmaine Gilbreath² ¹Physics Department,
Curve-Fitting Regression
E MPIRICAL M ODE D ECOMPOSITION BASED T ECHNIQUE APPLIED IN EXPERIMENTAL BIOSIGNALS Alexandros Karagiannis Mobile Radio Communications Laboratory School.
An introduction to Empirical Mode Decomposition. The simplest model for a signal is given by circular functions of the type Such “Fourier modes” are of.
On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series Norden E. Huang Research Center for Adaptive Data Analysis National.
Modern Navigation Thomas Herring MW 11:00-12:30 Room
CCN COMPLEX COMPUTING NETWORKS1 This research has been supported in part by European Commission FP6 IYTE-Wireless Project (Contract No: )
Detector Noise Characterization with the Hilbert-Huang Transform
Vibrationdata 1 Unit 6a The Fourier Transform. Vibrationdata 2 Courtesy of Professor Alan M. Nathan, University of Illinois at Urbana-Champaign.
Estimating the uncertainties in the products of inversion algorithms or, how do we set the error bars for our inversion results? Emmanuel Boss, U. of Maine.
ECE 8443 – Pattern Recognition EE 3512 – Signals: Continuous and Discrete Objectives: Eigenfunctions Fourier Series of CT Signals Trigonometric Fourier.
ACCESS IC LAB Graduate Institute of Electronics Engineering, NTU Hilbert-Huang Transform(HHT) Presenter: Yu-Hao Chen ID:R /05/07.
Ensemble Empirical Mode Decomposition Zhaohua Wu Center for Ocean-Land-Atmosphere Studies And Norden E Huang National Central University.
Detection of Intermittent Turbulence In Stable Boundary Layer Using Empirical Mode Decomposition Xiaoning Gilliam, Christina Ho, and Sukanta Basu Texas.
An Introduction to Time-Frequency Analysis Speaker: Po-Hong Wu Advisor: Jian-Jung Ding Digital Image and Signal Processing Lab GICE, National Taiwan University.
ECE 8443 – Pattern Recognition ECE 3163 – Signals and Systems Objectives: Eigenfunctions Fourier Series of CT Signals Trigonometric Fourier Series Dirichlet.
Introduction to HHT for Nonlinear and Nonstationary Time Series Analysis: A Plea for Adaptive Data Analysis Norden E. Huang Research Center for Adaptive.
The Empirical Mode Decomposition Method Sifting. Goal of Data Analysis To define time scale or frequency. To define energy density. To define joint frequency-energy.
Frequency and Instantaneous Frequency A Totally New View of Frequency.
ENSEMBLE EMPIRICAL MODE DECOMPOSITION Noise Assisted Signal Analysis (nasa) Part II EEMD Zhaohua Wu and N. E. Huang: Ensemble Empirical Mode Decomposition:
Empirical Mode Decomposition of Geophysical Well log Data of Bombay Offshore Basin, Mumbai, India Gaurav S. Gairola and E. Chandrasekhar Department of.
Paradoxes on Instantaneous Frequency
Lecture 16: Hilbert-Huang Transform Background:
A Conjecture & a Theorem
Wu, Z. , N. E. Huang, S. R. Long and C. K
Decomposition nonstationary turbulence velocity in open channel flow
Chapter 8 The Discrete Fourier Transform
Presentation transcript:

Properties of EMD Basis The Adaptive Basis based on and derived from the data by the empirical method satisfy nearly all the traditional requirements for basis empirically and a posteriori: Complete Convergent Orthogonal Unique

The combination of Hilbert Spectral Analysis and Empirical Mode Decomposition has been designated by NASA as HHT (HHT vs. FFT)

Comparison between FFT and HHT

Comparisons: Fourier, Hilbert & Wavelet

Surrogate Signal: Non-uniqueness signal vs. Spectrum I. Hello

The original data : Hello

The IMF of original data : Hello

The surrogate data : Hello

The IMF of Surrogate data : Hello

The Hilbert spectrum of original data : Hello

The Hilbert spectrum of Surrogate data : Hello

To quantify nonlinearity we also need instantaneous frequency. Additionally

How to define Nonlinearity? How to quantify it through data alone (model independent)?

The term, ‘Nonlinearity,’ has been loosely used, most of the time, simply as a fig leaf to cover our ignorance. Can we be more precise?

How is nonlinearity defined? Based on Linear Algebra: nonlinearity is defined based on input vs. output. But in reality, such an approach is not practical: natural system are not clearly defined; inputs and out puts are hard to ascertain and quantify. Furthermore, without the governing equations, the order of nonlinearity is not known. In the autonomous systems the results could depend on initial conditions rather than the magnitude of the ‘inputs.’ The small parameter criteria could be misleading: sometimes, the smaller the parameter, the more nonlinear.

Linear Systems Linear systems satisfy the properties of superposition and scaling. Given two valid inputs to a system H, as well as their respective outputs then a linear system, H, must satisfy for any scalar values α and β.

How is nonlinearity defined? Based on Linear Algebra: nonlinearity is defined based on input vs. output. But in reality, such an approach is not practical: natural system are not clearly defined; inputs and out puts are hard to ascertain and quantify. Furthermore, without the governing equations, the order of nonlinearity is not known. In the autonomous systems the results could depend on initial conditions rather than the magnitude of the ‘inputs.’ The small parameter criteria could be misleading: sometimes, the smaller the parameter, the more nonlinear.

How should nonlinearity be defined? The alternative is to define nonlinearity based on data characteristics: Intra-wave frequency modulation. Intra-wave frequency modulation is known as the harmonic distortion of the wave forms. But it could be better measured through the deviation of the instantaneous frequency from the mean frequency (based on the zero crossing period).

Characteristics of Data from Nonlinear Processes

Duffing Pendulum x

Duffing Equation : Data

Hilbert ’ s View on Nonlinear Data Intra-wave Frequency Modulation

A simple mathematical model

Duffing Type Wave Data: x = cos(wt+0.3 sin2wt)

Duffing Type Wave Perturbation Expansion

Duffing Type Wave Wavelet Spectrum

Duffing Type Wave Hilbert Spectrum

Degree of nonlinearity

Degree of Nonlinearity DN is determined by the combination of δη precisely with Hilbert Spectral Analysis. Either of them equals zero means linearity. We can determine δ and η separately: –η can be determined from the instantaneous frequency modulations relative to the mean frequency. –δ can be determined from DN with known η. NB: from any IMF, the value of δη cannot be greater than 1. The combination of δ and η gives us not only the Degree of Nonlinearity, but also some indications of the basic properties of the controlling Differential Equation, the Order of Nonlinearity.

Stokes Models

Data and IFs : C1

Summary Stokes I

Lorenz Model Lorenz is highly nonlinear; it is the model equation that initiated chaotic studies. Again it has three parameters. We decided to fix two and varying only one. There is no small perturbation parameter. We will present the results for ρ=28, the classic chaotic case.

Phase Diagram for ro=28

X-Component DN1= CDN=0.5027

Data and IF

Comparisons FourierWaveletHilbert Basisa priori Adaptive FrequencyIntegral transform: Global Integral transform: Regional Differentiation: Local PresentationEnergy-frequencyEnergy-time- frequency Nonlinearno yes, quantifying Non-stationarynoyesYes, quantifying Uncertaintyyes no Harmonicsyes no

How to define and determine Trend ? Parametric or Non-parametric? Intrinsic vs. extrinsic approach?

The State-of-the arts: Trend “ One economist ’ s trend is another economist ’ s cycle ” Watson : Engle, R. F. and Granger, C. W. J Long-run Economic Relationships. Cambridge University Press.

Philosophical Problem Anticipated 名不正則言不順 言不順則事不成 —— 孔夫子

Definition of the Trend Proceeding Royal Society of London, 1998 Proceedings of National Academy of Science, 2007 Within the given data span, the trend is an intrinsically fitted monotonic function, or a function in which there can be at most one extremum. The trend should be an intrinsic and local property of the data; it is determined by the same mechanisms that generate the data. Being local, it has to associate with a local length scale, and be valid only within that length span, and be part of a full wave length. The method determining the trend should be intrinsic. Being intrinsic, the method for defining the trend has to be adaptive. All traditional trend determination methods are extrinsic.

Algorithm for Trend Trend should be defined neither parametrically nor non-parametrically. It should be the residual obtained by removing cycles of all time scales from the data intrinsically. Through EMD.

Global Temperature Anomaly Annual Data from 1856 to 2003

GSTA

IMF Mean of 10 Sifts : CC(1000, I)

Statistical Significance Test

IPCC Global Mean Temperature Trend

Comparison between non-linear rate with multi-rate of IPCC Blue shadow and blue line are the warming rate of non-linear trend. Magenta shadow and magenta line are the rate of combination of non-linear trend and AMO-like components. Dashed lines are IPCC rates.

Conclusion With HHT, we can define the true instantaneous frequency and extract trend from any data. We can quantify the degree of nonlinearity. Among the applications, the degree of nonlinearity could be used to set an objective criterion in biomedical and structural health monitoring, and to quantify the degree of nonlinearity in natural phenomena. We can also determine the trend, which could be used in financial as well as natural sciences. These are all possible because of adaptive data analysis method.

History of HHT 1998: The Empirical Mode Decomposition Method and the Hilbert Spectrum for Non-stationary Time Series Analysis, Proc. Roy. Soc. London, A454, The invention of the basic method of EMD, and Hilbert transform for determining the Instantaneous Frequency and energy. 1999: A New View of Nonlinear Water Waves – The Hilbert Spectrum, Ann. Rev. Fluid Mech. 31, Introduction of the intermittence in decomposition. 2003: A confidence Limit for the Empirical mode decomposition and the Hilbert spectral analysis, Proc. of Roy. Soc. London, A459, Establishment of a confidence limit without the ergodic assumption. 2004: A Study of the Characteristics of White Noise Using the Empirical Mode Decomposition Method, Proc. Roy. Soc. London, A460, Defined statistical significance and predictability.

Recent Developments in HHT 2007: On the trend, detrending, and variability of nonlinear and nonstationary time series. Proc. Natl. Acad. Sci., 104, 14, , : On Ensemble Empirical Mode Decomposition. Adv. Adaptive data Anal., 1, : On instantaneous Frequency. Adv. Adaptive Data Anal., 2, : The Time-Dependent Intrinsic Correlation Based on the Empirical Mode Decomposition. Adv. Adaptive Data Anal., : Multi-Dimensional Ensemble Empirical Mode Decomposition. Adv. Adaptive Data Anal., 3, : Degree of Nonlinearity. (Patent and Paper) 2012: Data-Driven Time-Frequency Analysis (Applied and Computational Harmonic Analysis, T. Hou and Z. Shi)

Current Efforts and Applications Non-destructive Evaluation for Structural Health Monitoring –(DOT, NSWC, DFRC/NASA, KSC/NASA Shuttle, THSR) Vibration, speech, and acoustic signal analyses –(FBI, and DARPA) Earthquake Engineering –(DOT) Bio-medical applications –(Harvard, Johns Hopkins, UCSD, NIH, NTU, VHT, AS) Climate changes –(NASA Goddard, NOAA, CCSP) Cosmological Gravity Wave –(NASA Goddard) Financial market data analysis –(NCU) Theoretical foundations –(Princeton University and Caltech)

Outstanding Mathematical Problems 1.Mathematic rigor on everything we do. (tighten the definitions of IMF,….) 2.Adaptive data analysis (no a priori basis methodology in general) 3. Prediction problem for nonstationary processes (end effects) 4. Optimization problem (the best stoppage criterion and the unique decomposition ….) 5. Convergence problem (finite step of sifting, best spline implement, …)

Do mathematical results make physical sense?

Good math, yes; Bad math,no.

The job of a scientist is to listen carefully to nature, not to tell nature how to behave. Richard Feynman To listen is to use adaptive method and let the data sing, and not to force the data to fit preconceived modes. The Job of a Scientist

All these results depends on adaptive approach. Thanks