Lecture 16: Hilbert-Huang Transform Background:

Slides:



Advertisements
Similar presentations
ECE 8443 – Pattern Recognition EE 3512 – Signals: Continuous and Discrete Objectives: Response to a Sinusoidal Input Frequency Analysis of an RC Circuit.
Advertisements

On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series A new application of HHT.
11/11/02 IDR Workshop Dealing With Location Uncertainty in Images Hasan F. Ates Princeton University 11/11/02.
An Introduction to HHT: Instantaneous Frequency, Trend, Degree of Nonlinearity and Non-stationarity Norden E. Huang Research Center for Adaptive Data Analysis.
Quantification of Nonlinearity and Nonstionarity Norden E. Huang With collaboration of Zhaohua Wu; Men-Tzung Lo; Wan-Hsin Hsieh; Chung-Kang Peng; Xianyao.
Properties of EMD Basis The Adaptive Basis based on and derived from the data by the empirical method satisfy nearly all the traditional requirements for.
FMRI Signal Analysis Using Empirical Mean Curve Decomposition Fan Deng Computer Science Department The University of Georgia Introduction.
Kizhner 1MAPLD 2005/1020 On the Hilbert-Huang Transform Theoretical Developments Semion Kizhner, Karin Blank, Thomas Flatley, Norden E. Huang, David Petrick.
Nonstationary Signal Processing Hilbert-Huang Transform Joseph DePasquale 22 Mar 07.
A Plea for Adaptive Data Analysis: An Introduction to HHT for Nonlinear and Nonstationary Data Norden E. Huang Research Center for Adaptive Data Analysis.
The Hilbert Transform and Empirical Mode Decomposition: Suz Tolwinski University of Arizona Program in Applied Mathematics Spring 2007 RTG Powerful Tools.
On Empirical Mode Decomposition and its Algorithms
Review of Frequency Domain
G O D D A R D S P A C E F L I G H T C E N T E R Upconversion Study with the Hilbert-Huang Transform Jordan Camp Kenji Numata John Cannizzo Robert Schofield.
A Plea for Adaptive Data Analysis: Instantaneous Frequencies and Trends For Nonstationary Nonlinear Data Norden E. Huang Research Center for Adaptive Data.
The Empirical Mode Decomposition Method Sifting. Goal of Data Analysis To define time scale or frequency. To define energy density. To define joint frequency-energy.
A Confidence Limit for Hilbert Spectrum Through stoppage criteria.
Paradoxes on Instantaneous Frequency a la Leon Cohen Time-Frequency Analysis, Prentice Hall, 1995 Chapter 2: Instantaneous Frequency, P. 40.
Lecture 8: Fourier Series and Fourier Transform
Basic Concepts and Definitions Vector and Function Space. A finite or an infinite dimensional linear vector/function space described with set of non-unique.
Multi-Resolution Analysis (MRA)
Zhaohua Wu and N. E. Huang:
Introduction to Wavelets
Chapter 3 Formalism. Hilbert Space Two kinds of mathematical constructs - wavefunctions (representing the system) - operators (representing observables)
MATH 3290 Mathematical Modeling
Frequency and Instantaneous Frequency A Totally New View of Frequency.
The Analytic Function from the Hilbert Transform and End Effects Theory and Implementation.
ENSEMBLE EMPIRICAL MODE DECOMPOSITION Noise Assisted Signal Analysis (nasa) Part II EEMD Zhaohua Wu and N. E. Huang: Ensemble Empirical Mode Decomposition:
Frequency and Instantaneous Frequency A Totally New View of Frequency.
Ensemble Empirical Mode Decomposition
Function approximation: Fourier, Chebyshev, Lagrange
The Wavelet Tutorial Dr. Charturong Tantibundhit.
Sep.2008DISP Time-Frequency Analysis 時頻分析  Speaker: Wen-Fu Wang 王文阜  Advisor: Jian-Jiun Ding 丁建均 教授   Graduate.
On the relationship between C n 2 and humidity Carlos O. Font, Mark P. J. L. Chang, Erick A. Roura¹, Eun Oh and Charmaine Gilbreath² ¹Physics Department,
Fourier Series. Introduction Decompose a periodic input signal into primitive periodic components. A periodic sequence T2T3T t f(t)f(t)
E MPIRICAL M ODE D ECOMPOSITION BASED T ECHNIQUE APPLIED IN EXPERIMENTAL BIOSIGNALS Alexandros Karagiannis Mobile Radio Communications Laboratory School.
CHAPTER 4 Adaptive Tapped-delay-line Filters Using the Least Squares Adaptive Filtering.
An introduction to Empirical Mode Decomposition. The simplest model for a signal is given by circular functions of the type Such “Fourier modes” are of.
Signal and Systems Prof. H. Sameti Chapter 3: Fourier Series Representation of Periodic Signals Complex Exponentials as Eigenfunctions of LTI Systems Fourier.
On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series Norden E. Huang Research Center for Adaptive Data Analysis National.
Fourier series: Eigenfunction Approach
Course Outline (Tentative) Fundamental Concepts of Signals and Systems Signals Systems Linear Time-Invariant (LTI) Systems Convolution integral and sum.
Periodic driving forces
Chapter 2. Signals and Linear Systems
Detector Noise Characterization with the Hilbert-Huang Transform
ECE 8443 – Pattern Recognition EE 3512 – Signals: Continuous and Discrete Objectives: Eigenfunctions Fourier Series of CT Signals Trigonometric Fourier.
Chapter 2-OPTIMIZATION G.Anuradha. Contents Derivative-based Optimization –Descent Methods –The Method of Steepest Descent –Classical Newton’s Method.
Ensemble Empirical Mode Decomposition Zhaohua Wu Center for Ocean-Land-Atmosphere Studies And Norden E Huang National Central University.
Detection of Intermittent Turbulence In Stable Boundary Layer Using Empirical Mode Decomposition Xiaoning Gilliam, Christina Ho, and Sukanta Basu Texas.
An Introduction to Time-Frequency Analysis Speaker: Po-Hong Wu Advisor: Jian-Jung Ding Digital Image and Signal Processing Lab GICE, National Taiwan University.
ECE 8443 – Pattern Recognition ECE 3163 – Signals and Systems Objectives: Eigenfunctions Fourier Series of CT Signals Trigonometric Fourier Series Dirichlet.
Frequency domain analysis and Fourier Transform
The Empirical Mode Decomposition Method Sifting. Goal of Data Analysis To define time scale or frequency. To define energy density. To define joint frequency-energy.
Frequency and Instantaneous Frequency A Totally New View of Frequency.
ENSEMBLE EMPIRICAL MODE DECOMPOSITION Noise Assisted Signal Analysis (nasa) Part II EEMD Zhaohua Wu and N. E. Huang: Ensemble Empirical Mode Decomposition:
Convergence of Fourier series It is known that a periodic signal x(t) has a Fourier series representation if it satisfies the following Dirichlet conditions:
Paradoxes on Instantaneous Frequency
A Conjecture & a Theorem
Week 5 The Fourier series and transformation
OSE801 Engineering System Identification Spring 2010
Basic Filters: Basic Concepts
Computational Data Analysis
Decomposition nonstationary turbulence velocity in open channel flow
Chapter 2. Fourier Representation of Signals and Systems
UNIT II Analysis of Continuous Time signal
Notes Assignments Tutorial problems
Gary Margrave and Michael Lamoureux
LECTURE 12: SIGNAL MODULATION AND DEMODULATION
HKN ECE 210 Exam 3 Review Session
Homework 4 (Due: 27th Dec.) (1) Suppose that x(t) is a stationary random process. Which of the following function is also a stationary random process?
Presentation transcript:

Lecture 16: Hilbert-Huang Transform Background: An examination of Fourier Analysis Existing non-stationary data handling method Instantaneous frequency Intrinsic mode functions(IMF) Empirical mode decomposition(EMD) Mathematical considerations

HHT Transform Sources: Original Paper: Huang, et al. "The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis." Proc. R. Soc. Lond. A (1998) 454, 903–995 NASA: http://techtransfer.gsfc.nasa.gov/HHT/ Book: HILBERT-HUANG TRANSFORM AND ITS APPLICATIONS Ed. by Norden E Huang and Samuel S P Shen EMD code: http://perso.ens-lyon.fr/patrick.flandrin/emd.html Other goodies: http://www.mathworks.com/matlabcentral/fileexchange/21409 HHT-based Identification codes: http://hitech.technion.ac.il/feldman/

Why not the Fourier analysis (FA)? The FA performs well when the system is linear; Measure at least two output: y1(t) and y2(t) corresponding to input x1(t) and x2(t). Now apply input: x(t) = a x1(t) + b x2(t) + c x3(t) +… if the output is given by y(t) = a y1(t) + b y2(t) + c y3(t) + … then the system is deemed to be linear, And when data are periodic or stationary;

And when is the FA not so best? when data are nonstationary; the FA basis functions are global, hence they cannot treat local nonlinearity without significant dispersions (spreading); The above is especially true when the wave forms deviate significantly from sinusoidal form; For delta function-like waves, an excessive number of harmonic terms are required, let alone the Gibbs phenomena.

Nonstationary data processing methods Spectrogram Wavelets analysis Wigner-Ville distribution Evolutionary spectrum Empirical orthogonal function expansion (EOF) Smoothed moving average Trend least-squares estimation

Instantaneous Frequency Definition of Hilbert Transform: Complexification: Frequency:

Instantaneous frequency - cont’d The instantaneous frequency defined is a scalar; which means that w is a monocomponent. In reality, the signal may not represent a monocomponent. Therefore, one should interpret it as a localized frequency within a narrow band. As the concept of bandwidth plays a crucial role, we borrow its definition from the signal processing: The number of zero crossing per unit time is given by while the expected number of extrema per unit time is given by where mi is the i-th moment of the spectrum.

Instantaneous frequency - cont’d Hence, a standard bandwidth measure can be given by n2 = p2 ( N21 - N20 ) Note that if n =0, the expected numbers of extrema and zero crossings are equal. It is this observation we will exploit in the empirical mode decomposition later on. However, the instantaneous frequency defined previously still yields a global measure. Hence, when one decomposes the signal into multi-components, a key criterion is to ensure the associated frequency is locally valid. This is discussed in the next, Intrinsic Mode Functions.

Intrinsic Mode Functions (IMF) (implies oscillations embedded in the data) Suppose a function is symmetric with respect to the local zero mean, and have the same numbers of extrema and zero crossing. Then a physically meaningful local instantaneous frequency can be discerned from the function. Exploiting this concept, an intrinsic mode function satisfies the following two conditions: In the whole data set, the number of extrema and the number of zero crossings must either be equal or differ at most by one; (adaptation of narrow band concept) At any point, the mean value of the envelope defined by the local maxima and the envelope defined by the local minima is zero (new - adoption of local properties).

Intrinsic Mode Functions - Cont’d Modification of local mean: the local mean of the two envelopes defined by the local maxima and local minima - this forces the local symmetry. However, it does engender an alias in the instantaneous frequency for nonlinearly deformed waves. The IMF properties: each IMF involves only one mode of oscillation; each IMF characterizes not only a narrow band but both amplitude and frequency modulations; an IMF can thus be nonstationary.

Huang et al Statement on why IMF-based instantaneous frequency makes sense (Proc. R. Soc. Lond. A (1998), p.916):

Empirical mode decomposition method (EMD) in a nutshell EMD identifies the intrinsic oscillatory modes by their characteristic time scales in the data empirically, then decomposes the data into the corresponding IMFs via the sifting process. Thus, it is an algorithm to assign an instantaneous frequency to each IMF in order to decompose an arbitrary set of data; this means, for complex data, we can allow more than one instantaneous frequency at a time locally. In doing so we obtain IMFs as most data do not consist of IMFs. In other words, EMD decomposes an arbitrary data set, whether they are linear, nonlinear or nonstationary, into a set of IMFs.

Assumptions introduced in EMD The signal has at least two extrema - one maxima and one minima; The characteristic time scale is defined by the time lapse between the extrema; If the data is totally devoid of extrema but contained only inflection points, then it can be differentiated once or more times to reveal the extrema. Final results then can be obtained by integration(s) of the components.

The sifting process

Signal from Final Shifting for c1

Algorithmic statement of the visual process demonstrated so far 1. For data X(t), we mark the local maxima and local minima, and interpolate the extrema points via, e.g., splines to obtain upper And lower envelopes. 2. Obtain the mean of the two envelopes, m1 . 3. Obtain h1 = X(t) - m1 and inspect whether the the number of extrema and the number of zero crossings must either be equal or differ at most by one. Plus, inspect whether all the local maxima are positive and all the local minima are negative. 3. If not, repeat the sifting process and obtain h1 - m11 = h11. and repeat to obtain h1(k-1) - m1k = h1k

Algorithmic statement - cont’d If h1k constitutes an IMF, then designate it c1 = h1k. Now we obtain the first residual r1 via r1 = X(t) - c1 Treat r1 as a new data set, and perform the sifting process to obtain c2. Continuing the sifting process we obtain r2 = r1 - c2, …, rn-1 - cn = rn. Finally, the original signal is decomposed in terms of IMFs:

Hilbert-Huang Transform (HHT) for Nonlinearity Detection

HHT - Cont’d The nonlinear and non-stationary time series signal reconstructed via the HHT are: complete by employing its stopping criterion; nearly orthogonal; local; and, highly adaptive. We label these properties into one phrase COLA. We will now introduce the HHT via the example problem used by Huang and et al.

1. The signal has at least one maximum and one minimum; HHT - Cont’d The Sifting Process Assumptions introduced (Huang et al, 1998): 1. The signal has at least one maximum and one minimum; 2. The characteristic time scale is defined by the time lapse between the extrema; 3. If the data were totally devoid of extrema but contained only inflection points, then it can be differentiated once or more times to reveal extrema; and, final results can be obtained by integration(s) of the components.

In addition to the above assumptions, they imposed a restriction The Sifting Process Restriction imposed (Huang et al, 1998): HHT - Cont’d In addition to the above assumptions, they imposed a restriction that the the resulting intrinsic mode functions (IMF) be symmetric locally with respect to the zero mean level. This restriction implies the IMFs have the same numbers of zero-crossings and extrema. This restriction then allows one to define the instantaneous frequency for each of the decomposed IMFs. In other words, an IMF satisfies: in the whole data set, the number of extrema and the number of zero-crossings must be either the same or differ at most by one; (2) at any point, the mean value of the envelope defined by the local maxima and the envelope defined by the local minima is zero.

The first condition is similar to the narrow band requirement for The Sifting Process Restriction imposed (Huang et al, 1998): HHT - Cont’d The first condition is similar to the narrow band requirement for a stationary Gaussian process. The second one, however, modifies the classical global zero-mean requirement to a local one. It is this very second property that goes with the concept of the instantaneous frequency that is valid for nonstationary process and nonlinear signals. From the context of signal processing, the second property allows us to avoid a local-averaging time scale altogether. Invoking the above assumptions and restriction, Huang et al showed that their empirical mode decomposition (EMD) can identify the intrinsic oscillatory modes by their characteristic time scales in the data.

Example Problem: Tone plus Chirp Oscillation (Source: Gabriel.Rilling (at) ens-lyon.fr http://perso.ens-lyon.fr/patrick.flandrin/emd.html)

Mark the maxima

Interpolate the maxima by cubic splines Repeat the minima by cubic splines

Obtain the local mean curve, m1 Obtain the residue, r1 = x - m1

Iterate on h1 if it violates the assumptions and restrictions

Nontrivial Example

Converged h1 after 9 iterations

Intrinsic Filtering Capability

Completeness Demonstration

Why the Hilbert Transform?

Back to HHT mathematics: The Hilbert Transform and Instantaneous Frequency For an arbitrary time series, x(t), its Hilbert transform, y(t), is defined as where PV indicates the Cauchy principal value.

The Hilbert Spectrum The Hilbert spectrum: a three-dimensional plot of the amplitude aj(t) vs time (t) and the instantaneous frequency wj(t), designated as H(w,t) ,either for each amplitude or the sum of all the amplitudes.

Utilizations of the Hilbert Spectrum

Comparison of Hilbert Spectrum

How good is the instantaneous frequency? Duffing Equation:

Example 2: Period doubling of