Presentation is loading. Please wait.

Presentation is loading. Please wait.

Page 0 of 14 Dynamical Invariants of an Attractor and potential applications for speech data Saurabh Prasad Intelligent Electronic Systems Human and Systems.

Published byToby Carson Modified over 9 years ago

Similar presentations

Presentation on theme: "Page 0 of 14 Dynamical Invariants of an Attractor and potential applications for speech data Saurabh Prasad Intelligent Electronic Systems Human and Systems."— Presentation transcript:

1 Page 0 of 14 Dynamical Invariants of an Attractor and potential applications for speech data Saurabh Prasad Intelligent Electronic Systems Human and Systems Engineering Department of Electrical and Computer Engineering Estimating Kolmogorov Entropy from Acoustic Attractors from a Recognition Perspective

2 Page 1 of 14 Dynamical Invariants of an Attractor and potential applications for speech data Estimating the correlation integral from a time series Correlation Integral of an attractor’s trajectory : Correlation sum of a system’s attractor is a measure quantifying the average number of neighbors in a neighborhood of radius along the trajectory. where represents the i’th point on the trajectory, is a valid norm and is the Heaviside’s unit step function (serving as a count function here) At a given embedding dimension (m > [2*D+1]), we have: ~ Fractal Dimension of the attractor

3 Page 2 of 14 Dynamical Invariants of an Attractor and potential applications for speech data order-q Renyi entropy and K2-Entropy Divide the state space into disjoint boxes If the evolution of the state space that generated the observable is sampled at Numerically, the Kolmogorov entropy can be estimated as the second order Renyi entropy (K 2 ) Represents the joint probability that lies in box i 1 lies in box i 2 and so on.

4 Page 3 of 14 Dynamical Invariants of an Attractor and potential applications for speech data Second Order Kolmogorov Entropy Estimation of speech data Speech data, sampled at 22.5 KHz – Sustained Phones (/aa/, /ae/, /eh/, /sh/, /z/, /f/, /m/, /n/) Output – Second order Kolmogorov Entropy We wish to analyze: – The presence or absence of chaos in any time series. – Their discrimination characteristics across attractors from different sound units (for classification)

5 Page 4 of 14 Dynamical Invariants of an Attractor and potential applications for speech data The analysis setup Currently, this analysis includes estimates of K2 for different embedding dimensions Variation in entropy estimates with the neighborhood radius, epsilon was studied Variation in entropy estimates with SNR of the signal was studied Currently, the analysis was performed on 3 vowels, 2 nasals and 2 fricatives Results show that vowels and nasals have a much smaller entropy, as compared to fricatives K 2 consistently decreases with embedding dimension for vowels and nasals, while for fricatives, it consistently increases

6 Page 5 of 14 Dynamical Invariants of an Attractor and potential applications for speech data The analysis setup (in progress / coming soon)… Data size (length of the time series): –This is crucial for our purpose, since we wish to extract information from short time series (sample data from utterances). Speaker variation: – We wish to study variations in the Kolmogorov entropy of phone or word level attractors across different speakers. across different phones/words across different broad phone classes

7 Page 6 of 14 Dynamical Invariants of an Attractor and potential applications for speech data Correlation Entropy vs. Embedding Dimension Various Epsilons

8 Page 7 of 14 Dynamical Invariants of an Attractor and potential applications for speech data Correlation Entropy vs. Embedding Dimension Various Epsilons

9 Page 8 of 14 Dynamical Invariants of an Attractor and potential applications for speech data Correlation Entropy vs. Embedding Dimension Various Epsilons

10 Page 9 of 14 Dynamical Invariants of an Attractor and potential applications for speech data Correlation Entropy vs. Embedding Dimension Various SNRs

11 Page 10 of 14 Dynamical Invariants of an Attractor and potential applications for speech data Correlation Entropy vs. Embedding Dimension Various Data Lengths

12 Page 11 of 14 Dynamical Invariants of an Attractor and potential applications for speech data Measuring Discrimination Information in K 2 based features Kullback-Leibler (KL) divergence: Provides an information theoretic distance measure between two statistical models Average Discriminating Information between class i and class j: Likelihood: i vs. jLikelihood: j vs. i For Normal Densities:

13 Page 12 of 14 Dynamical Invariants of an Attractor and potential applications for speech data Measuring Discrimination Information in K 2 based features Statistics of entropy estimates over several frames, for various phones

14 Page 13 of 14 Dynamical Invariants of an Attractor and potential applications for speech data Measuring Discrimination Information in K 2 based features KL-Divergence Measure between K 2 features from various phonemes for two speakers

15 Page 14 of 14 Dynamical Invariants of an Attractor and potential applications for speech data Plans Finish studying the use of K 2 entropy as a feature characterizing phone-level attractors – We will be performing a similar analysis on Lyapunov Exponents and Correlation Dimension estimates Measure speaker dependence in this invariant Use this setup on a meaningful recognition task Noise robustness, parameter tweaking, integrating these features to MFCCs Statistical Modeling…

Download ppt "Page 0 of 14 Dynamical Invariants of an Attractor and potential applications for speech data Saurabh Prasad Intelligent Electronic Systems Human and Systems."

Similar presentations

Robust Speech recognition V. Barreaud LORIA. Mismatch Between Training and Testing n mismatch influences scores n causes of mismatch u Speech Variation.

Robust Speech recognition V. Barreaud LORIA. Mismatch Between Training and Testing n mismatch influences scores n causes of mismatch u Speech Variation.
Coarticulation Analysis of Dysarthric Speech Xiaochuan Niu, advised by Jan van Santen.

Coarticulation Analysis of Dysarthric Speech Xiaochuan Niu, advised by Jan van Santen.
Multipitch Tracking for Noisy Speech

Multipitch Tracking for Noisy Speech
Forecasting using Non Linear Techniques in Time Series Analysis – Michel Camilleri – September 2004 1 FORECASTING USING NON-LINEAR TECHNIQUES IN TIME SERIES.

Forecasting using Non Linear Techniques in Time Series Analysis – Michel Camilleri – September FORECASTING USING NON-LINEAR TECHNIQUES IN TIME SERIES.
Abstract Statistical or machine-learning techniques, such as Hidden Markov models and Gaussian mixture models, have dominated the signal processing and.

Abstract Statistical or machine-learning techniques, such as Hidden Markov models and Gaussian mixture models, have dominated the signal processing and.
Motivation Traditional approach to speech and speaker recognition:

Motivation Traditional approach to speech and speaker recognition:
Shape and Dynamics in Human Movement Analysis Ashok Veeraraghavan.

Shape and Dynamics in Human Movement Analysis Ashok Veeraraghavan.
Speech Recognition. What makes speech recognition hard?

Speech Recognition. What makes speech recognition hard?
Page 0 of 8 Time Series Classification – phoneme recognition in reconstructed phase space Sanjay Patil Intelligent Electronics Systems Human and Systems.

Page 0 of 8 Time Series Classification – phoneme recognition in reconstructed phase space Sanjay Patil Intelligent Electronics Systems Human and Systems.
MODULATION SPECTRUM EQUALIZATION FOR ROBUST SPEECH RECOGNITION Source: Automatic Speech Recognition & Understanding, 2007. ASRU. IEEE Workshop on Author.

MODULATION SPECTRUM EQUALIZATION FOR ROBUST SPEECH RECOGNITION Source: Automatic Speech Recognition & Understanding, ASRU. IEEE Workshop on Author.
Speaker Adaptation for Vowel Classification

Speaker Adaptation for Vowel Classification
Speech Recognition in Noise

Speech Recognition in Noise
Object Class Recognition Using Discriminative Local Features Gyuri Dorko and Cordelia Schmid.

Object Class Recognition Using Discriminative Local Features Gyuri Dorko and Cordelia Schmid.
SNR-Dependent Mixture of PLDA for Noise Robust Speaker Verification

SNR-Dependent Mixture of PLDA for Noise Robust Speaker Verification
Why is ASR Hard? Natural speech is continuous

Why is ASR Hard? Natural speech is continuous
Acoustic and Linguistic Characterization of Spontaneous Speech Masanobu Nakamura, Koji Iwano, and Sadaoki Furui Department of Computer Science Tokyo Institute.

Acoustic and Linguistic Characterization of Spontaneous Speech Masanobu Nakamura, Koji Iwano, and Sadaoki Furui Department of Computer Science Tokyo Institute.
EE513 Audio Signals and Systems Statistical Pattern Classification Kevin D. Donohue Electrical and Computer Engineering University of Kentucky.

EE513 Audio Signals and Systems Statistical Pattern Classification Kevin D. Donohue Electrical and Computer Engineering University of Kentucky.
Nonlinear Mixture Autoregressive Hidden Markov Models for Speech Recognition S. Srinivasan, T. Ma, D. May, G. Lazarou and J. Picone Department of Electrical.

Nonlinear Mixture Autoregressive Hidden Markov Models for Speech Recognition S. Srinivasan, T. Ma, D. May, G. Lazarou and J. Picone Department of Electrical.
Normalization of the Speech Modulation Spectra for Robust Speech Recognition Xiong Xiao, Eng Siong Chng, and Haizhou Li Wen-Yi Chu Department of Computer.

Normalization of the Speech Modulation Spectra for Robust Speech Recognition Xiong Xiao, Eng Siong Chng, and Haizhou Li Wen-Yi Chu Department of Computer.
Overview of NIT HMM-based speech synthesis system for Blizzard Challenge 2011 Kei Hashimoto, Shinji Takaki, Keiichiro Oura, and Keiichi Tokuda Nagoya.

Overview of NIT HMM-based speech synthesis system for Blizzard Challenge 2011 Kei Hashimoto, Shinji Takaki, Keiichiro Oura, and Keiichi Tokuda Nagoya.

Similar presentations

Ads by Google