Presentation is loading. Please wait.

Presentation is loading. Please wait.

IIT Bombay ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults.

Published byFelix Bell Modified over 8 years ago

Similar presentations

Presentation on theme: "IIT Bombay ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults."— Presentation transcript:

1 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 1 ICA 2004, Kyoto, April 4-9, 2004 / Session: SPP02, Paper No 00574 (Th.P3.17) Harmonic Plus Noise Model Based Speech Synthesis in Hindi and Pitch Modification By P.K. Lehana P.C. Pandey IIT Bombay, India http://www.ee.iitb.ac.in

2 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 2 ABSTRACT In harmonic plus noise model (HNM), each segment of speech is modeled as two bands: a lower "harmonic" part represented as amplitudes and phases of the harmonics of a fundamental and an upper noise part using an all-pole filter excited by random white noise, with dynamically varying band boundary. HNM based synthesis can be used for good quality output with relatively small number of parameters and it permits pitch and time scaling without explicit estimation of vocal tract parameters. We have investigated its use for synthesis in Hindi which has aspirated stops and lacks voiced fricatives. It was found that good quality synthesis could be carried out, including those of aspirated stops. The upper band of HNM was needed only for the palatal and alveolar fricatives. Sensitivity of output quality to the errors in glottal closure instants was studied and random perturbations exceeding 4% of the local pitch period resulted in noticeable degradation. Synthesis with pitch scaling showed that the frequency scale of the amplitudes and phases of the harmonics of the original signal needed to be modified by a speaker dependent warping function, obtained by studying the relationship between pitch frequency and formant frequencies for the three cardinal vowels spoken with different pitches.

3 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 3 OVERVIEW  Introduction  Harmonic plus noise model (HNM)  Methodology  Results  Conclusions

4 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 4 INTRODUCTION Research Objective Use of harmonic plus noise model (HNM) based pitch synchronous synthesis to study: Speech synthesis with phoneme sets in Hindi (“aspiration” a feature for stops) Effect of perturbations in glottal crossing instants (GCI’s) on speech quality, by using electroglottogram (EGG) for accurate specifications of GCI’s Speaker modification

5 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 5 HARMONIC PLUS NOISE MODEL (1/3) Harmonic plus Noise Model (HNM) of Speech (Stylianou, 1995; 2001) Speech signal divided into: Harmonic part Noise part Parameters: Max. voiced frequency V/UV & pitch Harm. ampl. & phases Noise parameters

6 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 6 HARMONIC PLUS NOISE MODEL (2/3) Analysis

7 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 7 HARMONIC PLUS NOISE MODEL (3/3) Synthesis

8 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 8 METHODOLOGY (1/3) Synthesis with Hindi Phoneme Sets Material : Recordings of speech and electroglottogram (EGG) for Isolated Vowels Syllables Words Sentences Processing : Analysis/synthesis of recorded material using HNM

9 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 9 METHODOLOGY (2/3) Effect of Pitch Perturbation on Speech Quality Material : 2-channel recording of vowels for male and female speakers Speech signal EGG from imp. glottograph Processing: – Estimation of pitch periods from speech signal EGG – Analysis of vowels for HNM parameters – Resynthesis, with 0 - 20 % perturbation in GCIs – Assessment of quality of resynthesized vowels

10 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 10 METHODOLOGY (3/3) Spectral Modifications Material : Sustained vowels at different notes by male and female speakers Processing: Study of F0 & formants in cardinal vowels Formant synthesis after interchanging the notes Scaling of HNM parameters by pitch-scaling factor

11 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 11 RESULTS (1/7) ANALYSIS/SYNTHESIS RESULTS Synthesis with Hindi Phoneme Sets All vowels and VCV natural & intelligible, if synthesized using harmonic part only, except / a∫a / and / asa / which require the noise part also. GCIs obtained from glottal signal (EGG) give better synthesis.

12 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 12 RESULTS (2/7) Example1: Synthesis of / ata / Recorded Synth. (H) Synth. (H+N)

13 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 13 RESULTS (3/7) Example2: Synthesis of /a∫a/ Recorded Synth. (H) Synth. (H+N)

14 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 14 RESULTS (4/7) Effect of Pitch Perturbation, Example: vowel / a / Recorded GCIs from Speech GCIs from EGG Syn. Syn. With  (GCI) < 4%

15 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 15 RESULTS (5/7) Effect of Pitch Perturbation on Vowel Quality Quality  (GCI) GCI’s from SpeechGCI’s from EGG Acceptable< 4 %< 6 % Noticeable degradation 4 - 8 %6 - 10 % Unacceptable> 8 %> 10 %

16 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 16 RESULTS (6/7) F0 and Formant Relations F1 monotonically increases with F0. Interchanging the notes results in unnatural output -> proper relation between F0 and F’s necessary. Speaker dependent relationship between F0 and formants.

17 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 17 RESULTS (7/7) Scaling of HNM parameters by speaker dependent scaling factor gives more natural o/p. Quality Scaling factor Natural< 1.5 Degradation1.5-2.0 Unacceptable> 2.0 Recorded / a / ( male, 117Hz) / a / pitch-scaled by 2.1

18 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 18 CONCLUSIONS Conclusions  HNM based synthesis provided good quality synthesis in Hindi.  GCI perturbations > 4 % → quality degradation. GCIs from EGG → better output, indicating HNM’s sensitivity to pitch estimation errors.  Modest pitch modification possible with linear frequency scaling of HNM parameters

19 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 19

20 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 20 ICA 2004, Kyoto, April 4-9, 2004 / Session: SPP02, Paper No 00574 (Th.P3.17) Harmonic Plus Based Speech Hindi and Pitch

21 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 21 Noise Model Synthesis in Modification

22 IIT Bombay pcpandey@ee.iitb.ac.in ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults Conclusions 22 By P.K. Lehana P.C. Pandey EE Dept, IIT Bombay, India http://www.ee.iitb.ac.in

Download ppt "IIT Bombay ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults."

Similar presentations

An Approach in Reproducing the Auto-Tune Effect Mentees: Dong-San Choi & Tejas Rawal Mentor: David Jun.

An Approach in Reproducing the Auto-Tune Effect Mentees: Dong-San Choi & Tejas Rawal Mentor: David Jun.
ON THE REPRESENTATION OF VOICE SOURCE APERIODICITIES IN THE MBE SPEECH CODING MODEL Preeti Rao and Pushkar Patwardhan Department of Electrical Engineering,

ON THE REPRESENTATION OF VOICE SOURCE APERIODICITIES IN THE MBE SPEECH CODING MODEL Preeti Rao and Pushkar Patwardhan Department of Electrical Engineering,
Vowel Formants in a Spectogram Nural Akbayir, Kim Brodziak, Sabuha Erdogan.

Vowel Formants in a Spectogram Nural Akbayir, Kim Brodziak, Sabuha Erdogan.
Analysis and Digital Implementation of the Talk Box Effect Yuan Chen Advisor: Professor Paul Cuff.

Analysis and Digital Implementation of the Talk Box Effect Yuan Chen Advisor: Professor Paul Cuff.
Liner Predictive Pitch Synchronization Voiced speech detection, analysis and synthesis Jim Bryan Florida Institute of Technology ECE5525 Final Project.

Liner Predictive Pitch Synchronization Voiced speech detection, analysis and synthesis Jim Bryan Florida Institute of Technology ECE5525 Final Project.
A System for Hybridizing Vocal Performance By Kim Hang Lau.

A System for Hybridizing Vocal Performance By Kim Hang Lau.
Prosody modification in speech signals Project by Edi Fridman & Alex Zalts supervision by Yizhar Lavner.

Prosody modification in speech signals Project by Edi Fridman & Alex Zalts supervision by Yizhar Lavner.
Page 0 of 34 MBE Vocoder. Page 1 of 34 Outline Introduction to vocoders MBE vocoder –MBE Parameters –Parameter estimation –Analysis and synthesis algorithm.

Page 0 of 34 MBE Vocoder. Page 1 of 34 Outline Introduction to vocoders MBE vocoder –MBE Parameters –Parameter estimation –Analysis and synthesis algorithm.
CENTER FOR SPOKEN LANGUAGE UNDERSTANDING 1 PREDICTION AND SYNTHESIS OF PROSODIC EFFECTS ON SPECTRAL BALANCE OF VOWELS Jan P.H. van Santen and Xiaochuan.

CENTER FOR SPOKEN LANGUAGE UNDERSTANDING 1 PREDICTION AND SYNTHESIS OF PROSODIC EFFECTS ON SPECTRAL BALANCE OF VOWELS Jan P.H. van Santen and Xiaochuan.
EE Dept., IIT Bombay Workshop “AICTE Sponsored Faculty Development Programme on Signal Processing and Applications, Dept. of Electrical.

EE Dept., IIT Bombay Workshop “AICTE Sponsored Faculty Development Programme on Signal Processing and Applications", Dept. of Electrical.
Basic Spectrogram Lab 8. Spectrograms §Spectrograph: Produces visible patterns of acoustic energy called spectrograms §Spectrographic Analysis: l Acoustic.

Basic Spectrogram Lab 8. Spectrograms §Spectrograph: Produces visible patterns of acoustic energy called spectrograms §Spectrographic Analysis: l Acoustic.
The Human Voice. I. Speech production 1. The vocal organs

The Human Voice. I. Speech production 1. The vocal organs
Itay Ben-Lulu & Uri Goldfeld Instructor : Dr. Yizhar Lavner Spring 200423/9/2004.

Itay Ben-Lulu & Uri Goldfeld Instructor : Dr. Yizhar Lavner Spring /9/2004.
G.S.MOZE COLLEGE OF ENGINNERING BALEWADI,PUNE -45.

G.S.MOZE COLLEGE OF ENGINNERING BALEWADI,PUNE -45.
Eva Björkner Helsinki University of Technology Laboratory of Acoustics and Audio Signal Processing HUT, Helsinki, Finland KTH – Royal Institute of Technology.

Eva Björkner Helsinki University of Technology Laboratory of Acoustics and Audio Signal Processing HUT, Helsinki, Finland KTH – Royal Institute of Technology.
VOICE CONVERSION METHODS FOR VOCAL TRACT AND PITCH CONTOUR MODIFICATION Oytun Türk Levent M. Arslan R&D Dept., SESTEK Inc., and EE Eng. Dept., Boğaziçi.

VOICE CONVERSION METHODS FOR VOCAL TRACT AND PITCH CONTOUR MODIFICATION Oytun Türk Levent M. Arslan R&D Dept., SESTEK Inc., and EE Eng. Dept., Boğaziçi.
Analysis and Synthesis of Shouted Speech Tuomo Raitio Jouni Pohjalainen Manu Airaksinen Paavo Alku Antti Suni Martti Vainio.

Analysis and Synthesis of Shouted Speech Tuomo Raitio Jouni Pohjalainen Manu Airaksinen Paavo Alku Antti Suni Martti Vainio.
December 2006 Cairo University Faculty of Computers and Information HMM Based Speech Synthesis Presented by Ossama Abdel-Hamid Mohamed.

December 2006 Cairo University Faculty of Computers and Information HMM Based Speech Synthesis Presented by Ossama Abdel-Hamid Mohamed.
Communications & Multimedia Signal Processing Report of Work on Formant Tracking LP Models and Plans on Integration with Harmonic Plus Noise Model Qin.

Communications & Multimedia Signal Processing Report of Work on Formant Tracking LP Models and Plans on Integration with Harmonic Plus Noise Model Qin.
EE2F1 Speech & Audio Technology Sept. 26, 2002 SLIDE 1 THE UNIVERSITY OF BIRMINGHAM ELECTRONIC, ELECTRICAL & COMPUTER ENGINEERING Digital Systems & Vision.

EE2F1 Speech & Audio Technology Sept. 26, 2002 SLIDE 1 THE UNIVERSITY OF BIRMINGHAM ELECTRONIC, ELECTRICAL & COMPUTER ENGINEERING Digital Systems & Vision.

Similar presentations

Ads by Google