Presentation is loading. Please wait.

Presentation is loading. Please wait.

IIT Bombay ISTE, IITB, Mumbai, 28 March, 2003 1 SPEECH SYNTHESIS PC Pandey EE Dept IIT Bombay March ‘03.

Published byLambert Johnston Modified over 8 years ago

Similar presentations

Presentation on theme: "IIT Bombay ISTE, IITB, Mumbai, 28 March, 2003 1 SPEECH SYNTHESIS PC Pandey EE Dept IIT Bombay March ‘03."— Presentation transcript:

1 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 1 SPEECH SYNTHESIS PC Pandey EE Dept IIT Bombay March ‘03

2 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 2 Speech units Sentences & phrases Words Syllables Phonemes Subphonemic acoustic segments Speech features Prosodic (suprasegmental) features Intensity variation Pitch variation Phonemic features Articulatory Acoustic Perceptual

3 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 3 Classification of phonemes Vowels Pure vowels Diphthongs Consonants Semivowels Whisper Stops Nasals Fricatives Affricates

4 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 4 Speech production system

5 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 5 Schematic of speech production

6 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 6 Vovel spectrum

7 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 7 Speech synthesis Generation of speech by a machine Applications Voice response systems (limited vocabulary) Text-to-speech synthesis (unlimited vocabulary) Analysis-by-synthesis (speech research) Generation of speech-like test signals Analysis-synthesis systems * channel capacity reduction* secure commn. * speech enhancement * voice transformation * processing for hearing aids

8 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 8 Development of speech synthesizers Mechanical / electro-mechanical (1760-1930) Electronic analog with key-board input (1930’s) Electronic analog analysis-synthesis systems (1930-50) Digital synthesizer (1950..) * software based* hardware based

9 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 9 Mechanical synthesizers Von Kempelen, 1780 Wheatstone’s speaking machine

10 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 10 Riesz, 1930’s: Speaking machine

11 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 11 Dudley, 1930s: Voder Electronic analog synthesizer with mechanical keyboard

12 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 12 Fant, 1950s: OVE

13 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 13 Holmes, 1960s: Parallel formant synth.

14 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 14 Klatt, 1970s: Cascade/parallel formant synth.

15 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 15 Modern synthesis approaches Waveform based high quality natural output limited vocabulary large storage requirement Speech model based unlimited speech synthesis with small storage difficulty in parameter generation & concatenation Text-to-speech synthesis Text pre-processing & phonetic transcription Parsing for syntactic & semantic structure Prosodic information & Sound units Speech waveform generation

16 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 16 Speech model based approaches Articulatory Source-filter * channel vocoder * LPC vocoder * homomorphic vocoder * formant-based synthesizer Acoustic * phase vocoder * sinusoidal model * harmonic plus noise model (HNM)

17 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 17 HARMONIC PLUS NOISE MODEL (Stylianou, 1995; 2001) Speech signal divided into: harmonic part noise part Harmonic part Noise part Parameters: Harmonic amplitudes and phases max. voiced frequency V/UV & pitch noise parameters

18 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 18 IMPLEMENTATION OF HNM

19 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 19 ANALYSIS

20 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 20 SYNTHESIS

21 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 21 SEGMENT CONCATENATION For generation of longer units from smaller ones. Steps: 1) Parsing of phonetic transcript 2) Fetching the parameters of required units 3) Pitch and intensity modifications for prosody 4) Smoothening of the parameter tracts at unit boundaries 5) Interpolation of the parameters over the frame length from end point values 6) Synthesis

22 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 22 RESULTS All VCV syllables and vowels natural & intelligible if synthesized using harmonic part only, except / a∫a / and / asa / HNM preserve the styles (anger, high articulatory rate) Synthesized /a∫a/ Synthesized /asa/

23 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 23 RESULTS (continued) GCIs from glottal signal give better synthesis. Pitch contours for "/ ap kΛhœn ja rΛhE hœn /" From glottal signal From speech (Childers and Hu’s, 1994)

24 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 24 RESULTS (continued) Good quality of the larger units constructed from prarameters of the smaller units. Recorded /Λb h Imani/ Synthesized from /Λb h I/, /Ima/, /ani/

25 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 25 /a/ R HN H Cardinal Vowels /I/ R HN H /u/ R HN H R HN H R HN H Stops /a k a / /a g a/ /a k h a/ /a g h a/ Fricatives /a ∫ a / /a s a/ Affricates /a t∫ a / /a d z a/ /a t∫ h a / /a dz h a/ Word / Λb h Imani / R HN Sentence / mœn dzΛmmu ja rΛha hun / R HN DEMONSTRATIONS

26 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 26 Further developments High quality multilingual / multi-dialect text-to-speech synthesis Voice transformations Processing for aids for the hearing impaired

27 IIT Bombay pcpandey@ee.iitb.ac.in ISTE, IITB, Mumbai, 28 March, 2003 27

Download ppt "IIT Bombay ISTE, IITB, Mumbai, 28 March, 2003 1 SPEECH SYNTHESIS PC Pandey EE Dept IIT Bombay March ‘03."

Similar presentations

ON THE REPRESENTATION OF VOICE SOURCE APERIODICITIES IN THE MBE SPEECH CODING MODEL Preeti Rao and Pushkar Patwardhan Department of Electrical Engineering,

ON THE REPRESENTATION OF VOICE SOURCE APERIODICITIES IN THE MBE SPEECH CODING MODEL Preeti Rao and Pushkar Patwardhan Department of Electrical Engineering,
Normal Aspects of Articulation. Definitions Phonetics Phonology Articulatory phonetics Acoustic phonetics Speech perception Phonemic transcription Phonetic.

Normal Aspects of Articulation. Definitions Phonetics Phonology Articulatory phonetics Acoustic phonetics Speech perception Phonemic transcription Phonetic.
Acoustic Characteristics of Consonants

Acoustic Characteristics of Consonants
Speech Perception Dynamics of Speech

Speech Perception Dynamics of Speech
Speech & Audio Coding TSBK01 Image Coding and Data Compression Lecture 11, 2003 Jörgen Ahlberg.

Speech & Audio Coding TSBK01 Image Coding and Data Compression Lecture 11, 2003 Jörgen Ahlberg.
Speech Synthesis December 4, 2014 Gentle Reminders Final exam: Friday, December 12 th, 3:30 – 5:30 pm In this room! Final exam review: Wednesday, December.

Speech Synthesis December 4, 2014 Gentle Reminders Final exam: Friday, December 12 th, 3:30 – 5:30 pm In this room! Final exam review: Wednesday, December.
5-Text To Speech (TTS) Speech Synthesis

5-Text To Speech (TTS) Speech Synthesis
CENTER FOR SPOKEN LANGUAGE UNDERSTANDING 1 PREDICTION AND SYNTHESIS OF PROSODIC EFFECTS ON SPECTRAL BALANCE OF VOWELS Jan P.H. van Santen and Xiaochuan.

CENTER FOR SPOKEN LANGUAGE UNDERSTANDING 1 PREDICTION AND SYNTHESIS OF PROSODIC EFFECTS ON SPECTRAL BALANCE OF VOWELS Jan P.H. van Santen and Xiaochuan.
EE Dept., IIT Bombay Workshop “AICTE Sponsored Faculty Development Programme on Signal Processing and Applications, Dept. of Electrical.

EE Dept., IIT Bombay Workshop “AICTE Sponsored Faculty Development Programme on Signal Processing and Applications", Dept. of Electrical.
Basic Spectrogram Lab 8. Spectrograms §Spectrograph: Produces visible patterns of acoustic energy called spectrograms §Spectrographic Analysis: l Acoustic.

Basic Spectrogram Lab 8. Spectrograms §Spectrograph: Produces visible patterns of acoustic energy called spectrograms §Spectrographic Analysis: l Acoustic.
1 Frequency Domain Analysis/Synthesis Concerned with the reproduction of the frequency spectrum within the speech waveform Less concern with amplitude.

1 Frequency Domain Analysis/Synthesis Concerned with the reproduction of the frequency spectrum within the speech waveform Less concern with amplitude.
EE 225D, Section I: Broad background Synthesis/vocoding history (chaps 2&3) Recognition history (chap 4) Machine recognition basics (chap 5) Human recognition.

EE 225D, Section I: Broad background Synthesis/vocoding history (chaps 2&3) Recognition history (chap 4) Machine recognition basics (chap 5) Human recognition.
Dr. O. Dakkak & Dr. N. Ghneim: HIAST M. Abu-Zleikha & S. Al-Moubyed: IT fac., Damascus U. Prosodic Feature Introduction and Emotion Incorporation in an.

Dr. O. Dakkak & Dr. N. Ghneim: HIAST M. Abu-Zleikha & S. Al-Moubyed: IT fac., Damascus U. Prosodic Feature Introduction and Emotion Incorporation in an.
6/3/20151 Voice Transformation : Speech Morphing Gidon Porat and Yizhar Lavner SIPL – Technion IIT December 1 2002.

6/3/20151 Voice Transformation : Speech Morphing Gidon Porat and Yizhar Lavner SIPL – Technion IIT December
1st and 2nd Generation Synthesis

1st and 2nd Generation Synthesis
EE2F1 Speech & Audio Technology Sept. 26, 2002 SLIDE 1 THE UNIVERSITY OF BIRMINGHAM ELECTRONIC, ELECTRICAL & COMPUTER ENGINEERING Digital Systems & Vision.

EE2F1 Speech & Audio Technology Sept. 26, 2002 SLIDE 1 THE UNIVERSITY OF BIRMINGHAM ELECTRONIC, ELECTRICAL & COMPUTER ENGINEERING Digital Systems & Vision.
1 Interspeech Synthesis of Singing Challenge, Aug 28, 2007 Formant-based Synthesis of Singing Sten Ternström and Johan Sundberg KTH Music Acoustics, Speech.

1 Interspeech Synthesis of Singing Challenge, Aug 28, 2007 Formant-based Synthesis of Singing Sten Ternström and Johan Sundberg KTH Music Acoustics, Speech.
Introduction to Speech Synthesis ● Key terms and definitions ● Key processes in sythetic speech production ● Text-To-Phones ● Phones to Synthesizer parameters.

Introduction to Speech Synthesis ● Key terms and definitions ● Key processes in sythetic speech production ● Text-To-Phones ● Phones to Synthesizer parameters.
Synthetic Audio A Brief Historical Introduction Generating sounds Synthesis can be “additive” or “subtractive” Additive means combining components (e.g.,

Synthetic Audio A Brief Historical Introduction Generating sounds Synthesis can be “additive” or “subtractive” Additive means combining components (e.g.,
EE2F1 Speech & Audio Technology Sept. 26, 2002 SLIDE 1 THE UNIVERSITY OF BIRMINGHAM ELECTRONIC, ELECTRICAL & COMPUTER ENGINEERING Digital Systems & Vision.

EE2F1 Speech & Audio Technology Sept. 26, 2002 SLIDE 1 THE UNIVERSITY OF BIRMINGHAM ELECTRONIC, ELECTRICAL & COMPUTER ENGINEERING Digital Systems & Vision.

Similar presentations

Ads by Google