Physical modeling of speech XV Pacific Voice Conference PVSF-PIXAR 3-11-05 Brad Story Dept. of Speech, Language and Hearing Sciences University of Arizona.

Slides:

Advertisements

Similar presentations

Advances in Speech Synthesis

Advertisements

Acoustic Characteristics of Consonants

From Resonance to Vowels March 8, 2013 Friday Frivolity Some project reports to hand back… Mystery spectrogram reading exercise: solved! We need to plan.

“Connecting the dots” How do articulatory processes “map” onto acoustic processes?

Perturbation Theory March 11, 2013 Just So You Know The Fourier Analysis/Vocal Tract exercise is due on Wednesday. Please note: don’t make too much out.

Hello, Everyone! Review questions  Give examples to show the following features that make human language different from animal communication system:

SPPA 403 Speech Science1 Unit 3 outline The Vocal Tract (VT) Source-Filter Theory of Speech Production Capturing Speech Dynamics The Vowels The Diphthongs.

ACOUSTICS OF SPEECH AND SINGING MUSICAL ACOUSTICS Science of Sound, Chapters 15, 17 P. Denes & E. Pinson, The Speech Chain (1963, 1993) J. Sundberg, The.

Basic Spectrogram Lab 8. Spectrograms §Spectrograph: Produces visible patterns of acoustic energy called spectrograms §Spectrographic Analysis: l Acoustic.

The Human Voice. I. Speech production 1. The vocal organs

ACOUSTICAL THEORY OF SPEECH PRODUCTION

The Human Voice Chapters 15 and 17. Main Vocal Organs Lungs Reservoir and energy source Larynx Vocal folds Cavities: pharynx, nasal, oral Air exits through.

Investigating The Voice. The voice follows the rules of physics… The pitch of a vocal sound is affected by the air pressure in the lungs, length and tension.

PH 105 Dr. Cecilia Vogel Lecture 14. OUTLINE  consonants  vowels  vocal folds as sound source  formants  speech spectrograms  singing.

Eva Björkner Helsinki University of Technology Laboratory of Acoustics and Audio Signal Processing HUT, Helsinki, Finland KTH – Royal Institute of Technology.

PHYS 103 lecture 29 voice acoustics. Vocal anatomy Air flow through vocal folds produces “buzzing” (like lips) Frequency is determined by thickness (mass)

Introduction to Linguistics Chapter 2: Phonetics

THE PRODUCTION OF SPEECH SOUNDS

Hossein Sameti Department of Computer Engineering Sharif University of Technology.

Vowel Acoustics, part 2 November 14, 2012 The Master Plan Acoustics Homeworks are due! Today: Source/Filter Theory On Friday: Transcription of Quantity/More.

Pitch changes result from changing the length and tension of the vocal folds The pitch you produce is based on the number of cycles (vocal fold vibrations)

Acoustics of Instruments Music Theory Class Gettysburg College.

Anatomic Aspects Larynx: Sytem of muscles, cartileges and ligaments.

1 Sounds: the building blocks of language CA461 Speech Processing 1 Lecture 2.

Chapter 2 Introduction to articulatory phonetics

Pitch changes result from changing the length and tension of the vocal folds The pitch you produce is based on the number of cycles per second Hertz (Hz)

Phonetics HSSP Week 5.

Physics 1251 The Science and Technology of Musical Sound Unit 3 Session 31 MWF The Fundamentals of the Human Voice Unit 3 Session 31 MWF The Fundamentals.

Source/Filter Theory and Vowels February 4, 2010.

LE 222 Sound and English Sound system

Speech Production1 Articulation and Resonance Vocal tract as resonating body and sound source. Acoustic theory of vowel production.

Acoustic Phonetics 3/9/00. Acoustic Theory of Speech Production Modeling the vocal tract –Modeling= the construction of some replica of the actual physical.

MUSIC 318 MINI-COURSE ON SPEECH AND SINGING

Speech Science Fall 2009 Oct 26, Consonants Resonant Consonants They are produced in a similar way as vowels i.e., filtering the complex wave produced.

Speech Science VII Acoustic Structure of Speech Sounds WS

LING 001 Introduction to Linguistics Fall 2010 Sound Structure I: Phonetics Acoustic phonetics Jan. 27.

Eva Björkner Helsinki University of Technology Laboratory of Acoustics and Audio Signal Processing HUT, Helsinki, Finland KTH – Royal Institute of Technology.

The end of vowels + The beginning of fricatives November 19, 2012.

Speech Science VI Resonances WS Resonances Reading: Borden, Harris & Raphael, p Kentp Pompino-Marschallp Reetzp

From Resonance to Vowels March 13, 2012 Fun Stuff (= tracheotomy) Peter Ladefoged: “To record the pressure of the air associated with stressed as opposed.

Fricatives November 20, 2015 The Road Ahead Formant plotting + vowel production exercises are due at 5 pm today! Monday and Wednesday of next week: fricatives,

LIN 3201 Sounds of Human Language Sayers -- Week 1 – August 29 & 31.

PHONETIC 1 MGSTER. RAMON GUERRA by: Mgster. Ramon Guerra.

Anatomy and Physiology of the Speech Mechanism. Major Biological Systems Respiratory System Laryngeal System Supralaryngeal System.

AUDITORY TRANSDUCTION SEPT 4, 2015 – DAY 6 Brain & Language LING NSCI Fall 2015.

1. SPEECH PRODUCTION MUSIC 318 MINI-COURSE ON SPEECH AND SINGING

THE SOUNDS OF LANGUAGE the study of inventory and structure of the sounds of language.  Human can produce any number of sounds including those we never.

Vowels, part 4 November 16, 2015 Just So You Know Today: Vowel remnants + Source-Filter Theory For Wednesday: vowel transcription! Turkish and British.

Speech Generation and Perception

P105 Lecture #27 visuals 20 March 2013.

Phonetics: A lecture Raung-fu Chung Southern Taiwan University

Whip Around  What 3 adjectives best describe you?  Think about this question and be prepared to share aloud with the class.

PHONETICS AND PHONOLOGY

ARTICULATORY PHONETICS

Chapter 3: The Speech Process

B. Harpsichord Strings are plucked

The Human Voice. 1. The vocal organs

P105 Lecture #26 visuals 18 March 2013.

Structure of Spoken Language

Chapter 3: The Speech Process

The Human Voice. 1. The vocal organs

Speech Generation and Perception

Speech Organs The process of producing speech

1. SPEECH PRODUCTION MUSIC 318 MINI-COURSE ON SPEECH AND SINGING

Remember me? The number of times this happens in 1 second determines the frequency of the sound wave.

The Production of Speech

Evolution of human vocal production

Speech Generation and Perception

Speech Systems/Organs Extended

Presentation transcript:

Physical modeling of speech XV Pacific Voice Conference PVSF-PIXAR Brad Story Dept. of Speech, Language and Hearing Sciences University of Arizona Tucson, AZ and voice quality

Physical model of human sound production: A mathematical representation of the physical processes that produce the sounds of speech and song.

Sound Production = Combination of Sound Sources and Filters Filter: Air spaces created by the trachea, pharynx, oral cavity, nasal passages Trachea Primary Source: Vibration of the vocal folds creates a time-varying airflow (glottal flow). Nasal tract

Source Model: vocal fold vibration, glottal area, glottal flow, etc. F0, intensity, breathy/pressed, registers, biphonation, etc. Filter Model: acoustic wave propagation through the air spaces of the trachea, vocal and nasal tracts Formant frequencies (F1, F2, F3, …) Time variation of glottal parameters Time variation of vocal tract shape speech/song/other

vocal folds output pressure Sagittal viewTubular approximation Source: glottal area/flow Low F0 Med F0 High F0

Output sound pressure Spectrogram F1 F2 F3 F0 F0 contour

Change the vocal tract shape to produce speech source filter output

Output sound pressure Spectrogram F1 F2 F3 F0 contour F0

F1 F2

Modeling Voice Quality “Voice quality is conceived here in a broad sense, as the characteristic auditory coloring of an individual speaker’s voice, and not in the more narrow sense of the quality deriving solely from laryngeal activity” From “The Phonetic Description of Voice Quality” by J. Laver (1980) What is voice quality?

Respiratory system structure & settings Laryngeal structure & settings Vocal Tract Structure & settings Temporal control Auditory coloring of an individual speaker’s voice results from:

Voice Quality Changes based on vocal tract modifications 1.Longitudinal: Modification of vocal tract length 2. Latitudinal: Tendencies to maintain a particular constrictive (or expansive) effect on the vocal tract shape.

1.Modification of vocal tract length (+ temporal modification) L= 17.5 cm

1.Modification of vocal tract length (+ temporal and F0 modification) L= 23 cm L= 17.5 cm L= 11 cm 60% 40% 80% 20%

2. Tendencies to maintain a particular constrictive (or expansive) effect on the vocal tract shape. (+ F0 contour modification) “pharyngealized” “palatized”

Beyond human voice quality… F0 = Hz Vocal tract length = 31 cm F0 = Hz Vocal tract length = 4.4 cm

Singing…?? Singer’s formant

The End This work was supported by NIH R01-DC04789