Hillenbrand: Vowels1 The Acoustics and Perception of American English Vowels.

Slides:



Advertisements
Similar presentations
Tom Lentz (slides Ivana Brasileiro)
Advertisements

Acoustic and Physiological Phonetics
Sounds that “move” Diphthongs, glides and liquids.
Human Speech Recognition Julia Hirschberg CS4706 (thanks to John-Paul Hosum for some slides)
From Resonance to Vowels March 8, 2013 Friday Frivolity Some project reports to hand back… Mystery spectrogram reading exercise: solved! We need to plan.
“Connecting the dots” How do articulatory processes “map” onto acoustic processes?
Basic Spectrogram & Clinical Application Lab 9. Spectrographic Features of Vowels n 1st formant carries much information about manner of articulation.
Acoustic Characteristics of Vowels
Vowels (again) February 23, 2010 The News For Thursday: Give me a (one paragraph or so) description of what you’re thinking of doing for a term project.
T - voicing in American English A comparison of initial d and voiced t.
Periodicity and Pitch Importance of fine structure representation in hearing.
SPEECH RECOGNITION 2 DAY 15 – SEPT 30, 2013 Brain & Language LING NSCI Harry Howard Tulane University.
Speech Science XII Speech Perception (acoustic cues) Version
Development of Speech Perception. Issues in the development of speech perception Are the mechanisms peculiar to speech perception evident in young infants?
The Perception of Speech. Speech is for rapid communication Speech is composed of units of sound called phonemes –examples of phonemes: /ba/ in bat, /pa/
Speech and speaker normalization (in vowel normalization)
PHONETICS AND PHONOLOGY
Basic Spectrogram Lab 8. Spectrograms §Spectrograph: Produces visible patterns of acoustic energy called spectrograms §Spectrographic Analysis: l Acoustic.
Effectiveness of spatial cues, prosody, and talker characteristics in selective attention C.J. Darwin & R.W. Hukin.
Static Vowels ► Diphthongs ► Semivowels ► Stops Extending SF Theory to Accommodate Articulatory Movement.
Exam 1 Monday, Tuesday, Wednesday next week WebCT testing centre Covers everything up to and including hearing (i.e. this lecture)
Neural Net Algorithms for SC Vowel Recognition Presentation for EE645 Neural Networks and Learning Algorithms Spring 2003 Diana Stojanovic.
1 Pattern Recognition (cont.). 2 Auditory pattern recognition Stimuli for audition is alternating patterns of high and low air pressure called sound waves.
SPEECH PERCEPTION The Speech Stimulus Perceiving Phonemes Top-Down Processing Is Speech Special?
Vowels Vowels: Articulatory Description (Ferrand, 2001) Tongue Position.
What is Phonetics? Short answer: The study of speech sounds in all their aspects. Phonetics is about describing speech. (Note: phonetics ¹ phonics) Phonetic.
English Phonetics and Phonology Lesson 4A
Mr Barton’s Maths Notes
CNBH, Physiology Department, Cambridge University The perception of size and sex in vowel sounds P60 David R. R. Smith and Roy.
SPEECH ARTICULATION: Vowels David Brett David Brett.
Phonological Constraints on the Acquisition of Mid Vowels in English for Students in Taiwan author: 黃俐雯 presented by Lisa Liu 報告人: 劉莉莎.
Diphthongs Five most frequent diphthongs in Māori are /ai ae au ou ao/. Mergers between /ai~ae/ and /au~ou/ [3] (Figure 2). Only one of these mergers is.
Speech Perception. Phoneme - a basic unit of a speech sound that distinguishes one word from another Phonemes do not have meaning on their own but they.
CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING Auditory Perception of Speech and the Consequences of Hearing Loss.
Vowels, part 4 March 19, 2014 Just So You Know Today: Source-Filter Theory For Friday: vowel transcription! Turkish, British English and New Zealand.
By Sarita Jondhale1 Pattern Comparison Techniques.
1 Speech Perception 3/30/00. 2 Speech Perception How do we perceive speech? –Multifaceted process –Not fully understood –Models & theories attempt to.
Transitional 1st Grade Skills Checklist – Reading 1st Quarter
Speech Perception 4/4/00.
The end of vowels + The beginning of fricatives November 19, 2012.
Sh s Children with CIs produce ‘s’ with a lower spectral peak than their peers with NH, but both groups of children produce ‘sh’ similarly [1]. This effect.
Speech Science VI Resonances WS Resonances Reading: Borden, Harris & Raphael, p Kentp Pompino-Marschallp Reetzp
The Sounds of English: an Introduction to English Phonetics.
Artificial Intelligence 2004 Speech & Natural Language Processing Speech Recognition acoustic signal as input conversion into written words Natural.
Katherine Morrow, Sarah Williams, and Chang Liu Department of Communication Sciences and Disorders The University of Texas at Austin, Austin, TX
Fricatives November 20, 2015 The Road Ahead Formant plotting + vowel production exercises are due at 5 pm today! Monday and Wednesday of next week: fricatives,
Exemplar Theory, part 2 April 15, 2013.
Stop Acoustics and Glides December 2, 2013 Where Do We Go From Here? The Final Exam has been scheduled! Wednesday, December 18 th 8-10 am (!) Kinesiology.
Speech Perception.
Language Perception.
Stop + Approximant Acoustics
A. R. Jayan, P. C. Pandey, EE Dept., IIT Bombay 1 Abstract Perception of speech under adverse listening conditions may be improved by processing it to.
Vowels, part 4 November 16, 2015 Just So You Know Today: Vowel remnants + Source-Filter Theory For Wednesday: vowel transcription! Turkish and British.
Stop Acoustics + Glides December 2, 2015 Down The Stretch They Come Today: Stop and Glide Acoustics Friday: Sonorant Acoustics + USRI evaluations We’ll.
What can we expect of cochlear implants for listening to speech in noisy environments? Andrew Faulkner: UCL Speech Hearing and Phonetic Sciences.
Danielle Werle Undergraduate Thesis Intelligibility and the Carrier Phrase Effect in Sinewave Speech.
Audio Books for Phonetics Research CatCod2008 Jiahong Yuan and Mark Liberman University of Pennsylvania Dec. 4, 2008.
Acoustic phonetics: Concerned with describing the acoustics of speech. Also called speech acoustics. Big questions: (1) What are the relationships between.
PHONETICS AND PHONOLOGY
Teaching pronunciation
Processing Speech Students need to distinguish speech sounds correctly so they can learn the rules of language and associate sounds with letters Speech.
An Introduction to : a closer look at analysing vowels
Static Vowels ► Diphthongs ► Semivowels ► Stops
The Acoustics and Perception of American English Vowels
What is Phonetics? Short answer: The study of speech sounds in all their aspects. Phonetics is about describing speech. (Note: phonetics ¹ phonics) Phonetic.
Speech Perception.
Audio Books for Phonetics Research
The Acoustics and Perception of American English Vowels
Speech Perception (acoustic cues)
Psychology 137C: Intimate Relationships Week 3, Lecture 1: Same-Sex Relationships Reminders: The web site for downloading videos was down for a while,
Presentation transcript:

Hillenbrand: Vowels1 The Acoustics and Perception of American English Vowels

Hillenbrand: Vowels2

3

4

5

6

7

8

9 Conventional F1-F2 PlotAcoustic Vowel Diagram

Hillenbrand: Vowels10

Hillenbrand: Vowels11

Hillenbrand: Vowels12 Peterson & Barney (1952) Study conducted at Bell Labs. The 1 st big acoustic study carried out with the (then) recently invented sound spectrograph machine. 1. Recordings 10 vowels (i, ɪ, ɛ,æ, ɑ, ɔ, ʊ,u, ʌ, ɚ ) /hVd/ context (“heed,” “hid,” “head,” “had,” etc.) 76 talkers (33 men, 28 women, 15 children) 2. Measurements: F0, F1-F3 3. Listening Study 70 listeners asked to identify each test signal as one of ten words (“heed,” “hid,” “head,” “had,” etc.)

Hillenbrand: Vowels13

Hillenbrand: Vowels14

Hillenbrand: Vowels15

Hillenbrand: Vowels16

Hillenbrand: Vowels17 Same Data as Previous Figure, but Plotted on a Single Graph

Hillenbrand: Vowels18

Hillenbrand: Vowels19

Hillenbrand: Vowels20

Hillenbrand: Vowels21 TrainingTesting

Hillenbrand: Vowels22

Hillenbrand: Vowels23 What does this mean? It appears as though listeners are recognizing vowels based on information other than F 0 and F 1 -F 3. What are the possibilities? Two Candidates:  Duration  Patterns of spectral change over time

Hillenbrand: Vowels24

Hillenbrand: Vowels25 Original Duration Neutral Duration Short Duration Long Duration

Hillenbrand: Vowels26 Logic: If duration plays no role in vowel recognition, the 4 signal types ought to be equally intelligible; i.e., artificially modifying duration will not affect what vowel is heard. On the other hand, if duration plays a role in vowel perception, the OD signals ought to be more intelligible than any of the duration-modified signals. Also, there are specific kinds of changes in vowel identity that we would expect. For example: Shortened /i/ ought to be heard as /I/ Lengthened /I/ ought to be heard as /i/ Shortened /A/ ought to be heard as /‰/ Lengthened / ‰ / ought to be heard as /A/ Shortened /u/ ought to be heard as /U/ Lengthened /U/ ought to be heard as /u/ Shortened /å/ ought to be heard as /ú/ Lengthened /ú/ ought to be heard as /å/

Hillenbrand: Vowels27

Hillenbrand: Vowels28

Hillenbrand: Vowels29 Effects of Duration on Vowel Perception Original Duration, Long Duration, Short Duration

Hillenbrand: Vowels30 The Role of Spectral Change in Vowel Perception

Hillenbrand: Vowels31 More examples. Note especially the rise in F2 for /U/ and /ú/.

Hillenbrand: Vowels32 Here’s another way to visualize patterns of formant frequency change in vowels: This figure shows formant frequencies measured at the beginning of the vowel and a 2 nd time at the end of the vowel. (The phonetic symbol is plotted at the 2 nd measurement). Note that some vowels (e.g., /i/ and /u/) are pretty steady over time, but others have formants that change quite a bit throughout the course of the vowel (e.g., /e/, /o/, / ú /, /U/, /A/, /I/ ).

Hillenbrand: Vowels33 NAT:Naturally spoken /hAd/ OF:Synthesized, preserving original formant contours FF:Synthesized with flattened formants

Hillenbrand: Vowels34 Key comparison is OF vs. FF: If the formant movements don’t matter, flattening the formant contour will not affect the vowel percept, and the recognition rates for OF and FF should be very similar. On the other hand, if the formant movements are important, the FF signals will be less intelligible than the OF signals. Conclusion: Spectral change patterns do matter.

Hillenbrand: Vowels35