Gestural Timing and Magnitude of English /r/: An Ultrasound-OptoTrak Study Fiona Campbell, Bryan Gick, Ian Wilson, and Eric Vatikiotis-Bateson Ultrafest.

Slides:



Advertisements
Similar presentations
Advances in Speech Synthesis
Advertisements

Normal Aspects of Articulation. Definitions Phonetics Phonology Articulatory phonetics Acoustic phonetics Speech perception Phonemic transcription Phonetic.
Phonetics as a scientific study of speech
Sounds that “move” Diphthongs, glides and liquids.
SPPA 403 Speech Science1 Unit 3 outline The Vocal Tract (VT) Source-Filter Theory of Speech Production Capturing Speech Dynamics The Vowels The Diphthongs.
Plasticity, exemplars, and the perceptual equivalence of ‘defective’ and non-defective /r/ realisations Rachael-Anne Knight & Mark J. Jones.
Glides (/w/, /j/) & Liquids (/l/, /r/) Degree of Constriction Greater than vowels – P oral slightly greater than P atmos Less than fricatives – P oral.
Collection of speech production ultrasound data Donald Derrick 12, Romain Fiasson 2 and Catherine T. Best 1 1 University of Western Sydney (MARCS Institute)
Speech Science XII Speech Perception (acoustic cues) Version
1 The Effect of Pitch Span on the Alignment of Intonational Peaks and Plateaux Rachael-Anne Knight University of Cambridge.
“Speech and the Hearing-Impaired Child: Theory and Practice” Ch. 13 Vowels and Diphthongs –Vowels are formed when sound produced at the glottal source.
Speech and speaker normalization (in vowel normalization)
Evidence of a Production Basis for Front/Back Vowel Harmony Jennifer Cole, Gary Dell, Alina Khasanova University of Illinois at Urbana-Champaign Is there.
Perception of syllable prominence by listeners with and without competence in the tested language Anders Eriksson 1, Esther Grabe 2 & Hartmut Traunmüller.
Vocal Tract Physiology December 2, 2014 Almost There… The final interim course project report is due today! I’ll get your last graded homeworks back.
Speech Perception Overview of Questions Can computers perceive speech as well as humans? Does each word that we hear have a unique pattern associated.
Speech Group INRIA Lorraine
Phonetic Similarity Effects in Masked Priming Marja-Liisa Mailend 1, Edwin Maas 1, & Kenneth I. Forster 2 1 Department of Speech, Language, and Hearing.
AMANDA L. MILLER CORNELL UNIVERSITY AND THE UNIVERSITY OF BRITISH COLUMBIA Using Ultrasound for Language Documentation.
Introduction to Intonation Jennifer J. Venditti Cognitive Science March 2001.
Ultrafest 3 U. Arizona, April 2005 Measuring the tongue root: Image dropoff, rotation issues, and the siren call of intrinsic F0 D. H. Whalen Haskins Laboratories.
1 The phonetics of speech errors Frisch, S. A. University of South Florida This work supported by NIH-NIDCD R
1 The University of South Florida audiovisual phoneme database v 1.0 Frisch, S.A., Stearns, A.M., Hardin, S.A., & Nikjeh, D.A. University of South Florida.
The articulatory settings of bilingual Canadian English- French speakers Ultrafest III - Apr.14, 2005 Tucson, AZ Ian Wilson, Bryan Gick, Fiona Campbell,
UltraFest III, University of Arizona 4/16/05 A study of pre-liquid excrescent schwa in English Adam Baker, Diana Archangeli, Jeff Mielke University of.
Chapter 2 Introduction to articulatory phonetics
Natural classes and distinctive features
Conclusions  Constriction Type does influence AV speech perception when it is visibly distinct Constriction is more effective than Articulator in this.
Phonology, phonotactics, and suprasegmentals
Précis Adults discriminate many non-native consonant contrasts poorly, but exceptions offer key insights about listeners’ knowledge of their native phonological.
Interarticulator programming in VCV sequences: Effects of closure duration on lip and tongue coordination Anders Löfqvist Haskins Laboratories New Haven,
Present Experiment Introduction Coarticulatory Timing and Lexical Effects on Vowel Nasalization in English: an Aerodynamic Study Jason Bishop University.
Phonetics and Phonology
Abstract Research Questions The present study compared articulatory patterns in production of dental stop [t] with conventional dentures to productions.
Segmental factors in language proficiency: Velarization degree as a signature of pronunciation talent Henrike Baumotte and Grzegorz Dogil {henrike.baumotte,
English Variety + Allophony January 15, 2014 For Friday Please take a stab at the following exercises from Chapter 2 of A Course in Phonetics before.
Nasal endings of Taiwan Mandarin: Production, perception, and linguistic change Student : Shu-Ping Huang ID No. : NA3C0004 Professor : Dr. Chung Chienjer.
Some thoughts on modelling phonetic effects in corpora.
Acoustic Phonetics 3/9/00. Acoustic Theory of Speech Production Modeling the vocal tract –Modeling= the construction of some replica of the actual physical.
An investigation of postvocalic /r/ in Glaswegian adolescents Jane Stuart-Smith and Robert Lawson Department of English Language, University of Glasgow.
1 Speech Perception 3/30/00. 2 Speech Perception How do we perceive speech? –Multifaceted process –Not fully understood –Models & theories attempt to.
Speech Science Fall 2009 Oct 26, Consonants Resonant Consonants They are produced in a similar way as vowels i.e., filtering the complex wave produced.
Phonological Theory.
Connected speech processes Coarticulation Suprasegmentals.
Results Tone study: Accuracy and error rates (percentage lower than 10% is omitted) Consonant study: Accuracy and error rates 3aSCb5. The categorical nature.
Speech Science IX How is articulation organized? Version WS
From subtle to gross variation: an Ultrasound Tongue Imaging study of Dutch and Scottish English /r/ James M Scobbie Koen Sebregts Jane Stuart-Smith.
Gradual Implementation of l-vocalization: A Hypothetical case for Aranese The main purpose of this research is to study the perception of l- vocalization.
English Variety + Allophony September 16, 2015 For Friday Please take a stab at the following exercises from Chapter 2 of A Course in Phonetics before.
1 Cross-language evidence for three factors in speech perception Sandra Anacleto uOttawa.
Introduction to Language Phonetics 1. Explore the relationship between sound and spelling Become familiar with International Phonetic Alphabet (IPA )
ICVGIP 2012 ICVGIP 2012 Speech training aids Visual feedback of the articulatory efforts during acquisition of speech production by a hearing-impaired.
LIN 3201 Sounds of Human Language Sayers -- Week 1 – August 29 & 31.
A Psycholinguistic Perspective on Child Phonology Sharon Peperkamp Emmanuel Dupoux Laboratoire de Sciences Cognitives et Psycholinguistique, EHESS-CNRS,
Speech Production “Problems” Key problems that science must address How is speech coded? How is speech coded? What is the size of the “basic units” of.
[  ] from [  ] James M Scobbie 2 nd Ultrasound Workshop UBC Vancouver April 2004 lip or lingual vs. lip & lingual.
Control of prosodic features under perturbation in collaboration with Frank Guenther Dept. of Cognitive and Neural Systems, BU Carrie Niziolek [carrien]
Soran University- College of Education English Department Articulatory phonetics/Speech organs Talib M. Sharif Omer Assistant lecturer
Observing Lip and Vertical Larynx Movements During Smiled Speech (and Laughter) - work in progress - Sascha Fagel 1, Jürgen Trouvain 2, Eva Lasarcyk 2.
Stop Acoustics + Glides December 2, 2015 Down The Stretch They Come Today: Stop and Glide Acoustics Friday: Sonorant Acoustics + USRI evaluations We’ll.
1 Probing the Big Bang with ultrasound: Retraction of /s/ in English Adam Baker, Jeff Mielke, Diana Archangeli University of Arizona Supported by James.
The effect of speech timing on velopharyngeal function
Acoustic to Articoulatory Speech Inversion by Dynamic Time Warping
PHREND at UCSC Sepember 24, 2016 Sarah Bakst, UC Berkeley
4aPPa32. How Susceptibility To Noise Varies Across Speech Frequencies
Vowels and Consonant Serikova Aigerim.
Susan Lin, Sharon Inkelas, Lara McConnaughey, Michael Dohn
Elaine R. Hitchcocka, Ph.D., Laura L. Koenigb,c, Ph.D.
Speech Perception (acoustic cues)
A Japanese trilogy: Segment duration, articulatory kinematics, and interarticulator programming Anders Löfqvist Haskins Laboratories New Haven, CT.
Presentation transcript:

Gestural Timing and Magnitude of English /r/: An Ultrasound-OptoTrak Study Fiona Campbell, Bryan Gick, Ian Wilson, and Eric Vatikiotis-Bateson Ultrafest IV Tucson, Arizona April 14, 2005

Goals  To better understand the gestural organization of composite segments in English.  Contribute to the knowledge of mechanisms for production of English /r/  Improve on past methodology by testing combined B/M-mode ultrasound and Optotrak as a means to increase temporal resolution while imaging the vocal tract from lips to tongue root.

Introduction  Generalizations from previous studies: Temporal: More anterior gestures appear at syllable peripheries. Nasals, /l/, /w/ (Krakow, 1999; Gick, 2003) Spatial: Position-dependent spatial reduction of gestures. (Sproat & Fujimura, 1993) Final position reduction of anterior gestures & Initial position reduction of less anterior gestures

Proposed Explanations  A number of explanations have been proposed to account for these generalizations, including: Sproat & Fujimura (1993) Browman & Goldstein (1995) Gick (2003) Carter (2002) Gick, Campbell, Oh, and Tamburri-Watt (in press)  All studies thus far have been based on a comparison of two gestures

English /r/  Composed of 3 constrictions: tongue root at the pharyngeal wall (TR) tongue tip/blade at the palate(TB) between the lips (Lip)  Variable tongue shape, more lip rounding and more prominent TB gesture in Initial position. (Zawadzki & Kuehn, 1980)  Examination of three gestures will help disambiguate the predictions made by different theories.

Predictions Summary of predicted categorization of gestures and predictions of relative timing by position: LipTBTRInitialFinal Sproat & Fujimura (1993) [vocalic] All three simultaneous, All three reduced All three simultaneous, No reduction Browman & Goldstein (1995) narrower constriction (than TR) narrower constriction (than TR) wider constriction All three simultaneous. TR > Lip TR > TB TB & Lip reduced Gick (2003)C-gesture V-gestureLip & TB > TR, TR reduced TR > Lip & TB Lip & TB reduced Carter (2002) ?seemingly consonantal seemingly vocalic Any order: dialect dependent (Lip)/TR > TB/(Lip) Gick et al (in press) anteriorless anteriorleast anterior All three simultaneous TR > TB > Lip

Methods  Optotrak 3D motion and position measurement (point tracking) system and B/M-mode ultrasound video were used to simultaneously record the three gestures of /r/ in syllable-initial, and syllable-final positions preceding a consonant and preceding a vowel in several vocalic contexts.

Participants  10 people, 5 women, 5 men  Native speakers of Canadian English  8 from Western Canada  One of the male subjects had to be excluded from the analysis due to poor ultrasound image quality.

Stimuli The position of /r/ varied within a given vocalic context such that: Syllable-initialResyllabifiableSyllable-final...V 1 # RV V 1 R# V V 1 R# hV 1... V 1 = /e/ (Lips, TR visible) V 1 = /a/ (Lips, TB visible) Stimuli were randomized and presented in a carrier phrase which was read by the subject. … said “ _________ ” each … x 10 for each stimulus eg. Cindy said "hay ray" each afternoon.

Data Collection  The subject was seated in a modified ophthalmic examination chair to maximize head stability and Ultrasound probe contact.  Stimuli were presented on a laptop located about 2m away from the subject at eye level.  Timed PowerPoint presentation: 130s trials  A 'clapper' with an Optotrak marker attached was used to set a 0 point for synchronization of the Optotrak, Ultrasound, and Audio signals.

Experimental Set-up

Data Collection II  Ultrasound: B/M mode: midsagittal section (29.97fps) + continuous movement trajectories of A (TT), B (TM), C (TR) recorded to DV.  Optotrak 3020 system: recorded (at 90 Hz) the 3D positions of 12 infrared-emitting diode Optotrak markers.  Audio: signal recorded synchronized with both Optotrak and Ultrasound data signals.

Optotrak Marker Placement

Ultrasound Data

Ultrasound Measures: Timing

Ultrasound Measures: Magnitude

Optotrak Measures

Qualitative Observations Sagittal diagram of idealized tongue shapes for American /r/ (Modified from Hagiwara, 1995, p.97) Tip Down Blade Up Tip Up

Results: Timing

Results: Magnitude

Qualitative Results  All three tongue shapes observed  No speaker used more than two of these  ‘blade up’ was most common across subjects and most stable across positions  Tongue shape varied by both vowel context and syllable position  Higher TB syllable-initially and in the context of low or back vowels

Tongue Shape Variability

Summary  The position-based differences observed in the overall results were: Initial Timing: front-to-back Spatial reduction: TR Final: Timing: TR & Lip simultaneous; precede TB Spatial reduction: TB and Lips

Surprises?  Three-way timing distinction in Initial position  Lip patterns with TR in terms of timing but with TB in terms of spatial reduction in Final position  The results are not consistent with any of the proposals considered

Proposal  Timing patterns depend on magnitude Relative width of constrictions determines order (Browman & Goldstein, 1995, but in both positions). Narrower constriction(s) at syllable edges Relative width can vary as a result of positional reduction  Possible motivating factor: Constriction width: Jaw height

Potential Problems  Potential for error in calculations  Unclear data for Resyllabifiable condition  Stationary M-mode lines, variable tongue shape  No head correction

Conclusions  Accounts employing a binary categorical system are challenged by the observed three-way timing distinction in Initial position.  The results of this study suggest a dependence relationship between the relative timing of gestures and their magnitude.  Future work may be able to test this proposal by measuring the actual relative constriction width of each gesture across positions.

Selected References Browman, C. P., & Goldstein, L. (1992). Articulatory phonology: An overview. Phonetica, 49, Carter, P. (2002). Structured variation in british english liquids: The role of resonance. Unpublished PhD Dissertation, University of York. Delattre, P., & Freeman, D. (1968). A dialect study of american r’s by x-ray motion picture. Linguistics, 44, Gick, B. (1999). A gesture-based account of intrusive consonants in english. Phonology, 16, Gick, B. (2003). Articulatory correlates of ambisyllabicity in english glides and liquids. In J. Local, R. Ogden & R. Temple (Eds.), Labphon VI: Constraints on phonetic interpretation. Cambridge: Cambridge University Press. Gick, B., Campbell, F., Oh, S., & Tamburri-Watt, L. (in press). Toward universals in the gestural organization of syllables: A cross-linguistics study of liquids. Journal of Phonetics. Hagiwara, R. (1995). Acoustic realizations of american /r/ as produced by women and men. UCLA Working Papers in Phonetics, 90, Krakow, R. A. (1999). Physiological organization of syllables: A review. Journal of Phonetics, 27, Sproat, R., & Fujimura, O. (1993). Allophonic variation in english /l/ and its implications for phonetic implementation. Journal of Phonetics, 21, Uldall, E. (1958) ‘American “molar” R and “flapped” T.’ Revista do Laboratorio de Fonetica Experimental, Universidad de Coimbra Zawadzki, P. A., & Kuehn, D. P. (1980). A cineradiographic study of static and dynamic aspects of american english /r/. Phonetica, 37,