Prosodic facilitation and interference in the resolution of temporary syntactic closure ambiguity Kjelgaard & Speer 1999 Kent Lee Ψ 526b 16 March 2006.

Slides:



Advertisements
Similar presentations
Prosody and Verb Placement Research question: Do Explicit Prosody and Verb Placement modulate listeners PP-attachment preferences in the processing of.
Advertisements

Information structuring in English dialogue class 4
Punctuation Generation Inspired Linguistic Features For Mandarin Prosodic Boundary Prediction CHEN-YU CHIANG, YIH-RU WANG AND SIN-HORNG CHEN 2012 ICASSP.
The Role of F0 in the Perceived Accentedness of L2 Speech Mary Grantham O’Brien Stephen Winters GLAC-15, Banff, Alberta May 1, 2009.
Eye Movements and Spoken Language Comprehension: effects of visual context on syntactic ambiguity resolution Spivey et al. (2002) Psych 526 Eun-Kyung Lee.
Perceptual Organization in Intonational Phonology: A Test of Parallelism J. Devin McAuley 1 & Laura C. Dilley 2 Department of Psychology Bowling Green.
Lexical Ambiguity in Sentence Comprehension By R. A. Mason & M. A. Just Brain Research 1146 (2007) Presented by Tatiana Luchkina.
Prosody Modeling (in Speech) by Julia Hirschberg Presented by Elaine Chew QMUL: ELE021/ELED021/ELEM March 2012.
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
Using disfluency to understand, um, sentences... with PP-attachment ambiguities Jennifer E. Arnold and Kellen Carpenter, UNC Chapel Hill Background 1)
Nuclear Accent Shape and the Perception of Prominence Rachael-Anne Knight Prosody and Pragmatics 15 th November 2003.
Making & marking text for synthesis Caroline Henton 10 August 2006.
Connecting Acoustics to Linguistics in Chinese Intonation Greg Kochanski (Oxford Phonetics) Chilin Shih (University of Illinois) Tan Lee (CUHK) with Hongyan.
SYNTAX 1 DAY 30 – NOV 6, 2013 Brain & Language LING NSCI Harry Howard Tulane University.
Language Use and Understanding BCS 261 LIN 241 PSY 261 CLASS 12: SNEDEKER ET AL.: PROSODY.
Results Clear distinction between two question intonations: perception and understanding level Three distinct prototypes for different interpretations.
J-ToBi Jennifer J. Venditti Presentation by James Rishe.
PSY 369: Psycholinguistics
Automatic Prosody Labeling Final Presentation Andrew Rosenberg ELEN Speech and Audio Processing and Recognition 4/27/05.
Dianne Bradley & Eva Fern á ndez Graduate Center & Queens College CUNY Eliciting and Documenting Default Prosody ABRALIN23-FEB-05.
Language, Mind, and Brain by Ewa Dabrowska Chapter 2: Language processing: speed and flexibility.
Sound and Speech. The vocal tract Figures from Graddol et al.
1 Speech synthesis 2 What is the task? –Generating natural sounding speech on the fly, usually from text What are the main difficulties? –What to say.
PSY 369: Psycholinguistics Language Comprehension: Sentence comprehension.
Dianne Bradley, Eva Fernández & Dianne Taylor Graduate Center & Queens College CUNY 16th Annual CUNY Conference on Human Sentence.
Intro to Psycholinguistics What its experiments are teaching us about language processing and production.
Interactions between Language and Stuttering NU/SFA Workshop for Fluency Specialists July, 1996 J. Scott Yaruss, Ph.D., CCC-SLP University of Pittsburgh.
Prosody and NLP Seminar by Nikhil: Adith: Prachur: 06D05011 We have a presentation this Friday ?
11 CS 388: Natural Language Processing: Syntactic Parsing Raymond J. Mooney University of Texas at Austin.
14: THE TEACHING OF GRAMMAR  Should grammar be taught?  When? How? Why?  Grammar teaching: Any strategies conducted in order to help learners understand,
Experiments concerning boundary tone perception in German 3 rd Workshop of the SPP-1234 Potsdam, 7 th January 2009 Presentation of the Stuttgart Project.
Perceived prominence and nuclear accent shape Rachael-Anne Knight LAGB 5 th September 2003.
WORD SEMANTICS 4 DAY 29 – NOV 4, 2011 Brain & Language LING NSCI Harry Howard Tulane University.
Ferreira and Henderson (1990)
Suprasegmentals Segmental Segmental refers to phonemes and allophones and their attributes refers to phonemes and allophones and their attributes Supra-
Prosody-driven Sentence Processing: An Event-related Brain Potential Study Ann Pannekamp, Ulrike Toepel, Kai Alter, Anja Hahne and Angela D. Friederici.
The “interpretative” foundation of Intonation Unit (IU) or Intonation Phrase (  ). Amedeo De Dominicis Conferenza annuale A.I.S.V (Università degli.
Comprehension of Grammatical and Emotional Prosody is Impaired in Alzheimer’s Disease Vanessa Taler, Shari Baum, Howard Chertkow, Daniel Saumier and Reported.
1 Statistical Parsing Chapter 14 October 2012 Lecture #9.
Older Adults’ More Effective Use of Context: Evidence from Modification Ambiguities Robert Thornton Pomona College Method Participants: 32 young and 32.
Copyright 2007, Toshiba Corporation. How (not) to Select Your Voice Corpus: Random Selection vs. Phonologically Balanced Tanya Lambert, Norbert Braunschweiler,
Intonation in Communication Skill: Recent Research Discourse, both in theoretical linguistics and in foreign language pedagogy,has focused on describing.
Speech Perception 4/4/00.
10/13/10Psyc / Ling / Comm 525 Fall 10 Kim & Osterhout (2005) JML The independence of combinatory semantic processing: Evidence from event-related potentials.
Avoiding the Garden Path: Eye Movements in Context
On Different Perspectives of Utilizing the Fujisaki Model to Mandarin Speech Prosody Zhao-yu Su Phonetics Lab, Institute of Linguistics, Academia Sinica.
Evaluating prosody prediction in synthesis with respect to Modern Greek prenuclear accents Elisabeth Chorianopoulou MSc in Speech and Language Processing.
LATERALIZATION OF PHONOLOGY 2 DAY 23 – OCT 21, 2013 Brain & Language LING NSCI Harry Howard Tulane University.
Background: Speakers use prosody to distinguish between the meanings of ambiguous syntactic structures (Snedeker & Trueswell, 2004). Discourse also has.
The Effect of Pitch Span on Intonational Plateaux Rachael-Anne Knight University of Cambridge Speech Prosody 2002.
1 Natural Language Processing Lecture Notes 14 Chapter 19.
Recognizing Discourse Structure: Speech Discourse & Dialogue CMSC October 11, 2006.
Speech Perception.
Nuclear Accent Shape and the Perception of Syllable Pitch Rachael-Anne Knight LAGB 16 April 2003.
CS460/IT632 Natural Language Processing/Language Technology for the Web Lecture 13 (17/02/06) Prof. Pushpak Bhattacharyya IIT Bombay Top-Down Bottom-Up.
LECTURE 4 Syntax. SPECIFYING SYNTAX Programming languages must be very well defined – there’s no room for ambiguity. Language designers must use formal.
Suprasegmental Properties of Speech Robert A. Prosek, Ph.D. CSD 301 Robert A. Prosek, Ph.D. CSD 301.
Syntactic Priming in Sentence Comprehension (Tooley, Traxler & Swaab, 2009) Zhenghan Qi.
Acoustic Cues to Emotional Speech Julia Hirschberg (joint work with Jennifer Venditti and Jackson Liscombe) Columbia University 26 June 2003.
Chapter 11 Language. Some Questions to Consider How do we understand individual words, and how are words combined to create sentences? How can we understand.
Syntax Analysis Or Parsing. A.K.A. Syntax Analysis –Recognize sentences in a language. –Discover the structure of a document/program. –Construct (implicitly.
Copyright © American Speech-Language-Hearing Association
The lexical/phonetic interface: Evidence for gradient effects of within-category VOT on lexical access Bob McMurray Richard N. Aslin Mickey K. TanenMouse.
Intonational and Its Meanings
Intonational and Its Meanings
Speech Perception.
Lecture 7: Introduction to Parsing (Syntax Analysis)
Comparative Studies Avesani et al 1995; Hirschberg&Avesani 1997
Discourse & Dialogue CMSC October 28, 2004
Jennifer J. Venditti Presentation by James Rishe
Presentation transcript:

Prosodic facilitation and interference in the resolution of temporary syntactic closure ambiguity Kjelgaard & Speer 1999 Kent Lee Ψ 526b 16 March 2006

Prosodic structure Potential cues for parsing: 1) Fundamental frequency (F 0 ) – glottal 2) Amplitude & spectral info

Prosodic structure Potential cues for parsing: 3) Duration 4) Lexical, sentential, focal stress (from duration & F 0 ) 5) Segmentation; e.g.: “let me kiss the sky”  “let me kiss this guy”

Prosodic structure Phonological phrase (PP)  often maps onto XPs (NPs, VPs...)  demarcated by phrase accent [L-, H-] Intonational phrase (IP)  often maps onto clause (S)  demarcated by boundary tones [L%, H%] Pitch (stress) accents [H*, L*, LH*, L*H, H-!H] Prosodic structure is non-recursive, thus less complex than syntax (which allows nested structures / recursion: S´ ⊂ VP ⊂ NP = N+RC = S ⊂ VP ⊂ NP)

Prosody-syntax mapping: Consistency & GP

1) Early Closure a. Consistent (“cooperating”) prosody When Tim is presenting, the lectures are interesting. b.Baseline When Tim is presenting the lectures are interesting. c.Conflicting When Tim is presenting the lectures, are interesting. 2) Late Closure a.Consistent (“cooperating”) When Tim is presenting the lectures, they’re interesting. b.Baseline When Tim is presenting the lectures they’re interesting. c.Conflicting When Tim is presenting, the lectures they’re interesting.

Prosody-syntax mapping: Consistency & GP Consistent prosodic-syntactic mapping should facilitate parsing Inconsistent mapping should create interference effects, and GPing with ambiguous sentences Previous studies found some such effects, but didn’t examine early vs. late closure Interference & facilitation compared with baseline condition (single IP for both clauses)

Materials 18 sets of 6 sentence variants 2 X 3 design: early/late closure X consistent (“cooperating”), baseline, conflicting prosody norming study used to generate sentences with transitivity index; phonetic analysis & manipulation pretests for acceptability / intelligibility

Experiment 1 66 subjects speeded grammaticality judgment DVs: judgments & error rates weak transitivity effect (e.g., r=-.5, p<.05) – should have been used as control variable? Insertion of extra function words (late closure) did not lead to significant length effects

Expt. 1 1) Sig. main effects of prosody & syntax in RTs & errors a) Errors | Prosody:  Conflicting > Baseline  GP effects only in Baseline  (Early > Late Closure) b) RTs: facilitation but no interference effects --  Coop < Baseline, Conflicting

Expt. 1 Prosody affected metalinguistic judgments Consistent faster than Baseline (w/o IP boundaries), no GP, no early/late closure differences Early closure in Baseline & Conflicting slower, induced GP But: no clear interference effect on RTs in Conflicting cond. (?), hence, Expt. 2

Expt. 2 Same design & materials Speeded “end of sentence” comprehension task (comprehended = yes/no) Avoids metalinguistic judgments

Expt. 2 RTs showed prosodic effects Facilitation: Cooperating < Baseline Interference: Conflicting > Baseline GP processing difficulty for early closure in Baseline & Conflicting No GP in Cooperating

Expt. 2 “no comprehension” reported in 4.6% trials

Expt. 2 Consistent IP boundary facilitated parsing, cf. ambiguous Baseline Significant interference effect in Conflicting cf. Baseline Consistent prosody  early facilitation for early closure; no difference in early cf. late closure in Cooperating cond., cf. Baseline & Conflicting Jives with Expt. 1 & overall predictions

Expt. 2 Rules out later or minor role of prosody Rules out prosody interpreted based on underlying syntax Can assist with ambiguous or dispreferred parses Can lead to interference with parsing if incongruous But: drawbacks to speeded comprehension task

Expt. 3 Cross-modal priming to measure point of disambiguation avoids “contamination” or interference of metalinguistic processing same materials & basic design

Expt. 3 Ss hear syntactically ambiguous fragment over headphones Previous sound files were truncated to ambiguous region (e.g., When Roger left the house...) Ss see & name disambiguating word that is visually presented (is/its) Ss complete the sentence (unnatural task?) In Conflicting cond., is/its  opposite closure type In Baseline cond., IP boundary tone was truncated

Expt. 3 Most errors in Baseline conditions & Conflicting early closure Cooperating EC < Baseline EC Cooperating LC = Baseline LC Interference: Conflicting < Baseline conditions

Expt. 3 GP difficulty for EC cf. LC in Baseline & Conflicting conditions, not for Cooperating cond. No correlations b/ naming times & # syllables / words in control study Show similar interference & facilitation effects as in Expts. 1-2, at point of disambiguation

Expts. 1-3 Expts. show prosody can mislead the parser Results are consistent with early processing Location of IP boundaries guide assignment of syntactic boundary locations, until reanlysis required

Expt. 4 Aims to examine PP boundaries If PP boundaries are used by syntactic parser, then PP facilitation / interference effects should be possible Similar design, materials, norming, analysis, & pretesting of stimuli as before Cross-modal naming task used for temporal resolution in detection of PP effects in parsing & disambiguation

Expt. 4 Stimuli with subtle tone changes used to rule out possibility that processing advantage is attributable to acoustically exaggerated boundaries Stimuli without final pauses used to rule out possibility that processing effects derive from extra duration; silences were deleted...] PP ] IP

Expt sentence sets, digitally truncated to ambiguous region 48 subjects 2X3 design: early/late closure X 3 prosodies Cooperating: PP boundary consistent with clause boundary Baseline: phonetically ambiguous phrase accent (L-) & brief break Conflicting: misleading visual targets to PP boundary tones

Expt. 4 Most errors in Baseline & Conflicting EC Main effects for prosody, syntax, & interaction effect

Expt. 4 Facilitation in Cooperating cf. Baseline cond., but only in EC as before Interference in Conflicting cf. Baseline GP processing difficulty in Baseline (EC, LC) & Conflicting (EC, LC) No GP in Cooperating cond.

Expt. 4 Results consistent with those for IPs in Expts Consistent PP boundaries facilitated parsing of dispreferred syntactic analysis Inconsistent PP boundaries led to interference for EC & LC (preferred / dispreferred syntax) Even subtle boundaries can influce parsing

Discussion No GP with consistent prosodic-syntactic boundaries Disadvantage for less preferred EC in ambiguous & inconsistent conditions Facilitation & interference early in syntactic processing Supports interactive processing models

Discussion Potential problems: Expts. 1 & 2 lack temporal resolution Expts. 3 & 4 have better resolution, but lack naturalness Still perhaps not so much resolution as previous studies, e.g., studies of verb bias effects Baseline condition stimuli sound like utterances with special prosodic focus; hence, may be problematic as control or wholly ambiguous stimuli