TOWARDS A MODULAR APPROACH TO ANAPHORIC PROCESSING: semantic operations precede discourse operations Arnout Koornneef.

Slides:



Advertisements
Similar presentations
Chapter 7 Hypothesis Testing
Advertisements

Clausal Backgrounding & Pronominal Reference – A Functionalist
Principle B and Phonologically Reduced Pronouns in Child English Jeremy Hartman Yasutada Sudo Ken Wexler.
 2 Test of Independence. Hypothesis Tests Categorical Data.
Social Influence Majority and Minority Influence.
Eye Movements and Spoken Language Comprehension: effects of visual context on syntactic ambiguity resolution Spivey et al. (2002) Psych 526 Eun-Kyung Lee.
Sentence Processing III Language Use and Understanding Class 12.
The Interaction of Lexical and Syntactic Ambiguity by Maryellen C. MacDonald presented by Joshua Johanson.
Sentence Processing 1: Encapsulation 4/7/04 BCS 261.
Spoken Word Recognition 1 Language Use and Understanding.
Introduction to Statistics: Political Science (Class 5)
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
Eye Movements of Younger and Older Drivers Professor: Liu Student: Ruby.
9/22/10Psyc / Ling / Comm 525 Fall 10 Semantic Priming (Phenomenon & Tool)...armkitchentree Related prime >doctoractor < Unrelated prime nurse floor...
Auditory Word Recognition
Think about the different ways people cope with sadness. Which of these is closest to the way you handle sadness? 1.Keeping your feelings to yourself 2.Talking.
Research Methods in Social Sciences
Week 5a. Binding theory CAS LX 522 Syntax I. Structural ambiguity John said that Bill slipped in the kitchen. John said that Bill slipped in the kitchen.
1 Reading time evidence for enriched composition McElree et al. (2001) Rianne Oostwoud-Wijdenes & Maartje Schulpen.
Expository Writing.
EXPERIMENT 2 [4] CW- inconsistent If cats were vegetarians they would be cheaper for owners to look after. Families could feed their cat a bowl of |fish.
Albert Gatt LIN 3098 Corpus Linguistics. In this lecture Some more on corpora and grammar Construction Grammar as a theoretical framework Collostructional.
Correlation and Regression
CHAPTER 10: Hypothesis Testing, One Population Mean or Proportion
Correlation and Regression
Chapter Correlation and Regression 1 of 84 9 © 2012 Pearson Education, Inc. All rights reserved.
2-1 MGMG 522 : Session #2 Learning to Use Regression Analysis & The Classical Model (Ch. 3 & 4)
What’s in the news right now related to science???? Flesh eating bacteria.
Cognitive demands of hands-free- phone conversation while driving Professor : Liu Student: Ruby.
Ferreira and Henderson (1990)
The Argument for Using Statistics Weighing the Evidence Statistical Inference: An Overview Applying Statistical Inference: An Example Going Beyond Testing.
Anaphoric dependencies : A window into the architecture of the language system Eye tracking experiments Eric Reuland Frank Wijnen Arnout Koornneef.
Qualitative versus Quantitative Research (Source: W.G. Zikmund, “Business Research Methods,” 7th Edition, US, Thomson, South-Western, 2003)
Age of acquisition and frequency of occurrence: Implications for experience based models of word processing and sentence parsing Marc Brysbaert.
Evaluating Research Articles Approach With Skepticism Rebecca L. Fiedler January 16, 2002.
1 Special Electives of Comp.Linguistics: Processing Anaphoric Expressions Eleni Miltsakaki AUTH Fall 2005-Lecture 2.
Evidence-based Practice Chapter 3 Ken Koedinger Based on slides from Ruth Clark 1.
Avoiding the Garden Path: Eye Movements in Context
Parafoveal Processing of Vowel Contexts: Evidence from Eye Movements Jane Ashby 1, Rebecca Treiman 2, Brett Kessler 2, & Keith Rayner 1 1 University of.
Welcome to MM207! Unit 9 Seminar. End of term deadlines Final Project due Tuesday, by 11:59 pm ET Unit 10 contains several discussion questions and an.
Chapter 4 – Research Methods in Clinical Psych Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
WHAT IS THE NATURE OF SCIENCE?. SCIENTIFIC WORLD VIEW 1.The Universe Is Understandable. 2.The Universe Is a Vast Single System In Which the Basic Rules.
Background: Speakers use prosody to distinguish between the meanings of ambiguous syntactic structures (Snedeker & Trueswell, 2004). Discourse also has.
1 The Theoretical Framework. A theoretical framework is similar to the frame of the house. Just as the foundation supports a house, a theoretical framework.
Section 2 Scientific Methods Chapter 1 Bellringer Complete these two tasks: 1. Describe an advertisement that cites research results. 2. Answer this question:
Hypothesis Testing An understanding of the method of hypothesis testing is essential for understanding how both the natural and social sciences advance.
Chapter 9 Correlation and Regression.
What Are Scientific Theories? Chapter 3. THEORY A collection of statements that when taken together attempt to explain a broad class of related phenomena.
Doing Science: Texting and Gender Experiment. Group Roles for Conducting Experiment (In some groups, individuals may perform more than one role) Recorders.
Personally Important Posttraumatic Growth as a Predictor of Self-Esteem in Adolescents Leah McDiarmid, Kanako Taku Ph.D., & Aundreah Walenski Presented.
STILL MORE 9.1. VI. CORRELATION & CAUSATION Just because there is a strong relationship, this does NOT imply cause and effect!
1 Special Electives of Comp.Linguistics: Processing Anaphoric Expressions Eleni Miltsakaki AUTH Fall 2005-Lecture 5.
Copyright © Cengage Learning. All rights reserved. 12 Analysis of Variance.
Experimental Psychology PSY 433 Chapter 5 Research Reports.
How to write an effective conclusion Also known as putting it all together.
Chapter 11 Language. Some Questions to Consider How do we understand individual words, and how are words combined to create sentences? How can we understand.
Coreferential Interpretations of Reflexives in Picture Noun Phrases: an Experimental Approach Micah Goldwater University of Texas at Austin Jeffrey T.
Significance Tests: The Basics Textbook Section 9.1.
Chapter Correlation and Regression 1 of 84 9 © 2012 Pearson Education, Inc. All rights reserved.
1 Nonparametric Statistical Techniques Chapter 18.
TMA04 - Writing the DE100 Project Report Discussion Section
Correlation and Regression
Investigating the combined effects of word frequency and contextual predictability on eye movements during reading Christopher J. Hand Glasgow Language.
Chapter 4 Research Methods in Clinical Psychology
Eye-tracking-while-reading Experiment Coherence Judgment Experiment
Kimron Shapiro & Frances Garrad-Cole The University of Wales, Bangor
TMA04 - Writing the DE100 Project Report Discussion Section
Sait Bayrakdar, Philipp Lersch, Sergi Vidal & Rory Coulter
Eleni Miltsakaki AUTH Fall 2005-Lecture 6
Presentation transcript:

TOWARDS A MODULAR APPROACH TO ANAPHORIC PROCESSING: semantic operations precede discourse operations Arnout Koornneef

HYPOTHESES Variable binding is cheaper than coreference In ambiguous situation variable binding has precedence over coreference

SEMANTICS vs. DISCOURSE previous research Piñango, Burkhardt, Brun and Avrutin (2001) Dual task experiment: participants listened to critical sentences and performed lexical decision task Rationale: tasks tap into same resources SEMANTICS vs. DISCOURSE previous research

STIMULI variable binding Everyone i hopes that the tenants will pay him i the rent before… coreference The landlord i hopes that the tenants will pay him i the rent before… STIMULI

RESULTS No difference in control condition Longer RT’s in coreference condition in experimental condition Variable binding is cheaper than coreference RESULTS

DIFFERENT INTERPRETATION coreference condition The landlord i hopes that the tenants will pay him i the rent before… the landlord c-command him: Variable binding and coreference are both possible Longer RT’s because of interference between two available processes?

EYE-TRACKING EXPERIMENT: semantics vs. discourse EYE-TRACKING EXPERIMENT: semantics vs. discourse

OBJECTIVES Support for hypothesis 2: in an ambiguous situation variable binding has precedence over coreference Additional support for hypothesis 1: variable binding is cheaper than coreference OBJECTIVES

HYPOTHESIS 2 In an ambiguous situation variable binding has precedence over coreference HYPOTHESIS 2

EXPERIMENTAL ITEMS variable binding context A working day in the factory is always very tough. Especially today a lot of working men, among them the very old man Paul, could barely cope. Every working man who just like Paul was running out of energy, thought it was very nice that he could go home early this afternoon. After a hot shower things would probably look better. coreference context A working day in the factory is always very tough. Especially today the very old man Paul could barely cope. Every working man who knew that Paul was running out of energy, thought it was very nice that he could go home early this afternoon. After a hot shower things would probably look better. EXPERIMENTAL ITEMS

PREDICTIONS variable binding context  he is bound by every working man  context supports dependency  no re-analysis coreference context  he is bound by every working man  context does not support dependency  re-analysis  he refers to Paul Longer reading times (regression path or second-pass durations) in coreference context PREDICTIONS

EYE-TRACKING MEASURES First-pass duration: time spent in a region before moving on or looking back Regression path duration: time from first entering a region until moving the eyes beyond that region, includes regression time Second-pass duration: duration of re-fixations Total fixation duration: the sum of all fixations in a region EYE-TRACKING MEASURES

EXPLANATION OF DIFFERENT MEASURES The clown thinks that he is… Reading Times for word 3 (thinks) First-pass duration = Regression Path duration = Second-pass duration = 6 Total duration = EYE-TRACKING MEASURES

FIRST-PASS DURATION co-ref: Every… thought it… that he could go home early this… binding: Every… thought it… that he could go home early this… FIRST-PASS DURATION

SECOND-PASS DURATION co-ref: Every… thought it… that he could go home early this… binding: Every… thought it… that he could go home early this… SECOND-PASS DURATION

TOTAL FIXATION DURATION co-ref: Every… thought it… that he could go home early this… binding: Every… thought it… that he could go home early this… TOTAL FIXATION DURATION

RESULTS HYPOTHESIS 2 Significant differences in first-pass, second-pass and total fixation duration: longer reading times in coreference context condition RESULTS HYPOTHESIS 2

CONCLUSION Results support hypothesis 2: in an ambiguous situation variable binding has precedence over coreference Consistent with the more general claim: semantics before discourse CONCLUSION

PROBLEMS Are the ambiguous pronouns interpreted as we intended? Is the context before critical pronoun strong enough to bias the interpretation? PROBLEMS

TWO WEB-BASED CONTROL EXPERIMENTS 1)Ask participants how they interpret the pronoun 2)Ask participants to finish the story TWO WEB-BASED CONTROL EXPERIMENTS

CONTROL EXPERIMENT 1 In variable binding context quantified referent is chosen 88.2% of the time In coreference context proper name is chosen 89.5% of the time The pronouns were interpreted as we intended CONTROL EXPERIMENT 1

CONTROL EXPERIMENT 2 Participants finish a story and indicate how the pronoun should be interpreted A working day in the factory is always very tough. Especially today a lot of working men, among them the very old man Paul, could barely cope. Every working man who just like Paul was running out of energy, thought it was very nice that he.. CONTROL EXPERIMENT 2

In variable binding context story continues about quantified referent 89.1% of the time In coreference context story continues about proper name 78.5% of the time Pronoun in coreference condition initially more ambiguous CONTROL EXPERIMENT 2

SOLUTION Use subset of items with no difference between two conditions 24 of original 36 items Variable binding 85.4% and coreference 89.5% SOLUTION

SECOND-PASS DURATION co-ref: Every… thought it… that he could go home early this… binding: Every… thought it… that he could go home early this… SECOND-PASS DURATION

CONCLUSION Results still support hypothesis 2: in an ambiguous situation variable binding has precedence over coreference Consistent with the more general claim: semantics before discourse Consistent with a modular view towards anaphoric processing CONCLUSION

HYPOTHESIS 1: EXPERIMENTAL CONDITIONS variable binding A working day in the factory is always very tough. Especially today a lot of working men could barely cope. Every working man who was running out of energy, thought it was very nice that he could go home early this afternoon. After a hot shower things would probably look better. coreference A working day in the factory is always very tough. Especially today the very old man Paul could barely cope. Paul was running out of energy. It was very nice that he could go home early this afternoon. After a hot shower things would probably look better. HYPOTHESIS 1 experimental conditions

HYPOTHESIS 1: CONTROL CONDITIONS similar to variable binding condition A working day in the factory is always very tough. Especially today a lot of working men could barely cope. All the working men who were running out of energy, thought it was very nice that they could go home early this afternoon. After a hot shower things would probably look better. similar to coreference condition A working day in the factory is always very tough. Especially today the very old man Paul could barely cope. Paul who was running out of energy thought it was very nice that he could go home early this afternoon. After a hot shower things would probably look better. HYPOTHESIS 1 control conditions

PREDICTIONS Longer reading times in coreference condition than variable binding condition If there is interference between two processes: longer reading times in two control conditions compared to experimental conditions PREDICTIONS

EYE-TRACKING MEASURES First-pass duration: time spent in a region before moving on or looking back Regression path duration: time from first entering a region until moving the eyes beyond that region, includes regression time Second-pass duration: duration of re-fixations Total fixation duration: the sum of all fixations in a region EYE-TRACKING MEASURES

EXPLANATION OF DIFFERENT MEASURES The clown thinks that he is… Reading Times for word 3 (thinks) First-pass duration = Regression Path duration = Second-pass duration = 6 Total duration = EYE-TRACKING MEASURES

REGIONS OF ANALYSIS 1initial region variable binding: Every working man who was running out of energy, 1initial region coreference: Paul was running out of energy. 2pre-critical region variable binding: thought it was very nice 2pre-critical region coreference: It was very nice 3critical region: that he 4spill-over region: could go 5pre-final region: home early 6final region: this afternoon. REGIONS OF ANALYSIS

SECOND-PASS DURATION co-ref: Paul… It was… that he could go home early this… binding: Every… thought it… that he could go home early this… SECOND-PASS DURATION

co-ref: Paul… It was… that he could go home early this… binding: Every… thought it… that he could go home early this… SECOND-PASS DURATION

RESULTS HYPOTHESIS 1: No significant differences in first-pass, regression path and total fixation duration Significant difference in second-pass duration in first spill over region: longer reading times in variable binding condition Only variable binding condition differed from control conditions RESULTS HYPOTHESIS 1

CONCLUSION No support for hypothesis 1: variable binding is cheaper than coreference No interference between variable binding and coreference Why the difference between Piñango et al. and these results? CONCLUSION

GENERAL DISCUSSION

GENERAL DISCUSSION HYPOTHESIS 1 No direct support for hypothesis 1: variable binding is cheaper than coreference GENERAL DISCUSSION hypothesis 1

FOLLOWING BURKHARDT Everyone i thinks that he i is not funny. Every clown i thinks that he i is not funny. The clown i thinks that he i is not funny. EXPLANATION?

FOLLOWING BURKHARDT Everyone i thinks that he i is not funny. quantified non-referential Every clown i thinks that he i is not funny. quantified referential The clown i thinks that he i is not funny. referential EXPLANATION?

PROCESSING COSTS 1)quantified non-referential (everyone) is purely variable binding 2)referential (the clown) is coreference 3)quantified referential (every clown) is coreference associated with additional processing costs because the information about the set, provided by the restrictor clown, has to be transferred to the pronoun (e.g., Burkhardt, 2004) EXPLANATION?

IMPLICATION We used quantified referential dependencies in our variable binding condition. This can explain why variable binding is more difficult than coreference in our stimuli Similar results by Carminati, Frazier & Rayner (2002) IMPLICATION

GENERAL DISCUSSION HYPOTHESIS 2 Support for hypothesis 2: in an ambiguous situation variable binding has precedence over coreference Consistent with the more general claim: semantics before discourse Consistent with a modular view towards anaphoric processing The results for hypothesis 1 require further research GENERAL DISCUSSION hypothesis 2

That’s all for today