Misinterpretation of Garden-Path Sentences: Implications for Models of Sentence Processing and Reanalysis by Ferreira et al. Kate Kokhan Department of.

Slides:



Advertisements
Similar presentations
Close Reading A revision guide to question types.
Advertisements

Knowledge as JTB Someone S has knowledge of P IFF: 1. S believes P 2. S is justified in believing P 3. P is true.
Eye Movements and Spoken Language Comprehension: effects of visual context on syntactic ambiguity resolution Spivey et al. (2002) Psych 526 Eun-Kyung Lee.
Sentence Processing III Language Use and Understanding Class 12.
SEMANTICS.
Language and Cognition Colombo, June 2011 Day 2 Introduction to Linguistic Theory, Part 4.
Lost on the garden path: Exploring misinterpretation and “good enough” language processing Kiel Christianson Dept. of Educational Psychology & Beckman.
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
Statistical NLP: Lecture 3
Introduction and Jurafsky Model Resource: A Probabilistic Model of Lexical and Syntactic Access and Disambiguation, Jurafsky 1996.
1 The role of structural prediction in rapid syntactic analysis Ellen Lau, Clare Sroud, Silke Plesch, Colin Phillips, 2006 PSYC Soondo Baek.
Amirkabir University of Technology Computer Engineering Faculty AILAB Efficient Parsing Ahmad Abdollahzadeh Barfouroush Aban 1381 Natural Language Processing.
Installment 10b. Raising, etc CAS LX 522 Syntax I.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Spring 2006-Lecture 4.
Language, Mind, and Brain by Ewa Dabrowska Chapter 2: Language processing: speed and flexibility.
PSY 369: Psycholinguistics Language Comprehension: The role of memory.
Models of Generative Grammar Smriti Singh. Generative Grammar  A Generative Grammar is a set of formal rules that can generate an infinite set of sentences.
Linguistic Theory Lecture 3 Movement. A brief history of movement Movements as ‘special rules’ proposed to capture facts that phrase structure rules cannot.
Test Taking Tips How to help yourself with multiple choice and short answer questions for reading selections A. Caldwell.
The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye movements Yuki Kamide, Gerry T.M. Altman, and Sarah L.
Albert Gatt LIN 3098 Corpus Linguistics. In this lecture Some more on corpora and grammar Construction Grammar as a theoretical framework Collostructional.
CAS LX 502 Semantics 3a. A formalism for meaning (cont ’ d) 3.2, 3.6.
Robert Hass CIS 630 April 14, 2010 NP NP↓ Super NP tagging JJ ↓
Syntax Lecture 8: Verb Types 1. Introduction We have seen: – The subject starts off close to the verb, but moves to specifier of IP – The verb starts.
Ferreira and Henderson (1990)
Dr. Monira Al-Mohizea MORPHOLOGY & SYNTAX WEEK 12.
1 Natural Language Processing Lecture 11 Efficient Parsing Reading: James Allen NLU (Chapter 6)
Exam Taking Kinds of Tests and Test Taking Strategies.
An Intelligent Analyzer and Understander of English Yorick Wilks 1975, ACM.
May 2006CLINT-LN Parsing1 Computational Linguistics Introduction Parsing with Context Free Grammars.
PS: Introduction to Psycholinguistics Winter Term 2005/06 Instructor: Daniel Wiechmann Office hours: Mon 2-3 pm Phone:
Avoiding the Garden Path: Eye Movements in Context
1 LIN 1310B Introduction to Linguistics Prof: Nikolay Slavkov TA: Qinghua Tang CLASS 24, April 3, 2007.
Linguistic Essentials
Critical Reading: Sentence Completion Step 3: Strategies.
COMMAS and SEMICOLONS.
Rules, Movement, Ambiguity
E BERHARD- K ARLS- U NIVERSITÄT T ÜBINGEN SFB 441 Coordinate Structures: On the Relationship between Parsing Preferences and Corpus Frequencies Ilona Steiner.
Results of Eyetracking & Self-Paced Moving Window Studies DO-Bias Verbs: The referees warned the spectators would probably get too rowdy. The referees.
The effects of working memory load on negative priming in an N-back task Ewald Neumann Brain-Inspired Cognitive Systems (BICS) July, 2010.
The Minimalist Program
1 LIN 1310B Introduction to Linguistics Prof: Nikolay Slavkov TA: Qinghua Tang CLASS 16, March 6, 2007.
Introduction Chapter 1 Foundations of statistical natural language processing.
Welcome! EWRT1A Composition and Reading. Agenda Extra Credit Available Workshop Rough Draft Introductions and Thesis Statements Homework.
Unit 8 Syntax. Syntax Syntax deals with rules for combining words into sentences, as well as with relationship between elements in one sentence Basic.
Subject-specific content: A Generic scoring guide for information-based topics 4 The student has a complete and detailed understanding of the information.
Guidelines for Writing Surveys A number of resources available ◦ Survey Research by Backstrom and Hursh- Casar ◦ Survey Research Methods by Fowler.
Instructor Availability AIM address: EleBranch Office Hours: Mondays & Thursdays 9:00 p.m. to 10:00 p.m. And by appointment.
Punctuation Commas Mme Adèle. How do you effectively use commas when writing? We will look at a series of rules developed by author Jane Staus in order.
Run-Together Sentences How to Identify and Fix. Run-Together Sentences Run-together sentences occur when two sentences are joined with no punctuation.
Lecture 1: Trace Theory.  We have seen that things move :  Arguments move out of the VP into subject position  Wh-phrases move out of IP into CP 
LOGO Change blindness in the absence of a visual disruption Professor: Liu Student: Ruby.
1 Some English Constructions Transformational Framework October 2, 2012 Lecture 7.
An Introduction to Semantic Parts of Speech Rajat Kumar Mohanty rkm[AT]cse[DOT]iitb[DOT]ac[DOT]in Centre for Indian Language Technology Department of Computer.
CAS LX 502 9b. Formal semantics Pronouns and quantifiers.
Scholastic Aptitude Test Developing Critical Reading Skills Doc Holley.
Chapter 11 Language. Some Questions to Consider How do we understand individual words, and how are words combined to create sentences? How can we understand.
1 Vocabulary acquisition from extensive reading: A case study Maria Pigada and Norbert Schmitt ( 2006)
Chapter 3 Language Acquisition: A Linguistic Treatment Jang, HaYoung Biointelligence Laborotary Seoul National University.
Genetic Programming. What is Genetic Programming? GP for Symbolic Regression Other Representations for GP Example of GP for Knowledge Discovery Outline.
Lecture 2: Categories and Subcategorisation
Syntax Lecture 9: Verb Types 1.
Statistical NLP: Lecture 3
Syntax Analysis Chapter 4.
Chapter Eight Syntax.
Chapter Eight Syntax.
The Nature of Learner Language (Chapter 2 Rod Ellis, 1997) Page 15
Linguistic Essentials
CSA2050 Introduction to Computational Linguistics
Presentation transcript:

Misinterpretation of Garden-Path Sentences: Implications for Models of Sentence Processing and Reanalysis by Ferreira et al. Kate Kokhan Department of Linguistics University of Illinois at Urbana-Champaign

Outline What is a garden-path sentence? Motivation for the research by Ferreira et al. Description of the experiments and the findings Implications for reanalysis: Fodor and Inoue (1998)

What is a garden-path sentence? A garden path sentence is a grammatically correct sentence that starts in such a way that a reader's most likely interpretation is an incorrect one, luring him initially into an improper parse that then turns out to be a dead end. The "garden path" is a reference to the saying "to be led down the garden path", meaning "to be misled.“

Motivation for the research Previous work on how garden-path sentences are processed had barely addressed how these sentences are actually understood. No data on the question of whether people understand these sentences the way we presume they should.

Motivation of the research General goal was “to discover how people understand language” Many studies showed that people had problem understanding some sentences (if they are presented visually without punctuation): While Anna dressed the baby spit up on the bed. The baby is the object of dressed When they encounter spit up => error

Models of reanalysis Goal of all models of reanalysis is to describe and motivate the mechanisms used by the parser to detect errors, deduce useful information about the nature of the necessary repair from those errors, and ultimately to create successful parse. Is reanalysis always successful? – No => Another goal of models of reanalysis is to explain why it is that successful revision is possible for some sentences but impossible for others.

What does influence the ease of reanalysis? Ferreira & Henderson (1991, 1998) => While Anna dressed the baby that was small and cute spit up on the bed. the error signal the head of the misanalysed phrase Reanalysis is more difficult if the head of the misanalysed phrase is distant from the error signal! However, the length of the sentence is not important.

Christianson et al.’s experiments 3 experiments but the same paradigm: Participant were asked to read garden-path sentences or corresponding control sentences They answered YES/NO questions Indicated their confidence in that answer Primary dependent measures are question- answering accuracy and confidence.

Experiment 1: Stimuli (1a) While Bill hunted the deer (that was brown and graceful) ran into the woods. G-P (1b) While Bill hunted the deer (that was brown and graceful) paced in the zoo. G-P (1c) While Bill hunted the pheasant the deer (that was brown and graceful) ran into the woods. Non-G-P Difference between (a) and (b) => the plausibility of misinterpretation Note: each participant saw only one out of the 6 possible versions but experience each of the 6 conditions. Read the sentences at their own pace.

Experiment 1: continuation (1a) While Bill hunted the deer (that was brown and graceful) ran into the woods. (1b) While Bill hunted the deer (that was brown and graceful) paced in the zoo. (1c) While Bill hunted the pheasant the deer (that was brown and graceful) ran into the woods. Question: Did Bill hunt the deer? If people answer YES to (a) and (b) => they did not end up with the appropriate interpretation for the sentences. If they say YES if the material in the parenthesis is included => tendency to say YES is attributable to the initial syntactic misanalysis

Results of Experiment 1

Experiment 2 With 2 innovations: Instead of using the control condition, they created non-garden-path conditions by reversing the order of the subordinate and main clauses => The deer ran into the woods while the man hunted Asked people two questions: Did the man hunt the deer? + Did the deer run into the woods? Note: both phrases were long instead of short vs. long in Experiment 1

Experiment 2: Stimuli (2a) While Bill hunted the brown and graceful deer/ the deer that was brown and graceful ran into the woods. (2b) The brown and graceful deer/ the deer that was brown and graceful ran into the woods while Bill hunted. Questions: Did Bill hunt the deer? or Did the deer run into the woods?

Experiment 2: Results

Experiment 3 To avoid the inference: when someone is intransitively hunting, he or she may be hunting a deer => Reflexive Absolute Transitive (RAT) verbs, e.g. dress and bathe Two sub-experiments: 1. The non-GP condition was created by reversing the order of the subordinate clause. 2x2 design= a sentence was either G-Pathing or not and the verb was either normal or RAT 2. They varied whether or not a comma separated the subordinate and the main clause: While Anna dressed, the baby spit up on the bed. The same 2x2 design

Experiment 3: Results

Explanation of the results The general reasoning argument: High numbers of incorrect answers to the comprehension questions stem from pragmatic inference: the man is hunting, and the deer, which is a common quarry for hunters, is running away => the man is possibly hunting the deer.

Evidence against a general reasoning arguments 1. The strong head position effect in Experiment 2=> no obvious reason why “the deer that was brown and furry” should be more likely to be inferred to the quarry of the hunt than “the brown and furry deer”, yet the subjects were more likely to derive an incorrect interpretation from the former construction than from the latter. 2. Elimination of syntactic ambiguity without changing the information load: reversing the clause order and separating the clauses with a comma => significantly fewer incorrect YES responses than the GP sentences 3. Use of RAT verbs =>participants had trouble reaching the correct interpretation of RAT verbs in the GP conditions => Pragmatic inferencing cannot account for the misinterpretation effect in the GP conditions.

Final explanation of the results Some garden-path sentences were completely reanalyzed but for others, no reanalysis occurred. The significant proportion of incorrect YES responses in the GP conditions could have been attributed to guessing on the trials on which the reanalysis did not take place = > evidence against this possibility. Some degree of reanalysis must have taken place for the NP initially parsed as the object of the subordinate clause to be recruited as the subject of the matrix clause.

Nonsyntactic factors cannot account for the data. Thus… Two alternative explanations: Radical (that reanalysis terminates with and the parser settles on a structure that is not licensed by the principles of human syntax) The NP that is necessary for the main clause is stolen from the subordinate clause, yet not erased from the original position =>this explanation is consistent with a model of parsing and reanalysis by Fodor and Inoue (1998)

Fodor and Inoue (1998) “Attach Anyway” => directs the parser simply to attach an incoming element even if it does not fit into the current phrase marker, temporarily ignoring the ungrammaticality that results “Adjust” =>resolves the grammatical conflict minimally, so that the adjustment may result in yet another conflict elsewhere in the tree. Adjust then moves on to correct that conflict and so on. Note: Adjust is constrained by Grammatical Dependency Principle (GDP)=>Adjust operations apply between nodes that are in some sort of a grammatical relationship: a head and its argument or a verb and its subject

Fodor and Inoue (1998) Reanalysis of the sentences used in Ferreira et al.’s experiments does not involve elements in such a relationship => in such circumstances, Fodor and Inoue suggest that the parser engages in “theft”, i.e. the lexical string the deer is stolen from the subordinate clause and assigned a position in a matrix clause, in violation of GDP. Theft could result in the dual thematic role assignment of Theme and Agent to deer because when GDP is violated the backward repair operations (Adjust) that are normally set in motion by Attach Anyway do not take place. as a result, the parser would not end up being able to return to the subordinate verb, re-access the lexicon, and locate its intransitive argument structure. The subordinate verb would, therefore, remain transitive, yielding a structure that could support the dual Theme/Agent (mis)interpretation.

Fodor and Inoue (1998) For the plausible sentences (e.g. While the man hunted the deer ran into the woods, the overall interpretation is checked according to the Minimal Revisions Principle (MRP) MRP: any revisions deemed necessary and consistent with the error signal should maintain as much of the initially assigned structure and interpretation as possible. The MRP predicts that the proposition stating that the man hunted the deer would not necessarily be erased, because that interpretations should be maintained to the extent possible.

Fodor and Inoue (1998) RAT verbs=> reanalysis differs The correct analysis of the sentence While Anna dressed the baby spit up on the bed had the parser assigning the role of Theme to an empty category after dressed, resulting in a specific theme for the verb dressing (Anna herself). contrasts with While Bill hunted the deer ran into the woods: hunt’s Theme role cannot be assigned to any syntactic constituent at all. Therefore, the interpretation that must be created is generic: Bill hunted something or other. The participants’ level of confidence suggests that they are relatively insensitive to any violations that might result from the early termination of Adjust operations

General conclusion “It appears that people work on sentences until they reach a point where it subjectively makes sense to them and then processing may cease… these garden-path sentences somehow produce an illusion of comprehension in our participant...They will be misunderstood despite the best attempts of the comprehender to come up with a correct analysis”