Hagoort, P., Brown, C.M., Groothusen, J. (1993) The Syntactic Positive Shift (SPS) as an ERP measure of syntactic processing.

Slides:



Advertisements
Similar presentations
Accessing spoken words: the importance of word onsets
Advertisements

CS460/IT632 Natural Language Processing/Language Technology for the Web Lecture 2 (06/01/06) Prof. Pushpak Bhattacharyya IIT Bombay Part of Speech (PoS)
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
ERP correlates of retrieval orientation: cue- related and item-related measures Jane E. Herron and Edward L. Wilding, School of Psychology, Cardiff University.
Working Memory and Nativelikeness in the Processing of Focus Structure Robert Reichle 1 Annie Tremblay 2 Caitlin Coughlin 2 1 Department of Foreign Languages.
Early auditory novelty processing in humans: auditory brainstem and middle-latency responses Slabu L, Grimm S, Costa-Faidella J, Escera C.
18 and 24-month-olds use syntactic knowledge of functional categories for determining meaning and reference Yarden Kedar Marianella Casasola Barbara Lust.
Word Imagery Effects on Explicit and Implicit Memory Nicholas Bube, Drew Finke, Darcy Lemon, and Meaghan Topper.
Syntactic analysis using Context Free Grammars. Analysis of language Morphological analysis – Chairs, Part Of Speech (POS) tagging – The/DT man/NN left/VBD.
Are the anterior negativities to grammatical violations indexing working memory? Manuel Martin-Loeches, Francisco munoz, Pilar Casado, A. Melcon, C. Fernandez-frias,
ERPs to Semantic and Physical Anomalies in Cartoon Videos Jennifer Michelson 1, Courtney Brown 1, Laura Davis 1, Tatiana Sitnikova 2 & Phillip J. Holcomb.
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
Learning linguistic structure with simple recurrent networks February 20, 2013.
Hemispheric asymmetries and joke comprehension Coulson, S., & Williams, R. F. (2005) Neuropsychologia, 43,
Background Dissociation: ◦ Lexical-gender (king) - recovered directly from the lexicon ◦ Stereotypical-gender (minister) – inferred from pragmatic information.
Semantic and syntactic processing in Chinese sentence comprehension: Evidence from event-related potentials Zheng Ye, Yue-kia Luo, Angela D. Friederici,
1 The role of structural prediction in rapid syntactic analysis Ellen Lau, Clare Sroud, Silke Plesch, Colin Phillips, 2006 PSYC Soondo Baek.
Amirkabir University of Technology Computer Engineering Faculty AILAB Efficient Parsing Ahmad Abdollahzadeh Barfouroush Aban 1381 Natural Language Processing.
Second Language Proficiency Places Cognitive Constraints on Sentence Processing Noriko Hoshino Department of Psychology The Pennsylvania State University.
Languages and Grammars MSU CSE 260. Outline Introduction: E xample Phrase-Structure Grammars: Terminology, Definition, Derivation, Language of a Grammar,
Models of Generative Grammar Smriti Singh. Generative Grammar  A Generative Grammar is a set of formal rules that can generate an infinite set of sentences.
Statistical Natural Language Processing. What is NLP?  Natural Language Processing (NLP), or Computational Linguistics, is concerned with theoretical.
11 CS 388: Natural Language Processing: Syntactic Parsing Raymond J. Mooney University of Texas at Austin.
The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye movements Yuki Kamide, Gerry T.M. Altman, and Sarah L.
Emergence of Syntax. Introduction  One of the most important concerns of theoretical linguistics today represents the study of the acquisition of language.
Albert Gatt LIN 3098 Corpus Linguistics. In this lecture Some more on corpora and grammar Construction Grammar as a theoretical framework Collostructional.
 (Worse) The number of banks charging their customers ATM user fees are increasing.  (Better) The number of banks charging their customers ATM user.
Empirical Methods in Information Extraction Claire Cardie Appeared in AI Magazine, 18:4, Summarized by Seong-Bae Park.
1 Statistical NLP: Lecture 10 Lexical Acquisition.
Word category and verb-argument structure information in the dynamics of parsing Frisch, Hahne, and Friedericie (2004) Cognition.
Change blindness and time to consciousness Professor: Liu Student: Ruby.
“How much context do you need?” An experiment about context size in Interactive Cross-language Question Answering B. Navarro, L. Moreno-Monteagudo, E.
Introduction How do people recognize objects presented in pictorial form? The ERP technique has been shown to be extremely useful in studies where the.
An electrophysiological study of gender agreement transfer in early language learners Katherine J. Midgley 1,2, Nicole Y. Y. Wicha 3, Phillip J. Holcomb.
METHODOLOGY Experiment 1: - Within-subjects 2 (CW/ RW) x 2 (consistent/ inconsistent) design - 40 experimental items in each condition (total 160) displayed.
Electrophysiological evidence for the role of animacy and lexico-semantic associations in processing nouns within passive structures Martin Paczynski 1,
Some notes Room Change (as of Thursday) Geological Sciences Stores Rd Course website New course outline (corrected.
An event related potential investigation of complement set reference Joanne Ingram University of Bedfordshire Linda M Moxey University.
As expected, a large N400 effect was observed for all 3 word types in both experiments, |ts|≥7.69, ps
Capturing patterns of linguistic interaction in a parsed corpus A methodological case study Sean Wallis Survey of English Usage University College London.
Reading Comprehension Exercises Online: The Effects of Feedback, Proficiency and Interaction Betty, Frances, Gordon & Judith.
Electrophysiological Processing of Single Words in Toddlers and School-Age Children with Autism Spectrum Disorder Sharon Coffey-Corina 1, Denise Padden.
Computational linguistics A brief overview. Computational Linguistics might be considered as a synonym of automatic processing of natural language, since.
N400-like semantic incongruity effect in 19-month-olds: Processing known words in picture contexts Manuela Friedrich and Angela D. Friederici J. of cognitive.
Rules, Movement, Ambiguity
E BERHARD- K ARLS- U NIVERSITÄT T ÜBINGEN SFB 441 Coordinate Structures: On the Relationship between Parsing Preferences and Corpus Frequencies Ilona Steiner.
The Critical Period for Language Acquisition: Evidence from Second Language Learning CATHERINE E. SNOW AND MARIAN HOEFNAGEL-HÖHLE UNIVERSITY OF AMSTERDAM.
Introduction Can you read the following paragraph? Can we derive meaning from words even if they are distorted by intermixing words with numbers? Perea,
Concepts and Realization of a Diagram Editor Generator Based on Hypergraph Transformation Author: Mark Minas Presenter: Song Gu.
Principal components analysis (PCA) as a tool for identifying EEG frequency bands: I. Methodological considerations and preliminary findings Jürgen Kayser,
Detecting Violations In Real- And Counterfactual- World Contexts: Eye-movements And ERP Analysis Heather J Ferguson, Anthony J Sanford & Hartmut Leuthold.
Learning Event Durations from Event Descriptions Feng Pan, Rutu Mulkar, Jerry R. Hobbs University of Southern California ACL ’ 06.
NATURAL LANGUAGE PROCESSING
Osterhout (1997) B&L On the brain response to syntactic anomalies: Manipulations of word position and word class reveal individual differences.
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
‘Potential’ contributions of event-related potentials to the elicitation of different types of knowledge of L2 morphosyntax Kara Morgan-Short University.
Chapter 3 Language Acquisition: A Linguistic Treatment Jang, HaYoung Biointelligence Laborotary Seoul National University.
King Faisal University جامعة الملك فيصل Deanship of E-Learning and Distance Education عمادة التعلم الإلكتروني والتعليم عن بعد [ ] 1 King Faisal University.
Willems, Oostenveld, & Hagoort (2008)  EEG tends to be oscillatory  Composed of several different frequency bands  Fourier Decomposition  Theta (4-6.
EXPLICIT AND IMPLICIT SECOND LANGUAGE TRAINING Morgan-Short et al.
Child Syntax and Morphology
Advanced Computer Systems
Contact Discussion and Conclusion
Theoretical and empiral rationale for using unrestricted PCA solutions
Word Imagery Effects on Explicit and Implicit Memory
Adrian G. Fischer, Markus Ullsperger  Neuron 
Noriko Hoshino Department of Psychology
Common ERPs BCS204 Week 5.2 2/13/2019.
Volume 59, Issue 5, Pages (September 2008)
Presentation transcript:

Hagoort, P., Brown, C.M., Groothusen, J. (1993) The Syntactic Positive Shift (SPS) as an ERP measure of syntactic processing

Introduction The data in this study may prove useful for resolving an ongoing debate in parsing research about the nature of processing of the parser: two approaches

Debate:  Autonomous approach: computation is based on syntactic principles. Lexical, semantic and pragmatic information have their influence only after syntactic parse is delivered   Separate  Separate level for the syntactic structure of a sentence is required.

Debate:  Interactive approach: syntactic information is directly integrated with lexical and semantic/pragmatic information, i.e., non syntactic sources are used either to direct the parser initial analysis or to evaluate immediately the outcome of syntactic analysis on a word-by- word basis.   No separate level of representation is required.

How to resolve this debate?  There is no sufficient empirical evidence  Existing chronometric techniques may not pick on the small effects of the parsing process  Re-analysis can be so fast, that it is difficult to observe

ERP method - advantages Empirical evidence from reaction times Sensitivity of ERP’s to the representational level (qualitatively different cognitive processes show up in different waveforms) If there are separate processing components producing output at different level of representation  there are distinct brain correlates to semantic and syntactic processing

Previous studies dealing with the ERP responses to syntactic violations Kutas & Hillyard (1983): first study to investigate ERP responses to syntactic errors Osterhout & Holcomb (1992): ERP responses to the syntactic violations (verb sub-categorization and phrase structure constraints) Neville et al. (1991): violations of constraints on the movement of wh-phrases

Summary of the previous research Syntactic violations do not show N400 effect shown for semantic anomaly Syntactic violations show P600 family positivities However, the results are not robust as the studies have not resulted in the global ERP index of parsing syntactic operations

Problems with the previous studies The number of studies is too limited to draw conclusions regarding the existence and nature of syntactic ERP responses Studies on parsing have been done on English only The question is whether specific syntactic violations in English result in similar ERP effect as the same syntactic violation in other languages (i.e., Dutch)

Current study Its goal is to investigate ERP manifestations of syntactic parsing (electrophysiological response that is qualitatively different from semantic parsing) – Syntactic Positive Shift (SPS) Although it may not provide the answer, it opens the way for a novel empirical investigation Syntactic processing is studied based on the following three syntactic violations in Dutch:

Choice of syntactic violation Should help optimize the likelihood that the subjects detect the violations All violations can be locally processed by detecting a mismatch between syntactic specifications of immediately adjacent elements or elements separated by a determiner (size of syntactic buffer is kept to a minimum) All three types are different at the level of the grammar and semantics  Will reflect ERP responses to different types of syntactic information

Types of syntactic violations in Dutch  Agreement:  subject-NP and finite verb do not agree in number (*On a rainy day the old man buy a life insurance.)

Types of syntactic violations in Dutch  Subcategorization:  verb that does not take an object NP is followed by a noun which has a role of grammatical object (*The tired young man elapsed the book on the floor.)

Types of syntactic violations in Dutch  Phrase structure:  obligatory word order violation-in Dutch, in NPs consisting of Adj and Adv, the Adv should precede the Adj (*Most of the visitors like the colourful very tulips in Holland.)

SVO and VSO agreement violation Violations between verbs and nouns: on either finite verbs or subject nouns within the same sentence (i.e., the subject noun could be singular in combination with plural form of the verb)

Examples: SVO and VSO agreement violation (the CW is italicized)

Subcategorization violation Involves obligatory intransitive verbs, which take a noun as a direct object In Dutch, unlike English, no continuation is possible following the noun in object position

Examples: subcategorization

Phrase structure violation Consist of nouns preceded by transpositions of adverbs and adjectives In Dutch, it’s a violation to have an Adj-Adv- Noun sequence

Sample sentences: adjective-adverb- noun sequence

Method Total of 360 sentences – 50% grammatically correct and 50% contain grammatical violation Each incorrect sentence is derived from the companion correct sentence such that words preceding and following the word string that makes the sentence ungrammatical are the same as the companion correct sentence The sentences are matched in number of words Other than specific violations, the sets of 180 correct and incorrect sentences are closely matched  well controlled

Criteria for violations Immediate (restricted to two adjacent words in a clause, or by a triplet of words) The Critical Word has a counterpart in its companion correct sentences The CW is either verb or noun, max length = 9 and min length = 4 At least 3 words preceding the CW and at least two words following the CW

Experiment design Two experimental lists 180 sentences each (90 correct and 90 incorrect, each made of 30 sentences of each violation type) Order: pseudo-randomized for each list (no > than 3 incorrect or correct sentences occur) The experiment included two parts:  Grammaticality Judgment Pretest: to ascertain that the syntactic violations were perceived by the subjects as such  The ERP experiment

Grammaticality Judgment Pretest: Results The subjects correctly identified the violations The majority of responses were either to CW or the word immediately following the CW  Choosing a CW as a point of ungrammaticality in a sentence is a valid method

The ERP experiment Subjects: 34 University students, all native speakers of Dutch, mean age=23 years old, range years Procedure:  The stimuli were displayed in the same manner as in a pretest (word by word, each word was presented for 300 ms with an ISI=300 ms, the ITI depended on number of words in a sentence)

The ERP experiment  EEG activity has been recorded using an Electrocap with seven scalp electrodes, each referred to the left mastoid  Sampling started 150 msec before the presentation of the first word of each sentence  Total sampling epoch = 8550 msec  Task: comprehending the whole sentence  No other task assigned  The subjects were told that there were incorrect sentences, but no information on violations was provided

Average waveforms were computed by subject for correct and incorrect sentence for each of the violation types Calculations are done separately for each of the seven electrodes The baseline for CW and its preceding position was chosen Each violation analyzed separately Results

Grand average waveforms by electrode site for the critical word in the correct and incorrect agreement condition (see page ) Results by violation: Agreement

CWs have widely distributed positive shift (the waveforms for the incorrect CW have a widely distributed positive shift in comparison to the correct words, which starts at around 500 msec following the onset of the CW and continues throughout the following word ) Analysis on each position (to test if the shift occurs on both grammatical words and CWs):  Positions preceding the CW  Penultimate and sentence-final positions  the shift is different on those positions (p ) Agreement: Data analysis

 The waveforms do not show the same positive shift to the CW  However, the waveforms show a sustained positive shift preceding and on the CW  This shift is most prominent at the Fz and right anterior sites, where it is in a position following the CW  Frontal positivity is absent or marginal at the Cp or P lateral sites (p ) Subcategorization: Data analysis

The waveforms at the CW are characterized by a positive shift with the broad scalp distribution for the incorrect CW in the latency window of msec The positivity is present from the immediate onset of the CW (p ) The negative shift for the incorrect condition is very similar to subcategorization and agreement conditions Phrase structure: Data analysis

The CW in the incorrect agreement and phrase-structure conditions have a positive shift compared to the correct conditions Most probably it results from the syntactic violation on the CW There is no significant positive shift in the subcategorization condition Summary of the results

All three violations have a significant negative shift for the incorrect condition on the sentence-final, and penultimate positions The negativity most probably results from the semantic analysis problems originating in syntactic violations Summary (continued)

Major result – the widely distributed positivity elicited by two of three syntactic violations: starts at about 500 msec, with a centro-parietal maximum (very similar to the P600 reported by Osterhout and Holcomb) SPS is different from N400 resulting from semantic violations Brain seems to process syntactic information differently from semantic one Discussion

The SPS is not an ERP response to violations only: in phrase structure violations, it occurs one word BEFORE the syntactic violation (due to the parser’s attempt to entertain the possibility of statistically infrequent but nevertheless grammatical construction “Determiner-Adj-Adv-Adj-Noun”) This is consistent with other empirical evidence that the parser avoids keeping all the possibilities open until the disambiguating information is received  Discussion (continued)

 The parser operates on the basis of the principle of computational economy or on the basis of the frequency of alternative syntactic constructions The SPS occurs in the absence of other tasks  the “surprise” account of the observed positivity is less likely Both open- and closed- class of words trigger SPS  the possibility that SPS is related to a word class is ruled out Discussion (continued)

The subcategorization violation results which differ from two other violation types are not only syntactic, but also semantic by necessity (verb meaning and its syntactic aspect are closely intertwined)  it is possible that “semantic” negativity and “syntactic” positivity occurred on the same word However, it may also be a methodological fallacy: it should be also tested on the closed class of words or using “syntactic prose” Discussion: problems encountered

It is hardly possible to avoid the constellation of semantic and syntactic violation The obtained results do allow for strong claims regarding temporal relation between parsing operations and semantic integration processes It is unclear if SPS is time-locked to the initial structural assignment or to the processor’s rejection of this first assignment Discussion: problems encountered (continued)

Although the results do not allow for conclusions that can resolve this debate, they show that there is some intermediate level of syntactic representation, which is computed, or a process of syntactic re-analysis initiated upon encountering a structural violation. At the level of language processing there is a relation between syntactic processing and “syntactic” positivity in the ERP waveform. Autonomous or interactive parsing?

Positive shift is a manifestation of a functionally distinct process in computation of syntactic structures A new label is assigned to this ERP response: SPS The obtained positivity can be related to the domain of syntactic parsing It is a common brain response to very different types of syntactic violations Autonomous or interactive parsing?

The end