Are the anterior negativities to grammatical violations indexing working memory? Manuel Martin-Loeches, Francisco munoz, Pilar Casado, A. Melcon, C. Fernandez-frias,

Slides:



Advertisements
Similar presentations
Helen Gaeta, David Friedman, & Gregory Hunt Cognitive Electrophysiology Laboratory New York State Psychiatric Institute Differential Effects of Stimulus.
Advertisements

Neuroimaging for Cognitive Research
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
Brain signatures of game play and language processing
ERP Characteristics of Early AD
Working Memory and Nativelikeness in the Processing of Focus Structure Robert Reichle 1 Annie Tremblay 2 Caitlin Coughlin 2 1 Department of Foreign Languages.
Early auditory novelty processing in humans: auditory brainstem and middle-latency responses Slabu L, Grimm S, Costa-Faidella J, Escera C.
Eye Movements and Spoken Language Comprehension: effects of visual context on syntactic ambiguity resolution Spivey et al. (2002) Psych 526 Eun-Kyung Lee.
ERPs to Semantic and Physical Anomalies in Cartoon Videos Jennifer Michelson 1, Courtney Brown 1, Laura Davis 1, Tatiana Sitnikova 2 & Phillip J. Holcomb.
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
Hagoort, P., Brown, C.M., Groothusen, J. (1993) The Syntactic Positive Shift (SPS) as an ERP measure of syntactic processing.
Hemispheric asymmetries and joke comprehension Coulson, S., & Williams, R. F. (2005) Neuropsychologia, 43,
Background Dissociation: ◦ Lexical-gender (king) - recovered directly from the lexicon ◦ Stereotypical-gender (minister) – inferred from pragmatic information.
SPECIFICITY OF ERP TO CHANGE OF EMOTIONAL FACIAL EXPRESSION. Michael Wright Centre for Cognition and Neuroimaging, Brunel University, Uxbridge, UB8 3PH,
Semantic and syntactic processing in Chinese sentence comprehension: Evidence from event-related potentials Zheng Ye, Yue-kia Luo, Angela D. Friederici,
1 S YNTACTIC C OMPLEXITY OF D IFFERENT B ASQUE W ORD O RDERS: E VIDENCE FROM N EUROIMAGE (ERP) Kepa Erdozia (University of the Basque Country) Itziar Laka.
1 The role of structural prediction in rapid syntactic analysis Ellen Lau, Clare Sroud, Silke Plesch, Colin Phillips, 2006 PSYC Soondo Baek.
ERP Correlates of Familiarity- and Recollection-Based Recognition: Modification by Study-Test Repetition Marianne de Chastelaine Cognitive Electrophysiology.
Second Language Proficiency Places Cognitive Constraints on Sentence Processing Noriko Hoshino Department of Psychology The Pennsylvania State University.
Conclusions Funding: NIH R01DC  The ERP findings for the language task are not surprising given that the P600 component has often been evoked by.
P10 04/06/11 1 SPAN Harry Howard - Tulane University.
Word category and verb-argument structure information in the dynamics of parsing Frisch, Hahne, and Friedericie (2004) Cognition.
Change blindness and time to consciousness Professor: Liu Student: Ruby.
Grammaticality Judgments Do you want to come with?20% I might could do that.38% The pavements are all wet.60% Y’all come back now.38% What if I were Romeo.
LA NEUROSINTAXIS 2 13 ABR 2011 – DÍA 37 Neurolingüística del español SPAN 4270 Harry Howard Tulane University.
An electrophysiological study of gender agreement transfer in early language learners Katherine J. Midgley 1,2, Nicole Y. Y. Wicha 3, Phillip J. Holcomb.
METHODOLOGY Experiment 1: - Within-subjects 2 (CW/ RW) x 2 (consistent/ inconsistent) design - 40 experimental items in each condition (total 160) displayed.
Electrophysiological evidence for the role of animacy and lexico-semantic associations in processing nouns within passive structures Martin Paczynski 1,
Studying Memory Encoding with fMRI Event-related vs. Blocked Designs Aneta Kielar.
10/13/10Psyc / Ling / Comm 525 Fall 10 Kim & Osterhout (2005) JML The independence of combinatory semantic processing: Evidence from event-related potentials.
Right hemisphere sensitivity to word & sentence level context: Evidence From Event-Related Brain Potentials. Coulson, S. Federmeier, K.D., Van Petten,
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
Some notes Room Change (as of Thursday) Geological Sciences Stores Rd Course website New course outline (corrected.
An event related potential investigation of complement set reference Joanne Ingram University of Bedfordshire Linda M Moxey University.
As expected, a large N400 effect was observed for all 3 word types in both experiments, |ts|≥7.69, ps
Kim & Osterhout (2005) JML The independence of combinatory semantic processing: Evidence from event-related potentials.
Electrophysiological Processing of Single Words in Toddlers and School-Age Children with Autism Spectrum Disorder Sharon Coffey-Corina 1, Denise Padden.
Bornkessel, Fiebach, Friederici, & Schlesewsky (2004) What individual difference measures best predict differences in language comprehension? –Working.
N400-like semantic incongruity effect in 19-month-olds: Processing known words in picture contexts Manuela Friedrich and Angela D. Friederici J. of cognitive.
An Electrophysiological Investigation of the Effects of Coreference on Word Repetition and Synonymy Jane E. Anderson & Phillip J. Holcomb 2005 Presented.
The effects of working memory load on negative priming in an N-back task Ewald Neumann Brain-Inspired Cognitive Systems (BICS) July, 2010.
Deep structure (semantic) Structure of language Surface structure (grammatical, lexical, phonological) Semantic units have all meaning components such.
Experimental Psychology PSY 433
Sahin, Pinker, Cash, Schomer, & Halgren (2009) Sequential processing of lexical, grammatical, and phonological information within Broca’s area.
Introduction Can you read the following paragraph? Can we derive meaning from words even if they are distorted by intermixing words with numbers? Perea,
Neural correlates of morphological decomposition in a morphologically rich language : An fMRI study Lehtonen, M., Vorobyev, V.A., Hugdahl, K., Tuokkola.
Detecting Violations In Real- And Counterfactual- World Contexts: Eye-movements And ERP Analysis Heather J Ferguson, Anthony J Sanford & Hartmut Leuthold.
Osterhout (1997) B&L On the brain response to syntactic anomalies: Manipulations of word position and word class reveal individual differences.
ERPs in language acquisition
RESEARCH QUESTIONS Might having to lie still without moving, or having to lie down rather than sit up, change the pattern of neural activity in very young.
Without Words for Emotions: Is the emotional processing deficit in alexithymia caused by dissociation or suppression? Christian Sinnott & Dr. Mei-Ching.
‘Potential’ contributions of event-related potentials to the elicitation of different types of knowledge of L2 morphosyntax Kara Morgan-Short University.
Topographic mapping on memory test of verbal/spatial information assessed by event related potentials (ERPs) Petrini L¹², De Pascalis V², Arendt-Nielsen.
Specialization of Neural Mechanisms Underlying Three-stage model in Humor Processing: An ERP study. FENG, Y. J., CHAN, Y. C., *CHEN, H. C. (2014). SPECIALIZATION.
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
Experiment & Results (congruous vs. 1 st person vs. 3 rd person honorific violation)  Experimental conditions (n=120 sets of sentences) Participants:
Willems, Oostenveld, & Hagoort (2008)  EEG tends to be oscillatory  Composed of several different frequency bands  Fourier Decomposition  Theta (4-6.
Introduction to ERPs.
A Darren Parker Presentation
Lecture 3: Functional Phrases
Contact Discussion and Conclusion
Neurofeedback of beta frequencies:
Motor Processing and Brain Activity are Related to Cognitive-Behavioral Improvement in Chronic Tic and Habit Disorders Irina Branet1,2 Caroline Hosatte-Ducassy1,4.
Evoked Response Potential (ERP) and Face Stimuli N170: negative-going potential at 170 ms Largest over the right parietal lobe,
Noriko Hoshino Department of Psychology
Paul E. Dux, Jason Ivanoff, Christopher L. Asplund, René Marois  Neuron 
Common ERPs BCS204 Week 5.2 2/13/2019.
Volume 59, Issue 5, Pages (September 2008)
Episodic retrieval of visually rich items and associations in young and older adults: Evidence from ERPs Kalina Nennstiel & Siri-Maria Kamp Neurocognitive.
Presentation transcript:

Are the anterior negativities to grammatical violations indexing working memory? Manuel Martin-Loeches, Francisco munoz, Pilar Casado, A. Melcon, C. Fernandez-frias, Psychophysiology 42, 2005, Presented by Dora Lu, 09/13/2006

ERP Component: N400 Kutas & Hillyard. (1980).

ERP Component: P600 Osterhout & Nicol (1999)

Anterior Negativities Neville et al (1991): Semantic anomaly: The scientist criticized Max’s event of the theorem. Phrase structure violation: The scientist criticized Max’s of proof the theorem. Specificity constraint violation: What did the scientist criticize Max’s proof of? Subjacency Constraint violation: What was a proof of criticized by the scientist?

Neville et al (1991) N400 N125 P500

Neville et al (1991): difference wave

(early) (left) Anterior Negativities A negative component that peaks between ms after stimulus onset, usually with anterior distribution, sometimes lateralized (e.g. Neville et al 1991)

When will (early) (left) Anterior Negativities appear? Grammatical violations Word category violations (disrupt the building of the phrase structure) – early left anterior negativity (e.g. Friederici et al 1996) Syntactic-category violation: The metal was refined by the goldsmith who was honored. The metal was for refined by the goldsmith who was honored. Syntactic-category ambiguity: The metal was for refining melted by the goldsmith who was honored. The metal was/became refining melted by the goldsmith who was honored. Morphosyntactic violations (gender/number agreement, verb inflection violations) – anterior negativity (e.g. Vos et al. 2001) The tourist have a busy schedule and visit the theater that very famous is. The tourist have a busy schedule and visits the theater that very famous is. The tourist that a busy schedule have, visit the theater that very famous is. The tourist that a busy schedule have, visits the theater that very famous is. Working memory demand (Kluender & Kutas 1993)

What these anterior negativities represent for? Reflect automatic first-pass parsing process, such as detecting morphosyntactic mismatch, inability to build the phrase structure (e.g. Hagoort 2003) Reflecting working memory operation or working memory load. AN have been found in grammatically well-formed sentences that demand large amount of working memory resources. (e.g. Kluender & Kutas 1993) The amplitude of LAN to morphosyntactic violations was affected by the working memory span of the subjects. (e.g. Vos et al 2001)

Unsettled issues about AN: When will you see AN? Grammatical violations: morphosyntactic and word category violations Do these two grammatical violations reflect the same process? (Friederici 2002: word category >> morphosyntactic process, but Hagoort 2003: artifacts of the moment when the violation appears) Different distribution of AN: because of different grammatical violations are used Whether it is related to working memory operations? Controversial – some studies failed to elicit it, effects are small, distribution is not consistent

Current Study Directly compare responses caused by working memory with those caused by grammatical manipulations. Two grammatical violations: word category & morphosyntactic violations Working memory load: relative clauses vs short, SR vs OR (structural difficulties)

Experimental stimuli Short sentence: (The composer edited the opera.) Correct: El compositor edito la opera. Category violation: El compositor edicion la opera. Morphosyntactic violation: El compositor edite la opera. Center embedded subject relative clause: (The composer [that hated the singer] edited the opera.) El compositor [que odio al cantante] edito la opera. El compositor [que odio al cantante] edicion la opera. El compositor [que odio al cantante] edite la opera. Center embedded object relative clause: (The composer [that the singer hated] edited the opera.) El compositor [que el cantante odio] edito la opera. El compositor [que el cantante odio] edicion la opera. El compositor [que el cantante odio] edite la opera.

Methods Participants: 32 Spanish speakers Stimuli: 180 sets (60 simple sentences, 60 SR, 60 OR) fillers (40 ungrammatical sentences with different violations) Word-by word center presentation, 300ms duration, 500ms SOA, 1500ms between each sentence Participants perform grammaticality judgment Recordings: 29 electrodes

Behavioral results Grammaticality judgment: People did pretty good for the grammaticality judgments. 93.2% for grammatical and 97.3% for ungrammatical sentences. People did worse for correct sentences with an object-relative clause (86.4%). Reaction time: People spent 100ms more to respond to correct OR clauses. (683ms for short, 792ms for OR, 618 for SR)

ERP results: Relative Clause region S: The composer edited the opera. SR: The composer [that hated the singer] edited the opera. OR: The composer [that the singer hated] edited the opera. Onset of 1 st word 1000ms, 3 rd word AN: both SR & OR

ERP results: Relative Clause region S: The composer edited the opera. SR: The composer [that hated the singer] edited the opera. OR: The composer [that the singer hated] edited the opera. Frontal distribution, slightly lateralized

ERP results: Relative Clause region SR: The composer [that hated the singer] edited the opera. OR: The composer [that the singer hated] edited the opera. 4 th word, 1500ms after sentence onset, OR has increasing AN, and more centrally distributed

ERP results: Main verb region (short) S: El compositor edito la opera. WV: El compositor edicion la opera. MV: El compositor edite la opera. AN P600 More bilateral

ERP results: Main verb region (SR) C: El compositor [que odio al cantante] edito la opera. WV: El compositor [que odio al cantante] edicion la opera. MV: El compositor [que odio al cantante] edite la opera. Only WC has posterior negativity! P600 larger for MV

ERP results: Main verb region (OR) C: El compositor [que el cantante odio] edito la opera. WV: El compositor [que el cantante odio] edicion la opera. MV: El compositor [que el cantante odio] edite la opera. No AN P600

ERP results: Main verb of relative clause S: The composer edited the opera. SR: The composer [that hated the singer] edited the opera. OR: The composer [that the singer hated] edited the opera. SR vs short: Long duration effect, wide frontal or frontal- central start about 200ms SR vs OR: long duration effect has parietal distribution

Comparing working memory related and syntactical related negativities 4 frontal negativities related to working memory 2 frontal negativities related to grammatical violations Frontal negativities related to grammatical violations has narrower distribution (Fig. 2)

Discussion Frontal negativities related to grammatical violation and working memory are qualitatively different in terms of topography and duration. Left lateralization is more reliable for grammatical related negativities Negativities related to working memory has wider distribution, involving most of the anterior part Duration could be one criterion to dissociate the two types of negativities. Working memory related negativities display longer duration. The syntactic operations involved in grammatical violation and working memory may not be independent. When working memory resources are demanded, the AN that reflects grammatical violations is reduced.  two types negativities are different but might from the same resource.

Discussion Two types of grammatical violations do not differ significantly. No latency difference. Found parietal negativities in SR word category violation.  probably because local structural differences. There is an ambiguity about whether the wrong noun should be an adjective or a verb. C: El compositor [que odio al cantante] edito la opera. WV: El compositor [que odio al cantante] edicion la opera Coulson et al (1998) Pronoun Case: The plane took *we to paradise and back. The plane took us to paradise and back. Verb agreement: Every Monday he *mow the lawn. Every Monday he mows the lawn.

Discussion Why bilateral parietal long duration negativities rather than AN in SR and OR’s main verb region?  could be grammatical and themantic role assignment in OR The P600 is larger in morphosyntactic violation than word category violation.  Morphosyntactic violations induce reanalysis and repair operation.

So, are you convinced? Negativities reflect at least two different cognitive processes. Although processes are different, they might use the same resources. But…will different types of grammatical violations yield the same results? Different degrees of grammatical violations. For example, verb/noun violation vs noun/preposition violations. Can we generalize that AN functions as a grammatical mismatch detector? Or just a detector for processing difficulties? Or could it reflect attention shift?