Semantic and syntactic processing in Chinese sentence comprehension: Evidence from event-related potentials Zheng Ye, Yue-kia Luo, Angela D. Friederici,

Slides:



Advertisements
Similar presentations
Accessing spoken words: the importance of word onsets
Advertisements

All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
Working Memory and Nativelikeness in the Processing of Focus Structure Robert Reichle 1 Annie Tremblay 2 Caitlin Coughlin 2 1 Department of Foreign Languages.
Figure 2. L2 Cognates vs. L2 Non-cognates in both language groups at the anterior electrode site Fz (finding A). Figure 3. L2 Cognates vs. L2 Non-cognates.
I Disappoint You or You Disappoint Me: L2 Acquisition of English Psych Verbs by Chinese EFL Learners Ai-li C. Hsin ( 忻愛莉 ) English Dept., NKNU
Eye Movements and Spoken Language Comprehension: effects of visual context on syntactic ambiguity resolution Spivey et al. (2002) Psych 526 Eun-Kyung Lee.
Sentence Processing III Language Use and Understanding Class 12.
Language Use and Understanding BCS 261 LIN 241 PSY 261 CLASS 12: BRANIGAN ET AL.: PRIMING.
18 and 24-month-olds use syntactic knowledge of functional categories for determining meaning and reference Yarden Kedar Marianella Casasola Barbara Lust.
Shallow Processing Eva M. Fernández Queens College & Graduate Center City University of New York.
Are the anterior negativities to grammatical violations indexing working memory? Manuel Martin-Loeches, Francisco munoz, Pilar Casado, A. Melcon, C. Fernandez-frias,
Prosodic facilitation and interference in the resolution of temporary syntactic closure ambiguity Kjelgaard & Speer 1999 Kent Lee Ψ 526b 16 March 2006.
Syntax Lecture 10: Auxiliaries. Types of auxiliary verb Modal auxiliaries belong to the category of inflection – They are in complementary distribution.
ERPs to Semantic and Physical Anomalies in Cartoon Videos Jennifer Michelson 1, Courtney Brown 1, Laura Davis 1, Tatiana Sitnikova 2 & Phillip J. Holcomb.
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
Hagoort, P., Brown, C.M., Groothusen, J. (1993) The Syntactic Positive Shift (SPS) as an ERP measure of syntactic processing.
Hemispheric asymmetries and joke comprehension Coulson, S., & Williams, R. F. (2005) Neuropsychologia, 43,
Sentence Memory: A Constructive Versus Interpretive Approach Bransford, J.D., Barclay, J.R., & Franks, J.J.
1 The role of structural prediction in rapid syntactic analysis Ellen Lau, Clare Sroud, Silke Plesch, Colin Phillips, 2006 PSYC Soondo Baek.
Read this article for Friday next week [1]Chelazzi L, Miller EK, Duncan J, Desimone R. A neural basis for visual search in inferior temporal cortex. Nature.
How do we process text with spatial information? Marijn E. Struiksma*, Matthijs L. Noordzij**, Bas F.W. Neggers*** & Albert Postma* *Universiteit Utrecht.
Language, Mind, and Brain by Ewa Dabrowska Chapter 2: Language processing: speed and flexibility.
Theoretical Models of Attention. Broadbent (1958) conceptualized attention as information processing Used a cuing paradigm to show that attentional selection.
Early effects of morphological complexity on visual evoked fields in MEG Eytan Zweig & Liina Pylkkänen New York University 80 th Annual LSA meeting, January.
 The misinformation effect refers to incorrect recall or source attribution of an item presented after a to-be-remembered event as having been presented.
Linguistic Theory Lecture 2 Phrase Structure. What was there before structure? Classical studies: Classical studies: –Languages such as Latin Rich morphology.
Conclusions Funding: NIH R01DC  The ERP findings for the language task are not surprising given that the P600 component has often been evoked by.
Liu, Perfetti, & Wang (2006) as summarized by Scott Hajek.
The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye movements Yuki Kamide, Gerry T.M. Altman, and Sarah L.
Language Comprehension Thomas G. Bowers, Ph.D
Experimental study of morphological priming: evidence from Russian verbal inflection Tatiana Svistunova Elizaveta Gazeeva Tatiana Chernigovskaya St. Petersburg.
Word category and verb-argument structure information in the dynamics of parsing Frisch, Hahne, and Friedericie (2004) Cognition.
Prosody-driven Sentence Processing: An Event-related Brain Potential Study Ann Pannekamp, Ulrike Toepel, Kai Alter, Anja Hahne and Angela D. Friederici.
An electrophysiological study of gender agreement transfer in early language learners Katherine J. Midgley 1,2, Nicole Y. Y. Wicha 3, Phillip J. Holcomb.
Electrophysiological evidence for the role of animacy and lexico-semantic associations in processing nouns within passive structures Martin Paczynski 1,
Chapter 10 - Language 4 Components of Language 1.Phonology Understanding & producing speech sounds Phoneme - smallest sound unit Number of phonemes varies.
Adele E. Goldberg. How argument structure constructions are learned.
LEXICAL LEARNING AND GENERALIZATION IN CHILDREN WITH DOWN SYNDROME Abstract LEXICAL LEARNING AND GENERALIZATION IN CHILDREN WITH DOWN SYNDROME Elbouz M.
10/13/10Psyc / Ling / Comm 525 Fall 10 Kim & Osterhout (2005) JML The independence of combinatory semantic processing: Evidence from event-related potentials.
Right hemisphere sensitivity to word & sentence level context: Evidence From Event-Related Brain Potentials. Coulson, S. Federmeier, K.D., Van Petten,
Avoiding the Garden Path: Eye Movements in Context
Some notes Room Change (as of Thursday) Geological Sciences Stores Rd Course website New course outline (corrected.
Training Phase Results The RT difference between gain and loss was numerically larger for the second half of the trials than the first half, as predicted,
LANGUAGE TRANSFER SRI SURYANTI WORD ORDER STUDIES OF TRANSFER ODLIN (1989;1990) UNIVERSAL POSITION WHAT EXTENT WORD ORDER IN INTERLANGUAGE IS.
As expected, a large N400 effect was observed for all 3 word types in both experiments, |ts|≥7.69, ps
Kim & Osterhout (2005) JML The independence of combinatory semantic processing: Evidence from event-related potentials.
Bornkessel, Fiebach, Friederici, & Schlesewsky (2004) What individual difference measures best predict differences in language comprehension? –Working.
English Relative Clauses Subject Relative –The reporter who attacked the senator didn’t check the facts carefully first. Object Relative –The reporter.
N400-like semantic incongruity effect in 19-month-olds: Processing known words in picture contexts Manuela Friedrich and Angela D. Friederici J. of cognitive.
The effects of working memory load on negative priming in an N-back task Ewald Neumann Brain-Inspired Cognitive Systems (BICS) July, 2010.
Investigating the combined effects of word frequency and contextual predictability on eye movements during reading Christopher J. Hand Glasgow Language.
Introduction Can you read the following paragraph? Can we derive meaning from words even if they are distorted by intermixing words with numbers? Perea,
48 Item Sets (Only the results for the relative clause versions are reported here.) The professor (who was) confronted by the student was not ready for.
Tonal Violations Interact with Lexical Processing: Evidence from Cross-modal Priming Meagan E. Curtis 1 and Jamshed J. Bharucha 2 1 Dept. of Psych. & Brain.
Osterhout (1997) B&L On the brain response to syntactic anomalies: Manipulations of word position and word class reveal individual differences.
Syntactic Priming in Sentence Comprehension (Tooley, Traxler & Swaab, 2009) Zhenghan Qi.
Processing Faces with Emotional Expressions: Negative Faces Cause Greater Stroop Interference for Young and Older Adults Gabrielle Osborne 1, Deborah Burke.
Chapter 11 Language. Some Questions to Consider How do we understand individual words, and how are words combined to create sentences? How can we understand.
48 Item Sets (Only the results for the relative clause versions are reported here.) The professor (who was) confronted by the student was not ready for.
‘Potential’ contributions of event-related potentials to the elicitation of different types of knowledge of L2 morphosyntax Kara Morgan-Short University.
By: Angela D. Friederici Presented By: Karol Krzywon.
EXPLICIT AND IMPLICIT SECOND LANGUAGE TRAINING Morgan-Short et al.
Investigating the combined effects of word frequency and contextual predictability on eye movements during reading Christopher J. Hand Glasgow Language.
Contact Discussion and Conclusion
2. Limitations and intepretations of ERPs
Towards a neural basis of auditory sentence processing
Noriko Hoshino Department of Psychology
Volume 59, Issue 5, Pages (September 2008)
The Neural Basis of Language Development and Its Impairment
Presentation transcript:

Semantic and syntactic processing in Chinese sentence comprehension: Evidence from event-related potentials Zheng Ye, Yue-kia Luo, Angela D. Friederici, Xiaolin Zhou Presenter: Brian Lin

Two models in sentence processing Syntax-first models  Parser initially builds a syntactic structure on the basis of word category information independent of lexical- semantic information. Thematic role assignment takes place during a second stage. Interactive models  Syntactic and semantic processes already interact at an early stage.

Friederici ’ s Neurocognitive model of auditory sentence processing

Components  Early LAN (ELAN, 160 ms): word-category errors, and has a maximum over the left anterior scalp.  LAN ( ms): morphosyntactic errors  N400: semantic errors or integration into the preceding context.  P600 ( ms): outright syntactic violations  Friederici claimed that phrase structural violations are correlated with ELAN followed P600.

Syntactic + semantic

Syntactic + semantic condition? What would happen in a syntactic + semantic conditions? Friederici’s predictions:  If syntactic and semantic processing occur in succession  ELAN, N400 and P600  Lexical-semantic info is used early and interacts with syntactic info  different ELAN from pure syntactic violations.  If semantic violation does not influence phrase structure building  ELAN and N400 will be affected since lexical integration is not licensed.

Hahne & Friederici (2002) Passive German sentences, auditory presented. N = 15 adult German college students Grammaticality judgment task

Hahne & Friederici (2002)

Concerns about the 1st Expt Studies on word-word priming effects have shown that a modulation of the N400 component is dependent on attentional mechanisms. Thus the lack of N400 in the combined situation might be due to attentional aspect.

Hahne & Friederici ’ s Expt 2 N = 16 Procedures was identical to the first expt, except that subjects were told to ignore syntactic violations and focus on semantic coherence of the sentences only.

Hahne & Friederici ’ s conclusions The task-induced emphasis on semantics did not affect ELAN. In the case of phrase structure violation semantic integration was not initiated automatically, but could still be initiated by attentional mechanisms.

No ELAN on Takazawa et al. (2002) N = 16 adult Japanese speakers. Stimuli:  correct  Semantic anomalies Violating the dependency b/w a verb and it’s argument.  Syntactic anomalies What-phrase followed by confirmative marker. Stimuli were presented phrase-by-phrase visually. Each phrase was presented for 500ms. ISI also 500ms. Grammaticality judgment task.

No ELAN on Takazawa et al. (2002) N400 for semantic anomalies and P600 for syntactic anomalies. But NO ELAN or LAN. Why?  Due to visual presentation.  Difference in syntactic violation types Neither phrase structure violations nor morphosyntactic violations.

Ye et al. ’ s experiment procedures N=12 Chinese adult speakers Auditory presented stimuli (240 experimental BA sentences and 120 filler sentences). Grammaticality judgment of experimental sentences and only trials with correct responses were analyzed. Stimuli lasted for 1000 ms.

Ba construction (disposal sentence) SVO sentence  我賣了車子。 Iselllecar (I have sold the car.)

Ba construction (disposal sentence) SVO sentence  我賣了車子。 Iselllecar (I have sold the car.) Ba sentence (S BA O V): the direct object is placed immediately after BA and before the verb.  我把車子賣了  I BAcarsellle (I have sold the car.)

Ba construction (disposal sentence) continued It’s not that simple! It’s ok to say…  他買了一輛車。  HebuyleaCLcar (He has bought a car.)

Ba construction (disposal sentence) It’s not that simple! It’s ok to say…  他買了一輛車。  HebuyleaCLcar (He has bought a car.) But weird to use Ba construction here!  * 他把一輛車買了。  *He BAaCLcarbuyle (He has bought a car.)

Ye et al. ’ s experimental conditions Correct 設計師製作新衣,把布料裁了。 Stylistmakenew clothesBAclothtailorle (To make new dresses, the stylist tailored the cloth.) Semantically incorrect 伐木工開採森林,把松樹裁了。 TimberjackexploitforestBApine tailorle (Exploiting the forest, the timberjack tailored pine trees.) Syntactically incorrect 設計師製作新衣,把裁了。 Stylistmakenew clothesBAtailor le (To make new dresses, the stylist tailored.) Combined incorrect 伐木工開採森林,把裁了。 TimberjackexploitforestBAtailor le (Exploiting the forest, the timberjack tailored.)

Predictions What would happen in a syntactic + semantic conditions?  If syntactic and semantic occur in succession  ELAN, N400 and P600  Syntactic phrase structure building independent of semantic processing  ELAN followed by P600  If semantic and syntactic processes interact in later processing stages  N400 and P600 will be affected in some way.

Ye et al. result

ELAN for syn + Combined.

Ye et al. result ELAN for syn + Combined. P600 ? Not sig.

Ye et al. result ELAN for syn + Combined. P600 ? Not sig. Early N400. Bigger for syn + combined

Ye et al. results Syntactic violation: ELAN but no P600 (no significant main effect, and could be due to possible overlap of largely distributed later negativity and P600.) Semantic violation: Early N400  May be due to monosyllabic words took less time to process.  Context dependency from the first clause.

Ye et al. results. Combined violations: pattern similar to syntactic violation, but demonstrate a larger negativity in time window.  Suggest that semantic and syntactic information are processed in parallel in an early phase of comprehension! In Mandarin, semantic and syntactic processes seem to be independent in an early time window and interact in a late processing phase.

Questions and Comments 1. The latency of a component only show the earliest time point when the machine reveals the differences but not necessarily the onset of the cognitive process! 2. In this study, there were only 12 participants and they had all 4 conditions of each verb. Is this usual in ERP research? 3. “It takes less time to process the semantic information in monosyllabic than in polysyllabic.” Shorter words don't necessarily mean that they have simpler information. 4. In both syntactic violation and combined sentences, the violation word didn't exist in the sentence. The early negativity has already detected the violation. There is no need to do further analysis. 5. Visual vs. auditory presentation. Is it possible that the visual presentation affords some small amount of parafoveal processing, however miniscule, that may alter the timing of the phrase processing (and additionally if that is different across the languages)?