1. FMRI CORRELATES OF COMPREHENDING REAL-WORLD EVENTS Tatiana Sitnikova, Ph.D. 1,2,4 Alexis Coty 1,2,4 Daphne Robakis 1,2,4 Phillip J. Holcomb, Ph.D. 5 Gina R. Kuperberg, M.D., Ph.D. 2,3,4 W. Caroline West, Ph.D. 1,2,4 1 Dept of Neurology, 2 Martinos Center for Biomedical Imaging, 3 Dept of Psychiatry, Mass Gen Hosp, Boston, MA, USA 4 Harvard Med Sch, Boston, MA, USA 5 Dept of Psychology, Tufts Univ, Medford, MA, USA

2. Introduction How do we use visual information to comprehend real-world events? Static pictures Naturalistic video clips Paradigm: Contextual anomalies

3. anomalous ending Contextual Anomaly Paradigm with Videos c o n t e x t congruous ending anomalous ending

4. Introduction: Electrophysiological Findings -2µV 400 800 1200 1600 ms N400 effect LPC effect congruous final scene anomalous final scene Cz Pz

5. Stimuli 40 congruous and 40 anomalous videos: context 6 s long final scene 2 s long

6. Stimuli: Congruous Video click in the middle of the slide to see the video

7. Stimuli: Anomalous Video click in the middle of the slide to see the video

8. Methods 16 participants, mean age 21 Pseudorandom stimulus presentation including fixation trials Counterbalanced design 3T Siemens MR scanner Event-related fMRI: TR 2 s, TE 25 ms, 33 slices, 3 mm skip 1 mm Talairach and spherical space

9. Timecourse of Hemodynamic Response xcxxcx time (s) 0 6 10 20 30 % signal change

10. Results: Summed Activity between 10 – 18 s in the Left Hemisphere xcxxcx anomalous vs. congruous BA 9 BA 44, 45 congruous vs. fixation p=10 -4 p=.03

11. Results: Anatomical Regions of Interest xcxxcx left posterior-lateral temporal left inferior-frontal gyrus

12. Results: Anatomical Regions of Interest xcxxcx anomalous vs. congruous average activity 10 - 18 s left hemisphere p=.03 p=10 -4 left posterior-lateral temporal time (s) 10 20 30 % signal change solid – congruent; dotted - anomalous 0.9 0.6 0.3

13. Results: Anatomical Regions of Interest xcxxcx anomalous vs. congruous average activity 10 - 18 s left hemisphere left inferior frontal (BA 44, 45) p=.03 p=10 -4 solid – congruent; dotted - anomalous time (s) 0.9 0.6 0.3 10 20 30 % signal change

14. left caudate Results: Anatomical Regions of Interest xcxxcx anomalous vs. congruous average activity 10 - 18 s p=.03 p=10 -4 solid – congruent; dotted - anomalous time (s) 0.9 0.6 0.3 10 20 30 % signal change

15. Discussion: How do fMRI and electrophysiological findings in language and visual real-world events tie together? Anomalies in language and videos Common brain activations Common electrophysiology Temporal cortex Inferior-frontal cortex Basal ganglia N400 LPC

16. Future Directions Understanding cognitive functions of these brain regions Understanding the flow of information between these regions Higher-level visual comprehension Conclusion A wide neural network

17. left inferior frontal (BA 44, 45) left caudate left posterior-lateral temporal Results: Anatomical Regions of Interest xcxxcx Solid – congruent; dotted - anomalous anomalous vs. congruous average activity 10 - 18 s left hemisphere time (s) 0.9 0.6 0.3 10 20 30 % signal change p=.03 p=10 -4