1. Event-related gamma-band activity in visual object representation: the coding of object features Jasna Martinovic Thomas Gruber * Matthias M. Müller * School of Psychology, University of Liverpool * Department of Experimental Psychology, University of Leipzig X ICON, Bodrum, Turkey, 2008

2. Outline Introduction Visual object representation Coding of object features Methods Experimental section 1) surface detail (contours, texture, colour) 2) visual complexity (low or high complexity) 3) colour typicality in colour diagnostic objects Conclusions

3. Visual Object Representation EXTRACTION OF OBJECTS FROM IMAGES Low-level: Edges Texture Colour IN VISUAL PROCESSING Mid-level: surfaces In 2.5/3D High-level: categorical Knowledge City; Buildings; Trees, Lampposts; Liver Building; Pierhead; Liverpool

4. Coding of object features Object representation can be achieved ultra-rapidly based on very few features in images of natural scenes (Simon Thorpe’s group). VanRullen & Thorpe, 2001, JoCN Early object-related effects reflect systematic low-level differences while late effects reflect the decision process; this is likely to be based on feed- forward processing of magnocellular input. Animal vs. vehicle 80 ms Target vs. non-target 150 ms

5. Coding of texture and colour? Object representations are task-relevant as well as context-dependent – they can also rely on other features (Tanaka et al., 2001). Animal Superordinate Bird Basic Bluebird Subordinate Shape Texture Colour Entry-level Entry-level is the level of identification of objects in everyday experience, wherein their names are being accessed.

6. Neural markers of visual object representation Cortical object representation occurs through formations of distributed synchronously-firing neural assemblies, coding for each of the various object features (Tallon-Baudry and Betrand, 1999) blue feathery texture shape flies about High-frequency oscillatory activity (gamma-band of the EEG) Evoked GBA – feature representation; induced GBA – object representation

7. Experimental design Experiment 3: Colour typicality Typical Atypical Naor-Raz et al., 2003 Experiment 2: Visual complexity Low complexity High complexity Ellis & Morrison, 1998 Line drawing Texture & shading Colour Rossion & Pourtois, 2004 Experiment 1: Surface detail

8. Procedure x Fixation (500-700 ms) Stimulus (650 ms) Fixation (1650 ms) End of trial; blink (900 ms) [time for response: 2300 ms ] Grammatical gender decision task Martinovic et al., 2008, Brain Research

9. Gamma-band analysis EVOKED + INDUCED: Average of single trials in the freq.domain EVOKED: Average of single trials (ERP) 128 electrode Biosemi ActiveTwo Amplifier System SCADS artifact correction (Junghoefer et al., 2000) incorrect trials excluded average trial rejection rate <30% average of 40-50 trials remaining average reference used EEG RECORDING:

10. Hypotheses EVOKED GBA: Sensory processing of image features (Karakas & Basar, 1998) INDUCED GBA: Cortical object representation (Tallon-Baudry & Bertrand, 1999) Surface detail enhancement no modulation Visual complexity enhancement Colour typicality no modulation EVOKED GBA: INDUCED GBA: AMPLITUDE MODULATIONS

11. Reaction Times Experiment 3: Colour typicality Experiment 2: Visual complexity Experiment 1: Surface detail (No effects across participants) 1200 1000 800 600 400 200 0 Line Texture Colour Colour diagnostic p<0.05 1200 1000 800 600 400 200 0 LowHigh Conceptual complexity p<0.001 1200 1000 800 600 400 TypicalAtypical 200 0 p<0.01

12. Evoked GBA – Surface Detail -0.1 [μV] 0 0.1 0.2 -100 0100200400300 [ms] 30 60 30 60 30 60 [Hz] 40 50 40 50 Line drawing Texture Colour 50-130 ms 0.14 0.7 -0.14 -0.7 0 [μV] Oz O2 O1 0 0.02 0.04 0.06 0.08 0.1 0.12 0.14 0.16 0.18 Line drawingTextureColour [μV] F(2,16)=3.50 p<0.05 -2 0 1 2 3 4 5 [μV] -5050100150200250300350 400 line drawing texture coloured P1 ***

13. Evoked GBA – Visual Complexity 50-130 ms [μV] 0 0.1 0.2 0.3 [μV] -100 400 [ms] 30 60 30 60 40 50 [Hz] 0100200300 50 40 Low High 0.22 0.11 -0.22 -0.11 0 [μV] Oz O1 O2 POz PO3 PO4 0 0.05 0.1 0.15 0.2 0.25 Low visual complexity High visual complexity t (17) = -4.19 p<0.001 -2 0 1 2 3 4 5 6 7 -100-5050100150200250300350400 low comp. high comp. [μV] P1 ***

14. Evoked GBA – Colour Typicality 50-140 ms 0.12 0.6 -0.12 -0.6 0 [μV] Oz O1O2 0 0.02 0.04 0.06 0.08 0.1 0.12 0.14 TypicalAtypical t (25) = -0.75 -0.05 0.05 0.1 0.15 [μV] -100 0 100200400300 [ms] 30 60 30 60 40 50 40 50 0 Typical Atypical [Hz] [μV] -100-50050100150200250300350 400 0 1 2 3 4 5 6 7 8 typical atypical P1

15. ERPs Experiment 3: Colour typicality Experiment 2: Visual complexity Experiment 1: Surface detail -100 -3.5 -3 -2.5 -2 -1.5 -0.5 0.5 1 1.5 -50050100150200250300350400450 [μV] [ms] N350 -5050100150200250300350400450 -100 -5 -4 -3 -2 0 1 [ms] [μV] N350 -100-5050100150200250300350400450 -5 -4 -3 -2 0 1 [μV] [ms] N350 Shorter latencies for coloured objects Amplitude increase for more complex objects Amplitude increase for atypically coloured objects

16. Induced GBA 40 60 80 -1000100200300400500 40 60 80 [ms] [Hz] -0.1 -0.05 0 0.05 [μV] [Hz] 30 40 50 60 80 -1000100200300400500 30 40 50 60 70 80 [ms] -0.1 -0.05 0 0.05 [μV] -100 0100200300400500 30 50 70 80 30 40 50 60 80 30 40 50 60 70 80 [Hz] [ms] Line drawing Texture Colour 0 0.05 -0.05 -0.1 [μV] Typical Atypical Low comp. High comp. Experiment 1: Surface detail Experiment 2: Visual complexity Experiment 3: Colour typicality

17. Evoked GBA primarily reflects the quantitative processing of object features Early synchronizations may be sufficient for relatively crude discrimination of objects in visual scenes (Frϋnd et al. 2008) but cannot support entry-level categorization. Induced GBA remained unmodulated in amplitude by object features. It seems to reflect the communality of object-related conceptual processes and is not so reliant on the coding of basic perceptual features. Conclusions blue feathery texture shape flies about Superordinate Identification (animal) Entry-level Identification (bird) ?

18. Acknowledgments Renate Zahn Sophie Trauer Søren Andersen Tobias Forderer Research has been funded by the DFG and DAAD J.M. is supported by an ESRC Postdoctoral Fellowship

20. -0.02 0 0.02 0.04 0.06 0.08 0.1 50100150200250300350400 Induced GBA Waveforms Experiment 3: Colour typicality Experiment 2: Visual complexity Experiment 1: Surface detail 40-60 Hz, Grand Means -0.01 0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 50100150200250300350400 [μV] low comp. high comp. typical atypical -0.06 -0.04 -0.02 0 0.02 0.04 0.06 0.08 50100150200250300350400 line drawing texture coloured