1. Experimental Design Christian Ruff With thanks to: Rik Henson Daniel Glaser Christian Ruff With thanks to: Rik Henson Daniel Glaser

2. RealignmentSmoothing Normalisation General linear model Statistical parametric map (SPM) Image time-series Parameter estimates Design matrix Template Kernel Gaussian field theory p <0.05 Statisticalinference

3. OverviewOverview Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions

4. Aim:Aim: – Brain structures underlying process P? Procedure:Procedure: – Contrast: [Task with P] – [control task without P ] = P  the critical assumption of „pure insertion“ Aim:Aim: – Brain structures underlying process P? Procedure:Procedure: – Contrast: [Task with P] – [control task without P ] = P  the critical assumption of „pure insertion“ Cognitive Subtraction - = Brain structures computing face recognition? Example:Example: – Brain areas involved in face recognition? Example:Example: – Brain areas involved in face recognition?

5. Cognitive Subtraction: Baseline-problems -  Several components differ ! „Distant“ stimuli „Distant“ stimuli -  P implicit in control condition ? „Roger“ „My yoga teacher?“ „Roger“ „My yoga teacher?“ „Related“ stimuli „Related“ stimuli Name Person! Name Gender! -  Interaction of process and task ? -  Interaction of process and task ? Same stimuli, different task Same stimuli, different task

6. Differential event-related fMRI Inferotemporal response to faces SPM{F} testing for evoked responses Evoked responses: „Rest“ baseline “Baseline” here corresponds to session mean (and thus processing during “rest”) “Baseline” here corresponds to session mean (and thus processing during “rest”) Null events or long SOAs essential for estimation Null events or long SOAs essential for estimation “Cognitive” interpretation hardly possible, but useful to define regions generally involved in the task “Cognitive” interpretation hardly possible, but useful to define regions generally involved in the task “Baseline” here corresponds to session mean (and thus processing during “rest”) “Baseline” here corresponds to session mean (and thus processing during “rest”) Null events or long SOAs essential for estimation Null events or long SOAs essential for estimation “Cognitive” interpretation hardly possible, but useful to define regions generally involved in the task “Cognitive” interpretation hardly possible, but useful to define regions generally involved in the task

7. Experimental design Word generationG Word repetitionR R G R G R G R G R G R G Experimental design Word generationG Word repetitionR R G R G R G R G R G R G G - R = Intrinsic word generation …under assumption of pure insertion G - R = Intrinsic word generation …under assumption of pure insertion A categorical analysis

8. OverviewOverview Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions

9. One way to minimise the baseline/pure insertion problem is to isolate the same process by two or more separate comparisons, and inspect the resulting simple effects for commonalitiesOne way to minimise the baseline/pure insertion problem is to isolate the same process by two or more separate comparisons, and inspect the resulting simple effects for commonalities A test for such activation common to several independent contrasts is called “Conjunction”A test for such activation common to several independent contrasts is called “Conjunction” Conjunctions can be conducted across a whole variety of different contexts:Conjunctions can be conducted across a whole variety of different contexts: tasks tasks stimuli stimuli senses (vision, audition) senses (vision, audition) etc. etc. But the contrasts entering a conjunction have to be truly independent!But the contrasts entering a conjunction have to be truly independent! One way to minimise the baseline/pure insertion problem is to isolate the same process by two or more separate comparisons, and inspect the resulting simple effects for commonalitiesOne way to minimise the baseline/pure insertion problem is to isolate the same process by two or more separate comparisons, and inspect the resulting simple effects for commonalities A test for such activation common to several independent contrasts is called “Conjunction”A test for such activation common to several independent contrasts is called “Conjunction” Conjunctions can be conducted across a whole variety of different contexts:Conjunctions can be conducted across a whole variety of different contexts: tasks tasks stimuli stimuli senses (vision, audition) senses (vision, audition) etc. etc. But the contrasts entering a conjunction have to be truly independent!But the contrasts entering a conjunction have to be truly independent!ConjunctionsConjunctions

10. Example: Which neural structures support object recognition, independent of task (naming vs viewing)? Example: Which neural structures support object recognition, independent of task (naming vs viewing)? A1A1A2A2 B2B2B1B1 Task (1/2) Naming Viewing Stimuli (A/B) Colours Objects Visual Processing V Object Recognition R Phonological Retrieval P (Object - Colour viewing) & (Object - Colour naming)  [1 -1 0 0] & [0 0 1 -1]  [ R,V - V ] & [ P,R,V - P,V ] = R & R = R (assuming no interaction RxP; see later) Visual Processing V Object Recognition R Phonological Retrieval P (Object - Colour viewing) & (Object - Colour naming)  [1 -1 0 0] & [0 0 1 -1]  [ R,V - V ] & [ P,R,V - P,V ] = R & R = R (assuming no interaction RxP; see later) ConjunctionsConjunctions Price et al, 1997 Common object recognition response (R ) Common object recognition response (R )

11. ConjunctionsConjunctions

12. SPM8 offers two general ways to test the significance of conjunctions: SPM8 offers two general ways to test the significance of conjunctions: Test of global null hypothesis: Significant set of consistent effectsTest of global null hypothesis: Significant set of consistent effects  “which voxels show effects of similar direction (but not necessarily individual significance) across contrasts?” Test of conjunction null hypothesis: Set of consistently significant effectsTest of conjunction null hypothesis: Set of consistently significant effects  “which voxels show, for each specified contrast, effects > threshold?” Choice of test depends on hypothesis and congruence of contrasts; the global null test is more sensitive (i.e., when direction of effects hypothesised)Choice of test depends on hypothesis and congruence of contrasts; the global null test is more sensitive (i.e., when direction of effects hypothesised) SPM8 offers two general ways to test the significance of conjunctions: SPM8 offers two general ways to test the significance of conjunctions: Test of global null hypothesis: Significant set of consistent effectsTest of global null hypothesis: Significant set of consistent effects  “which voxels show effects of similar direction (but not necessarily individual significance) across contrasts?” Test of conjunction null hypothesis: Set of consistently significant effectsTest of conjunction null hypothesis: Set of consistently significant effects  “which voxels show, for each specified contrast, effects > threshold?” Choice of test depends on hypothesis and congruence of contrasts; the global null test is more sensitive (i.e., when direction of effects hypothesised)Choice of test depends on hypothesis and congruence of contrasts; the global null test is more sensitive (i.e., when direction of effects hypothesised) Two flavours of inference about conjunctions A1-A2 B1-B2 p(A1=A2)<p + + p(B1=B2)<p + + Friston et al.Neuroimage, 25:661-7. Friston et al. (2005). Neuroimage, 25:661-7. Nichols et al. (2005). Neuroimage, 25:653-60. Friston et al.Neuroimage, 25:661-7. Friston et al. (2005). Neuroimage, 25:661-7. Nichols et al. (2005). Neuroimage, 25:653-60.

13. OverviewOverview Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions

14. Parametric Designs: General Approach Parametric designs approach the baseline problem by:Parametric designs approach the baseline problem by: – Varying a stimulus-parameter of interest on a continuum, in multiple (n>2) steps... –... and relating blood-flow to this parameter Flexible choice of tests for such relations :Flexible choice of tests for such relations : LinearLinear Nonlinear: Quadratic/cubic/etc.Nonlinear: Quadratic/cubic/etc. „Data-driven“ (e.g., neurometric functions)„Data-driven“ (e.g., neurometric functions) Model-basedModel-based Parametric designs approach the baseline problem by:Parametric designs approach the baseline problem by: – Varying a stimulus-parameter of interest on a continuum, in multiple (n>2) steps... –... and relating blood-flow to this parameter Flexible choice of tests for such relations :Flexible choice of tests for such relations : LinearLinear Nonlinear: Quadratic/cubic/etc.Nonlinear: Quadratic/cubic/etc. „Data-driven“ (e.g., neurometric functions)„Data-driven“ (e.g., neurometric functions) Model-basedModel-based

15. Adaptation: Linear effects of time? Adaptation: A linear parametric contrast

16. Adaptation: Nonlinear effects of time? Adaptation: A nonlinear parametric contrast

17. Inverted ‘U’ response to increasing word presentation rate in the DLPFC Inverted ‘U’ response to increasing word presentation rate in the DLPFC SPM{F}SPM{F} Polynomial expansion: f(x) ~ f(x) ~ b 1 x + b 2 x 2 +... …up to (N-1)th order for N levels Polynomial expansion: f(x) ~ f(x) ~ b 1 x + b 2 x 2 +... …up to (N-1)th order for N levels E.g, F-contrast [0 1 0] on Quadratic Parameter => E.g, F-contrast [0 1 0] on Quadratic Parameter => Nonlinear parametric design matrix (SPM8 GUI offers polynomial expansion as option during creation of parametric modulation regressors) Linear change Quadratic change Mean response

18. Parametric Designs: Neurometric functions Rees, G., et al. (1997). Neuroimage, 6: 27-78 versusversus Inverted ‘U’ response to increasing word presentation rate in the DLPFC Inverted ‘U’ response to increasing word presentation rate in the DLPFC Rees, G., et al. (1997). Neuroimage, 6: 27-78

19. Parametric Designs: Neurometric functions Coding of tactile stimuli in Anterior Cingulate Cortex: Stimulus (a) presence, (b) intensity, and (c) pain intensity – – Variation of intensity of a heat stimulus applied to the right hand (300, 400, 500, and 600 mJ) Coding of tactile stimuli in Anterior Cingulate Cortex: Stimulus (a) presence, (b) intensity, and (c) pain intensity – – Variation of intensity of a heat stimulus applied to the right hand (300, 400, 500, and 600 mJ) Büchel et al. (2002). The Journal of Neuroscience, 22: 970-6 – : – Assumptions:

20. Parametric Designs: Neurometric functions Büchel et al. (2002). The Journal of Neuroscience, 22: 970-6  Stimulus presence  Pain intensity  Stimulus intensity

21. Parametric Designs: Model-based regressors Seymour, O‘Doherty, et al. (2004). Nature.

22. OverviewOverview Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions

23. A1A1A2A2 B2B2B1B1 Task (1/2) Naming Viewing Naming Viewing Stimuli (A/B) Colours Objects Colours Objects Colours Objects Colours Objects Colours Objects interaction effect (Task x Stimuli) (Task x Stimuli) interaction effect (Task x Stimuli) (Task x Stimuli) ViewingViewingNamingNaming Factorial designs: Main effects and Interactions Main effect of task:(A1 + B1) – (A2 + B2)Main effect of task:(A1 + B1) – (A2 + B2) Main effect of stimuli: (A1 + A2) – (B1 + B2)Main effect of stimuli: (A1 + A2) – (B1 + B2) Interaction of task and stimuli: Can show a failure of pure insertionInteraction of task and stimuli: Can show a failure of pure insertion (A1 – B1) – (A2 – B2) Main effect of task:(A1 + B1) – (A2 + B2)Main effect of task:(A1 + B1) – (A2 + B2) Main effect of stimuli: (A1 + A2) – (B1 + B2)Main effect of stimuli: (A1 + A2) – (B1 + B2) Interaction of task and stimuli: Can show a failure of pure insertionInteraction of task and stimuli: Can show a failure of pure insertion (A1 – B1) – (A2 – B2)

24. Interactions and pure insertion Object-naming-specific activations Context: no naming naming adjusted rCBF Components Visual processingV Object recognition R Phonological retrievalP InteractionRxP Interaction (name object - colour) - (view object - colour)  [1 -1 0 0] - [0 0 1 -1] = [ P,R,V + RxP - P,V ] - [ R,V - V ] = RxP Components Visual processingV Object recognition R Phonological retrievalP InteractionRxP Interaction (name object - colour) - (view object - colour)  [1 -1 0 0] - [0 0 1 -1] = [ P,R,V + RxP - P,V ] - [ R,V - V ] = RxP

25. Interactions and pure insertion Interactions:simpleandcross-over We can selectively inspect our data for one or the other by masking during inference Interactions:simpleandcross-over A1 A2 B1 B2

26. OverviewOverview Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions

27. A linear Time-by-ConditionInteraction (“difference in adaptation for repeating vs generating”) A linear Time-by-ConditionInteraction (“difference in adaptation for repeating vs generating”) Contrast: [5 3 1 -1 -3 -5]  [-1 1] = [-5 5 -3 3 -1 1 1 -1 3 -3 5 -5] Contrast: [5 3 1 -1 -3 -5]  [-1 1] = [-5 5 -3 3 -1 1 1 -1 3 -3 5 -5] Linear Parametric Interaction

28. Factorial Design with 2 factors: 1. Gen/Rep (Categorical, 2 levels) 2. Time (Parametric, 6 levels) Time effects modelled with both linear and quadratic components… Factorial Design with 2 factors: 1. Gen/Rep (Categorical, 2 levels) 2. Time (Parametric, 6 levels) Time effects modelled with both linear and quadratic components… G-R Time Lin Time Lin G x T Lin G x T Lin Time Quad Time Quad G x T Quad G x T Quad F-contrast tests for nonlinear Generation-by-Time interaction (including both linear and Quadratic components) F-contrast tests for nonlinear Generation-by-Time interaction (including both linear and Quadratic components) Nonlinear Parametric Interaction

29. OverviewOverview Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions

30. ContextContext sourcesource targettarget XX Parametric, factorial design, in which one factor is a psychological context …...and the other is a physiological source (activity extracted from a brain region of interest) Parametric, factorial design, in which one factor is a psychological context …...and the other is a physiological source (activity extracted from a brain region of interest) Psycho-physiological Interaction (PPI)

31. stimulistimuli Modulation of stimulus-specific responses sourcesource targettarget SetSet Context-sensitiveconnectivityContext-sensitiveconnectivity sourcesource targettarget Parametric, factorial design, in which one factor is a psychological context …...and the other is a physiological source (activity extracted from a brain region of interest) Parametric, factorial design, in which one factor is a psychological context …...and the other is a physiological source (activity extracted from a brain region of interest) Psycho-physiological Interaction (PPI)

32. Attentional modulation of V1 - V5 contribution Attentional modulation of V1 - V5 contribution AttentionAttention V1V1 V5V5 Psycho-physiological Interaction (PPI) V1 Att V1 x Att 0 0 1

33. SPM{Z} Attentional modulation of V1 - V5 contribution Attentional modulation of V1 - V5 contribution AttentionAttention V1V1 V5V5 attention no attention V1 activity V5 activity time V1 activity Psycho-physiological Interaction (PPI)

34. Stimuli: Faces or objects Stimuli: PPCPPC ITIT Psycho-physiological Interaction (PPI) PPC Stim PPC x Stim 0 0 1

35. adjusted rCBF medial parietal activity FacesFaces ObjectsObjects Stimuli: Faces or objects Stimuli: PPCPPC ITIT SPM{Z}SPM{Z} Psycho-physiological Interaction (PPI)

36. PPIs tested by a GLM with form:PPIs tested by a GLM with form: y = (V1  A).b 1 + V1.b 2 + A.b 3 + ec = [1 0 0] However, the interaction term of interest, V1  A, is the product of V1 activity and Attention block AFTER convolution with HRFHowever, the interaction term of interest, V1  A, is the product of V1 activity and Attention block AFTER convolution with HRF We are really interested in interaction at neural level, but:We are really interested in interaction at neural level, but: (HRF  V1)  (HRF  A)  HRF  (V1  A) (unless A low frequency, e.g., blocked; mainly problem for event-related PPIs) SPM8 can effect a deconvolution of physiological regressors (V1), before calculating interaction term and reconvolving with the HRF – the “PPI button”SPM8 can effect a deconvolution of physiological regressors (V1), before calculating interaction term and reconvolving with the HRF – the “PPI button” PPIs tested by a GLM with form:PPIs tested by a GLM with form: y = (V1  A).b 1 + V1.b 2 + A.b 3 + ec = [1 0 0] However, the interaction term of interest, V1  A, is the product of V1 activity and Attention block AFTER convolution with HRFHowever, the interaction term of interest, V1  A, is the product of V1 activity and Attention block AFTER convolution with HRF We are really interested in interaction at neural level, but:We are really interested in interaction at neural level, but: (HRF  V1)  (HRF  A)  HRF  (V1  A) (unless A low frequency, e.g., blocked; mainly problem for event-related PPIs) SPM8 can effect a deconvolution of physiological regressors (V1), before calculating interaction term and reconvolving with the HRF – the “PPI button”SPM8 can effect a deconvolution of physiological regressors (V1), before calculating interaction term and reconvolving with the HRF – the “PPI button” Psycho-physiological Interaction (PPI)

37. OverviewOverview Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions