1. Experimental Design Christian Ruff With thanks to: Rik Henson Daniel Glaser Christian Ruff With thanks to: Rik Henson Daniel Glaser

2. RealignmentSmoothing Normalisation General linear model Statistical parametric map (SPM) Image time-series Parameter estimates Design matrix Template Kernel Gaussian field theory p <0.05 Statisticalinference

3. OverviewOverview Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions

4. Aim:Aim: – Neuronal structures underlying process P? Procedure:Procedure: – Contrast: [Task with P] – [control task without P ] = P the critical assumption of pure insertion the critical assumption of pure insertion Aim:Aim: – Neuronal structures underlying process P? Procedure:Procedure: – Contrast: [Task with P] – [control task without P ] = P the critical assumption of pure insertion the critical assumption of pure insertion Cognitive Subtraction - Neuronal structures computing face recognition? Example:Example: – Neuronal structures underlying face recognition? Example:Example: – Neuronal structures underlying face recognition?

5. Cognitive Subtraction: Baseline-problems - P implicit in control task ? Queen! Aunt Jenny? Queen! Aunt Jenny? Related stimuli Related stimuli - Several components differ ! Distant stimuli Distant stimuli Name Person! Name Gender! - Interaction of process and task ? - Interaction of process and task ? Same stimuli, different task Same stimuli, different task

6. Differential event-related fMRI Parahippocampal responses to words BOLD EPI fMRI at 2T, TR 3.2sec. Words presented every 16 secs; (i) studied words or (ii) new words SPM{F} testing for evoked responses Evoked responses Baseline here corresponds to session mean (and thus processing during rest) Baseline here corresponds to session mean (and thus processing during rest) Null events or long SOAs essential for estimation Null events or long SOAs essential for estimation Cognitive interpretation hardly possible, but useful to define regions generally involved in the task Cognitive interpretation hardly possible, but useful to define regions generally involved in the task Baseline here corresponds to session mean (and thus processing during rest) Baseline here corresponds to session mean (and thus processing during rest) Null events or long SOAs essential for estimation Null events or long SOAs essential for estimation Cognitive interpretation hardly possible, but useful to define regions generally involved in the task Cognitive interpretation hardly possible, but useful to define regions generally involved in the task

7. Differential event-related fMRI Parahippocampal responses to words BOLD EPI fMRI at 2T, TR 3.2sec. Words presented every 16 secs; (i) studied words or (ii) new words SPM{F} testing for evoked responses Differential responses Peri-stimulus time {secs} SPM{F} testing for differences studied words new words

8. Experimental design Word generationG Word repetitionR R G R G R G R G R G R G Experimental design Word generationG Word repetitionR R G R G R G R G R G R G G - R = Intrinsic word generation …under assumption of pure insertion G - R = Intrinsic word generation …under assumption of pure insertion A categorical analysis

9. OverviewOverview Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions

10. One way to minimise the baseline/pure insertion problem is to isolate the same process by two or more separate comparisons, and inspect the resulting simple effects for commonalitiesOne way to minimise the baseline/pure insertion problem is to isolate the same process by two or more separate comparisons, and inspect the resulting simple effects for commonalities A test for such activation common to several independent contrasts is called ConjunctionA test for such activation common to several independent contrasts is called Conjunction Conjunctions can be conducted across a whole variety of different contexts:Conjunctions can be conducted across a whole variety of different contexts: tasks tasks stimuli stimuli senses (vision, audition) senses (vision, audition) etc. etc. But the contrasts entering a conjunction have to be truly independent!But the contrasts entering a conjunction have to be truly independent! One way to minimise the baseline/pure insertion problem is to isolate the same process by two or more separate comparisons, and inspect the resulting simple effects for commonalitiesOne way to minimise the baseline/pure insertion problem is to isolate the same process by two or more separate comparisons, and inspect the resulting simple effects for commonalities A test for such activation common to several independent contrasts is called ConjunctionA test for such activation common to several independent contrasts is called Conjunction Conjunctions can be conducted across a whole variety of different contexts:Conjunctions can be conducted across a whole variety of different contexts: tasks tasks stimuli stimuli senses (vision, audition) senses (vision, audition) etc. etc. But the contrasts entering a conjunction have to be truly independent!But the contrasts entering a conjunction have to be truly independent!ConjunctionsConjunctions

11. Example: Which neural structures support object recognition, independent of task (naming vs viewing)? Example: Which neural structures support object recognition, independent of task (naming vs viewing)? A1A1A2A2 B2B2B1B1 Task (1/2) Naming Viewing Stimuli (A/B) Colours Objects Visual Processing V Object Recognition R Phonological Retrieval P (Object - Colour viewing) & (Object - Colour naming) [1 -1 0 0] & [0 0 1 -1] [1 -1 0 0] & [0 0 1 -1] [ R,V - V ] & [ P,R,V - P,V ] [ R,V - V ] & [ P,R,V - P,V ] = R & R = R (assuming no interaction RxP; see later) Visual Processing V Object Recognition R Phonological Retrieval P (Object - Colour viewing) & (Object - Colour naming) [1 -1 0 0] & [0 0 1 -1] [1 -1 0 0] & [0 0 1 -1] [ R,V - V ] & [ P,R,V - P,V ] [ R,V - V ] & [ P,R,V - P,V ] = R & R = R (assuming no interaction RxP; see later) ConjunctionsConjunctions Price et al, 1997 Common object recognition response (R ) Common object recognition response (R )

12. ConjunctionsConjunctions

13. SPM8 offers two general ways to test the significance of conjunctions: SPM8 offers two general ways to test the significance of conjunctions: Test of global null hypothesis: Significant set of consistent effectsTest of global null hypothesis: Significant set of consistent effects which voxels show effects of similar direction (but not necessarily individual significance) across contrasts? which voxels show effects of similar direction (but not necessarily individual significance) across contrasts? Test of conjunction null hypothesis: Set of consistently significant effectsTest of conjunction null hypothesis: Set of consistently significant effects which voxels show, for each specified contrast, effects > threshold? which voxels show, for each specified contrast, effects > threshold? Choice of test depends on hypothesis and congruence of contrasts; the global null test is more sensitive (i.e., when direction of effects hypothesised)Choice of test depends on hypothesis and congruence of contrasts; the global null test is more sensitive (i.e., when direction of effects hypothesised) SPM8 offers two general ways to test the significance of conjunctions: SPM8 offers two general ways to test the significance of conjunctions: Test of global null hypothesis: Significant set of consistent effectsTest of global null hypothesis: Significant set of consistent effects which voxels show effects of similar direction (but not necessarily individual significance) across contrasts? which voxels show effects of similar direction (but not necessarily individual significance) across contrasts? Test of conjunction null hypothesis: Set of consistently significant effectsTest of conjunction null hypothesis: Set of consistently significant effects which voxels show, for each specified contrast, effects > threshold? which voxels show, for each specified contrast, effects > threshold? Choice of test depends on hypothesis and congruence of contrasts; the global null test is more sensitive (i.e., when direction of effects hypothesised)Choice of test depends on hypothesis and congruence of contrasts; the global null test is more sensitive (i.e., when direction of effects hypothesised) Two flavours of inference about conjunctions A1-A2 B1-B2 p(A1=A2)<p + + p(B1=B2)<p + + Friston et al.Neuroimage, 25:661-7. Friston et al. (2005). Neuroimage, 25:661-7. Nichols et al. (2005). Neuroimage, 25:653-60. Friston et al.Neuroimage, 25:661-7. Friston et al. (2005). Neuroimage, 25:661-7. Nichols et al. (2005). Neuroimage, 25:653-60.

14. OverviewOverview Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions

15. Parametric Designs: General Approach Parametric designs approach the baseline problem by:Parametric designs approach the baseline problem by: – Varying a stimulus-parameter of interest on a continuum, in multiple (n>2) steps... –... and relating blood-flow to this parameter Flexible choice of tests for such relations :Flexible choice of tests for such relations : LinearLinear Nonlinear: Quadratic/cubic/etc.Nonlinear: Quadratic/cubic/etc. Data-driven (e.g., neurometric functions)Data-driven (e.g., neurometric functions) Model-basedModel-based Parametric designs approach the baseline problem by:Parametric designs approach the baseline problem by: – Varying a stimulus-parameter of interest on a continuum, in multiple (n>2) steps... –... and relating blood-flow to this parameter Flexible choice of tests for such relations :Flexible choice of tests for such relations : LinearLinear Nonlinear: Quadratic/cubic/etc.Nonlinear: Quadratic/cubic/etc. Data-driven (e.g., neurometric functions)Data-driven (e.g., neurometric functions) Model-basedModel-based

16. Linear effect of time Linear effect of time A linear parametric contrast

17. The nonlinear effect of time assessed with the SPM{T} The nonlinear effect of time assessed with the SPM{T} A nonlinear parametric contrast

18. Inverted U response to increasing word presentation rate in the DLPFC Inverted U response to increasing word presentation rate in the DLPFC SPM{F}SPM{F} Polynomial expansion: f(x) ~ f(x) ~ b 1 x + b 2 x 2 +... …up to (N-1)th order for N levels Polynomial expansion: f(x) ~ f(x) ~ b 1 x + b 2 x 2 +... …up to (N-1)th order for N levels Linear Quadratic E.g, F-contrast [0 1 0] on Quadratic Parameter => E.g, F-contrast [0 1 0] on Quadratic Parameter => Nonlinear parametric design matrix (SPM8 GUI offers polynomial expansion as option during creation of parametric modulation regressors)

19. Parametric Designs: Neurometric functions Rees, G., et al. (1997). Neuroimage, 6: 27-78 versusversus Inverted U response to increasing word presentation rate in the DLPFC Inverted U response to increasing word presentation rate in the DLPFC Rees, G., et al. (1997). Neuroimage, 6: 27-78

20. Parametric Designs: Neurometric functions Coding of tactile stimuli in Anterior Cingulate Cortex: Stimulus (a) presence, (b) intensity, and (c) pain intensity – – Variation of intensity of a heat stimulus applied to the right hand (300, 400, 500, and 600 mJ) Coding of tactile stimuli in Anterior Cingulate Cortex: Stimulus (a) presence, (b) intensity, and (c) pain intensity – – Variation of intensity of a heat stimulus applied to the right hand (300, 400, 500, and 600 mJ) Büchel et al. (2002). The Journal of Neuroscience, 22: 970-6 – : – Assumptions:

21. Parametric Designs: Neurometric functions Büchel et al. (2002). The Journal of Neuroscience, 22: 970-6 Stimulus presence Stimulus presence Pain intensity Pain intensity Stimulus intensity Stimulus intensity

22. Parametric Designs: Model-based regressors Seymour, ODoherty, et al. (2004). Nature.

23. OverviewOverview Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions

24. A1A1A2A2 B2B2B1B1 Task (1/2) Naming Viewing Naming Viewing Stimuli (A/B) Colours Objects Colours Objects Colours Objects Colours Objects Colours Objects interaction effect (Task x Stimuli) (Task x Stimuli) interaction effect (Task x Stimuli) (Task x Stimuli) ViewingViewingNamingNaming Factorial designs: Main effects and Interactions Main effect of task:(A1 + B1) – (A2 + B2)Main effect of task:(A1 + B1) – (A2 + B2) Main effect of stimuli: (A1 + A2) – (B1 + B2)Main effect of stimuli: (A1 + A2) – (B1 + B2) Interaction of task and stimuli: Can show a failure of pure insertionInteraction of task and stimuli: Can show a failure of pure insertion (A1 – B1) – (A2 – B2) Main effect of task:(A1 + B1) – (A2 + B2)Main effect of task:(A1 + B1) – (A2 + B2) Main effect of stimuli: (A1 + A2) – (B1 + B2)Main effect of stimuli: (A1 + A2) – (B1 + B2) Interaction of task and stimuli: Can show a failure of pure insertionInteraction of task and stimuli: Can show a failure of pure insertion (A1 – B1) – (A2 – B2)

25. Interactions and pure insertion Object-naming-specific activations Context: no naming naming adjusted rCBF Components Visual processingV Object recognition R Phonological retrievalP InteractionRxP Interaction (name object - colour) - (view object - colour) [1 -1 0 0] - [0 0 1 -1] [1 -1 0 0] - [0 0 1 -1] = [ P,R,V + RxP - P,V ] - [ R,V - V ] = RxP Components Visual processingV Object recognition R Phonological retrievalP InteractionRxP Interaction (name object - colour) - (view object - colour) [1 -1 0 0] - [0 0 1 -1] [1 -1 0 0] - [0 0 1 -1] = [ P,R,V + RxP - P,V ] - [ R,V - V ] = RxP

26. Interactions and pure insertion Interactions:cross-overandsimple We can selectively inspect our data for one or the other by masking during inference Interactions:cross-overandsimple A1 A2 B1 B2

27. OverviewOverview Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions

28. A (Linear) Time-by-ConditionInteraction (Generation strategy?) A (Linear) Time-by-ConditionInteraction (Generation strategy?) Contrast: [5 3 1 -1 -3 -5] [-1 1] = [-5 5 -3 3 -1 1 1 -1 3 -3 5 -5] Contrast: [5 3 1 -1 -3 -5] [-1 1] = [-5 5 -3 3 -1 1 1 -1 3 -3 5 -5] Linear Parametric Interaction

29. Factorial Design with 2 factors: 1. Gen/Rep (Categorical, 2 levels) 2. Time (Parametric, 6 levels) Time effects modelled with both linear and quadratic components… Factorial Design with 2 factors: 1. Gen/Rep (Categorical, 2 levels) 2. Time (Parametric, 6 levels) Time effects modelled with both linear and quadratic components… G-R Time Lin Time Lin G x T Lin G x T Lin Time Quad Time Quad G x T Quad G x T Quad F-contrast tests for nonlinear Generation-by-Time interaction (including both linear and Quadratic components) F-contrast tests for nonlinear Generation-by-Time interaction (including both linear and Quadratic components) Nonlinear Parametric Interaction

30. OverviewOverview Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions

31. ContextContext sourcesource targettarget XX Parametric, factorial design, in which one factor is a psychological context …...and the other is a physiological source (activity extracted from a brain region of interest) Parametric, factorial design, in which one factor is a psychological context …...and the other is a physiological source (activity extracted from a brain region of interest) Psycho-physiological Interaction (PPI)

32. stimulistimuli Modulation of stimulus-specific responses sourcesource targettarget SetSet Context-sensitiveconnectivityContext-sensitiveconnectivity sourcesource targettarget Parametric, factorial design, in which one factor is a psychological context …...and the other is a physiological source (activity extracted from a brain region of interest) Parametric, factorial design, in which one factor is a psychological context …...and the other is a physiological source (activity extracted from a brain region of interest) Psycho-physiological Interaction (PPI)

33. SPM{Z} Attentional modulation of V1 - V5 contribution Attentional modulation of V1 - V5 contribution AttentionAttention V1V1 V5V5 attention no attention V1 activity V5 activity time V1 activity Psycho-physiological Interaction (PPI)

34. SPM{Z} attention no attention V1 activity V5 activity time V1 activity V1 Att V1 x Att 0 0 1 Psycho-physiological Interaction (PPI)

35. adjusted rCBF medial parietal activity FacesFaces ObjectsObjects Stimuli: Faces or objects Stimuli: PPCPPC ITIT SPM{Z}SPM{Z} Psycho-physiological Interaction (PPI)

36. PPIs tested by a GLM with form:PPIs tested by a GLM with form: y = (V1 A).b 1 + V1.b 2 + A.b 3 + ec = [1 0 0] However, the interaction term of interest, V1 A, is the product of V1 activity and Attention block AFTER convolution with HRFHowever, the interaction term of interest, V1 A, is the product of V1 activity and Attention block AFTER convolution with HRF We are really interested in interaction at neural level, but:We are really interested in interaction at neural level, but: (HRF V1) (HRF A) HRF (V1 A) (unless A low frequency, e.g., blocked; mainly problem for event-related PPIs) SPM5 can effect a deconvolution of physiological regressors (V1), before calculating interaction term and reconvolving with the HRF – the PPI buttonSPM5 can effect a deconvolution of physiological regressors (V1), before calculating interaction term and reconvolving with the HRF – the PPI button PPIs tested by a GLM with form:PPIs tested by a GLM with form: y = (V1 A).b 1 + V1.b 2 + A.b 3 + ec = [1 0 0] However, the interaction term of interest, V1 A, is the product of V1 activity and Attention block AFTER convolution with HRFHowever, the interaction term of interest, V1 A, is the product of V1 activity and Attention block AFTER convolution with HRF We are really interested in interaction at neural level, but:We are really interested in interaction at neural level, but: (HRF V1) (HRF A) HRF (V1 A) (unless A low frequency, e.g., blocked; mainly problem for event-related PPIs) SPM5 can effect a deconvolution of physiological regressors (V1), before calculating interaction term and reconvolving with the HRF – the PPI buttonSPM5 can effect a deconvolution of physiological regressors (V1), before calculating interaction term and reconvolving with the HRF – the PPI button Psycho-physiological Interaction (PPI)

37. OverviewOverview Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions Categorical designs Categorical designs Subtraction - Pure insertion, evoked / differential responses Conjunction - Testing multiple hypotheses Parametric designs Parametric designs Linear - Adaptation, cognitive dimensions Nonlinear- Polynomial expansions, neurometric functions Factorial designs Factorial designs Categorical- Interactions and pure insertion Parametric- Linear and nonlinear interactions - Psychophysiological Interactions