Variational Bayesian Inference for fMRI time series Will Penny, Stefan Kiebel and Karl Friston Wellcome Department of Imaging Neuroscience, University.

Slides:



Advertisements
Similar presentations
Bayesian fMRI models with Spatial Priors Will Penny (1), Nelson Trujillo-Barreto (2) Guillaume Flandin (1) Stefan Kiebel(1), Karl Friston (1) (1) Wellcome.
Advertisements

Bayesian inference Lee Harrison York Neuroimaging Centre 01 / 05 / 2009.
Bayesian inference Jean Daunizeau Wellcome Trust Centre for Neuroimaging 16 / 05 / 2008.
Hierarchical Models and
1st level analysis - Design matrix, contrasts & inference
Pattern Recognition and Machine Learning
The General Linear Model Or, What the Hell’s Going on During Estimation?
The General Linear Model (GLM) Methods & models for fMRI data analysis in neuroeconomics November 2010 Klaas Enno Stephan Laboratory for Social & Neural.
Bayesian models for fMRI data
Group analyses Wellcome Dept. of Imaging Neuroscience University College London Will Penny.
The General Linear Model (GLM)
The General Linear Model (GLM) SPM Course 2010 University of Zurich, February 2010 Klaas Enno Stephan Laboratory for Social & Neural Systems Research.
J. Daunizeau Wellcome Trust Centre for Neuroimaging, London, UK Institute of Empirical Research in Economics, Zurich, Switzerland Bayesian inference.
Group analyses of fMRI data Methods & models for fMRI data analysis 26 November 2008 Klaas Enno Stephan Laboratory for Social and Neural Systems Research.
General Linear Model & Classical Inference Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM M/EEGCourse London, May.
With many thanks for slides & images to: FIL Methods group, Virginia Flanagin and Klaas Enno Stephan Dr. Frederike Petzschner Translational Neuromodeling.
SPM Course Zurich, February 2015 Group Analyses Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London With many thanks to.
Group analyses of fMRI data Methods & models for fMRI data analysis November 2012 With many thanks for slides & images to: FIL Methods group, particularly.
Mean Field Variational Bayesian Data Assimilation EGU 2012, Vienna Michail Vrettas 1, Dan Cornford 1, Manfred Opper 2 1 NCRG, Computer Science, Aston University,
CS 782 – Machine Learning Lecture 4 Linear Models for Classification  Probabilistic generative models  Probabilistic discriminative models.
Bayesian Modelling of Functional Imaging Data Will Penny The Wellcome Department of Imaging Neuroscience, UCL http//:
Bayesian Inference and Posterior Probability Maps Guillaume Flandin Wellcome Department of Imaging Neuroscience, University College London, UK SPM Course,
Wellcome Dept. of Imaging Neuroscience University College London
FMRI Modelling & Statistical Inference Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM Course Chicago, Oct.
The General Linear Model
The General Linear Model Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM fMRI Course London, May 2012.
Bayesian Methods Will Penny and Guillaume Flandin Wellcome Department of Imaging Neuroscience, University College London, UK SPM Course, London, May 12.
Bayesian inference Lee Harrison York Neuroimaging Centre 23 / 10 / 2009.
Variance components Wellcome Dept. of Imaging Neuroscience Institute of Neurology, UCL, London Stefan Kiebel.
The general linear model and Statistical Parametric Mapping II: GLM for fMRI Alexa Morcom and Stefan Kiebel, Rik Henson, Andrew Holmes & J-B Poline.
Mixture Models with Adaptive Spatial Priors Will Penny Karl Friston Acknowledgments: Stefan Kiebel and John Ashburner The Wellcome Department of Imaging.
Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM Course Zurich, February 2008 Bayesian Inference.
Bayesian Inference in SPM2 Will Penny K. Friston, J. Ashburner, J.-B. Poline, R. Henson, S. Kiebel, D. Glaser Wellcome Department of Imaging Neuroscience,
The General Linear Model Christophe Phillips SPM Short Course London, May 2013.
The General Linear Model Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM fMRI Course London, October 2012.
Bayesian fMRI analysis with Spatial Basis Function Priors
The General Linear Model (GLM)
Group Analyses Guillaume Flandin SPM Course London, October 2016
Variational Bayesian Inference for fMRI time series
The general linear model and Statistical Parametric Mapping
Ch3: Model Building through Regression
The General Linear Model
Bayesian Inference Will Penny
Random Effects Analysis
Neuroscience Research Institute University of Manchester
The General Linear Model (GLM)
Spatio-Temporal Clustering
Wellcome Dept. of Imaging Neuroscience University College London
The General Linear Model
Linear Hierarchical Modelling
Statistical Parametric Mapping
The general linear model and Statistical Parametric Mapping
SPM2: Modelling and Inference
Bayesian Methods in Brain Imaging
The General Linear Model
Hierarchical Models and
The General Linear Model (GLM)
Wellcome Dept. of Imaging Neuroscience University College London
Bayesian Inference in SPM2
Wellcome Centre for Neuroimaging, UCL, UK.
The General Linear Model
Mixture Models with Adaptive Spatial Priors
Probabilistic Modelling of Brain Imaging Data
WellcomeTrust Centre for Neuroimaging University College London
The General Linear Model
Wellcome Dept. of Imaging Neuroscience University College London
The General Linear Model
Wellcome Dept. of Imaging Neuroscience University College London
Uncertainty Propagation
Presentation transcript:

Variational Bayesian Inference for fMRI time series Will Penny, Stefan Kiebel and Karl Friston Wellcome Department of Imaging Neuroscience, University College, London, UK.

Generalised Linear Model A central concern in fMRI is that the errors from scan n-1 to scan n are serially correlated We use Generalised Linear Models (GLMs) with autoregressive error processes of order p y n = x n w + e n e n = ∑ a k e n-k + z n where k=1..p. The errors z n are zero mean Gaussian with variance σ 2.

Variational Bayes We use Bayesian estimation and inference The true posterior p(w,a,σ 2 |Y) can be approximated using sampling methods. But these are computationally demanding. We use Variational Bayes (VB) which uses an approximate posterior that factorises over parameters q(w,a,σ 2 |Y) = q(w|Y) q(a|Y) q(σ 2 |Y)

Variational Bayes Estimation takes place by minimizing the Kullback-Liebler divergence between the true and approximate posteriors. The optimal form for the approximate posteriors is then seen to be q(w|Y)=N(m,S), q(a|Y)=N(v,R) and q(1/σ 2 |Y)=Ga(b,c) The parameters m,S,v,R,b and c are then updated in an iterative optimisation scheme

Synthetic Data Generate data from y n = x w + e n e n = a e n-1 + z n where x=1, w=2.7, a=0.3, σ 2 =4 Compare VB results with exact posterior (which is expensive to compute).

Synthetic data True posterior, p(a,w|Y) VB’s approximate posterior, q(a,w|Y) VB assumes a factorized form for the posterior. For small ‘a’ the width of p(w|Y) will be overestimated, for large ‘a’ it will be underestimated. But on average, VB gets it right !

Synthetic Data Regression coefficient posteriors: Exact p(w|Y), VB q(w|Y) Noise variance posteriors: Exact p(σ 2 |Y), VB q(σ 2 |Y ) Autoregressive coefficient posteriors: Exact p(a|Y), VB q(a|Y)

fMRI Data Design Matrix, X Modelling Parameters Y=Xw+e 9 regressors AR(6) model for the errors VB model fitting: 4 seconds Gibbs sampling: much longer ! Event-related data from a visual-gustatory conditioning experiment. 680 volumes acquired at 2Tesla every 2.5 seconds. We analyse just a single voxel from x = 66 mm, y = -39 mm, z = 6 mm (Talairach). We compare the VB results with a Bayesian analysis using Gibbs sampling.

fMRI Data Posterior distributions of two of the regression coefficients

Summary Exact Bayesian inference in GLMs with AR error processes is intractable VB approximates the true posterior with a factorised density VB takes into account the uncertainty of the hyperparameters Its much less computationally demanding than sampling methods It allows for model order selection (not shown)