Presentation is loading. Please wait.

Presentation is loading. Please wait.

Biological Modeling of Neural Networks: Week 15 – Population Dynamics: The Integral –Equation Approach Wulfram Gerstner EPFL, Lausanne, Switzerland 15.1.

Published byCleopatra MargaretMargaret Griffith Modified over 8 years ago

Similar presentations

Presentation on theme: "Biological Modeling of Neural Networks: Week 15 – Population Dynamics: The Integral –Equation Approach Wulfram Gerstner EPFL, Lausanne, Switzerland 15.1."— Presentation transcript:

1 Biological Modeling of Neural Networks: Week 15 – Population Dynamics: The Integral –Equation Approach Wulfram Gerstner EPFL, Lausanne, Switzerland 15.1 Populations of Neurons - review: homogeneous population - review: parameters of single neurons 15.2 Integral equation - aim: population activity - renewal assumption 15.3 Populations with Adaptation - Quasi-renewal theory 15.4. Coupled populations - self-coupling - coupling to other populations Week 15 – Integral Equation for population dynamics

2 Neuronal Dynamics – Brain dynamics is complex motor cortex frontal cortex to motor output 10 000 neurons 3 km of wire 1mm Week 15-part 1: Review: The brain is complex

3 Homogeneous population: -each neuron receives input from k neurons in the population -each neuron receives the same (mean) external input (could come from other populations) -each neuron in the population has roughly the same parameters Week 15-part 1: Review: Homogeneous Population excitation inhibition Example: 2 populations

4 I(t) Week 15-part 1: Review: microscopic vs. macroscopic microscopic: -spikes are generated by individual neurons -spikes are transmitted from neuron to neuron macroscopic: -Population activity A n (t) -Populations interact via A n (t)

5 I(t) Week 15-part 1: Review: coupled populations

6 Populations: - pyramidal neurons in layer 5 of barrel D1 - pyramidal neurons in layer 2/3 of barrel D1 - inhibitory neurons in layer 2/3 of barrel D1 Week 15-part 1: Example: coupled populations in barrel cortex Neuronal Populations = a homogeneous group of neurons (more or less) 100-2000 neurons per group (Lefort et al., NEURON, 2009) different barrels and layers, different neuron types  different populations

7 -Extract parameters for SINGLE neuron (see NEURONAL DYNAMICS, Chs. 8-11; review now) -Dynamics in one (homogeneous) population Today, parts 15.2 and 15.3! -Dynamics in coupled populations -Understand Coding in populations -Understand Brain dynamics Sensory input Week 15-part 1: Global aim and strategy

8 i Spike emission potential threshold Input I(t) 3 arbitrary linear filters Week 15-part 1: Review: Spike Response Mode (SRM)

9 SRM + escape noise = Generalized Linear Model (GLM) i j -spikes are events -spike leads to reset/adapt. currents/increased threshold -strict threshold replaced by escape noise: spike exp Jolivet et al., J. Comput. NS, 2006

10 threshold current Input current: -Slow modulation -Fast signal Pozzorini et al. Nat. Neuros, 2013 Adaptation - extends over several seconds - power law

11 Adaptation current Dyn. threshold Mensi et al. 2012, Jolivet et al. 2007 Week 15-part 1: Predict spike times + voltage with SRM/GLM

12 threshold current Dynamic threshold Dyn. Threshold unimportant Dyn. Threshold VERY IMPORTANT Fast Spiking Pyramidal N. Different neuron types have different parameters Dyn. Threshold important Non-fast Spiking Mensi et al. 2011 Week 15-part 1: Extract parameter for different neuron types

13 -We can extract parameters for SINGLE neuron (see NEURONAL DYNAMICS, Chs. 8-11) -Different neuron types have different parameters  Model Dynamics in one (homogeneous) population Today, parts 15.2 and 15.3!  Couple different populations Today, parts 15.4! Sensory input Week 15-part 1: Summary and aims Eventually: Understand Coding and Brain dynamics

14 Biological Modeling of Neural Networks: Week 15 – Population Dynamics: The Integral –Equation Approach Wulfram Gerstner EPFL, Lausanne, Switzerland 15.1 Populations of Neurons - review: homogeneous population - review: parameters of single neurons 15.2 Integral equation - aim: population activity - renewal assumption 15.3 Populations with Adaptation - Quasi-renewal theory 15.4. Coupled populations - self-coupling - coupling to other populations Week 15 – Integral Equation for population dynamics

15 I(t) Population of Neurons? Single neurons - model exists - parameters extracted from data - works well for step current - works well for time-dep. current Population equation for A(t) Week 15-part 2: Aim: from single neuron to population -existing models - integral equation

16 h(t) I(t) ? A(t) potential A(t) t population activity Question: – what is correct? Poll!!! A(t) Wilson-Cowan Benda-Herz LNP current Ostojic-Brunel Paninski, Pillow Week 15-part 2: population equation for A(t) ?

17 Experimental data : Tchumatchenko et al. 2011 See also: Poliakov et al. 1997 Week 15-part 2: A(t) in experiments: step current, (in vitro)

18 25000 identical model neurons (GLM/SRM with escape noise) parameters extracted from experimental data response to step current I(t) h(t) potential simulation data : Naud and Gerstner, 2012 Week 15-part 2: A(t) in simulations : step current

19 Week 15-part 2: A(t) in theory: an equation? Can we write down an equation for A(t) ? Simplification: Renewal assumption Potential (SRM/GLM) of one neuron h(t) Sum over all past spikes Keep only last spike  time-dependent renewal theory

20 Week 15-part 2: Renewal theory (time dependent) Potential (SRM/GLM) of one neuron last spike Keep only last spike  time-dependent renewal theory

21 Week 15-part 2: Renewal model –Example Example: nonlinear integrate-and-fire model deterministic part of input noisy part of input/intrinsic noise  escape rate Example: exponential stochastic intensity t

22 escape process A u(t) Survivor function t escape rate Interval distribution Survivor function escape rate u Week 15-part 2: Renewal model - Interspike Intervals

23 Interval distribution Survivor function escape rate Week 15-part 2: Renewal model – Integral equation population activity Image: Gerstner et al., Neuronal Dynamics, Cambridge Univ. Press (2014) Gerstner 1995, 2000; Gerstner&Kistler 2002 See also: Wilson&Cowan 1972 Blackboard!

24 Week 15-part 2: Integral equation – example: LIF input population of leaky integrate-and-fire neurons w. escape noise simulation Image: Gerstner et al., Neuronal Dynamics, Cambridge Univ. Press exact for large population N  infinity

25 Biological Modeling of Neural Networks: Week 15 – Population Dynamics: The Integral –Equation Approach Wulfram Gerstner EPFL, Lausanne, Switzerland 15.1 Populations of Neurons - review: homogeneous population - review: parameters of single neurons 15.2 Integral equation - aim: population activity - renewal assumption 15.3 Populations with Adaptation - Quasi-renewal theory 15.4. Coupled populations - self-coupling - coupling to other populations Week 15 – Integral Equation for population dynamics

26 I(t) Population of adapting Neurons? Single neurons - model exists - parameters extracted from data - works well for step current - works well for time-dep. current Population equation for A(t) - existing modes - integral equation Week 15-part 3: Neurons with adapation Real neurons show adapation on multipe time scales

27 h(t) I(t) ? A(t) potential A(t) t population activity A(t) Wilson-Cowan Benda-Herz LNP current Week 15-part 3: population equation for A(t) ?

28 I(t) Rate adapt. optimal filter (rate adaptation) Benda-Herz Week 15-part 3: neurons with adaptation – A(t) ? simulation LNP theory

29 I(t) Population of Adapting Neurons? 1) Linear-Nonlinear-Poisson (LNP): fails! 2) Phenomenological rate adaptation: fails! 3) Time-Dependent-Renewal Theory ? Week 15-part 3: population equation for adapting neurons ?  Integral equation of previous section

30 Spike Response Model (SRM) i Spike emission potential Input I(t) h(t)

31 interspike interval distribution last firing time Gerstner 1995, 2000; Gerstner&Kistler 2002 See also: Wilson&Cowan 1972

32 Week 15-part 3: population equation for adapting neurons ?

33 I Rate adapt. Week 15-part 3: population equation for adapting neurons ? OK in late phaseOK in initial phase

34 I(t) Population of Adapting Neurons 1) Linear-Nonlinear-Poisson (LNP): fails! 2) Phenomenological rate adaptation: fails! 3) Time-Dependent-Renewal Theory: fails! 4) Quasi-Renewal Theory!!! Week 15-part 3: population equation for adapting neurons

35 and h(t) Expand the moment generating functional g(t-s) Week 15-part 3: Quasi-renewal theory Blackboard!

36 I Rate adapt. Quasi-Renewal RA OK in initial AND late phase

37 Week 15-part 3: Quasi-renewal theory Image: Gerstner et al., Neuronal Dynamics, Cambridge Univ. Press PSTH or population activity A(t) predicted by quasi-renewal theory

38 I(t) Population of Adapting Neurons? 1) Linear-Nonlinear-Poisson (LNP): fails! 2) Phenomenological rate adaptation: fails! 3) Time-Dependent-Renewal Theory : fails! 4) Quasi-Renewal Theory: works!!!! Week 15-part 3: population equation for adapting neurons

39 Biological Modeling of Neural Networks: Week 15 – Population Dynamics: The Integral –Equation Approach Wulfram Gerstner EPFL, Lausanne, Switzerland 15.1 Populations of Neurons - review: homogeneous population - review: parameters of single neurons 15.2 Integral equation - aim: population activity - renewal assumption 15.3 Populations with Adaptation - Quasi-renewal theory 15.4. Coupled populations - self-coupling - coupling to other populations Week 15 – Integral Equation for population dynamics

40 Week 15-part 4: population with self-coupling Same theory works - Include the self-coupling in h(t) Potential (SRM/GLM) of one neuron h(t) J0J0

41 Week 15-part 4: population with self-coupling Image: Gerstner et al., Neuronal Dynamics, Cambridge Univ. Press

42 Week 15-part 4: population with self-coupling Image: Gerstner et al., Neuronal Dynamics, Cambridge Univ. Press J0J0

43 Week 15-part 4: population with self-coupling instabilities and oscillations noise level delay stable asynchronous state Image: Gerstner et al., Neuronal Dynamics, Cambridge Univ. Press

44 Week 15-part 4: multipe coupled populations Same theory works - Include the cross-coupling in h(t) Potential (SRM/GLM) of one neuron in population n h n (t) J 11 J 22 J 21 J 12

45 -We can extract parameters for SINGLE neuron (see NEURONAL DYNAMICS, Chs. 8-11) -Different neuron types have different parameters  Model Dynamics in one (homogeneous) population Today, parts 15.2 and 15.3!  Couple different populations Today, parts 15.4! Sensory input Week 15-part 1: Summary and aims Eventually: Understand Coding and Brain dynamics

46 The end Reading: Chapter 14 of NEURONAL DYNAMICS, Gerstner et al., Cambridge Univ. Press (2014)

Download ppt "Biological Modeling of Neural Networks: Week 15 – Population Dynamics: The Integral –Equation Approach Wulfram Gerstner EPFL, Lausanne, Switzerland 15.1."

Similar presentations

Introduction to Neural Networks

Introduction to Neural Networks
What is the neural code? Puchalla et al., 2003. What is the neural code? Encoding: how does a stimulus cause the pattern of responses? what are the responses.

What is the neural code? Puchalla et al., What is the neural code? Encoding: how does a stimulus cause the pattern of responses? what are the responses.
Biological Modeling of Neural Networks: Week 9 – Coding and Decoding Wulfram Gerstner EPFL, Lausanne, Switzerland 9.1 What is a good neuron model? - Models.

Biological Modeling of Neural Networks: Week 9 – Coding and Decoding Wulfram Gerstner EPFL, Lausanne, Switzerland 9.1 What is a good neuron model? - Models.
Neural Network of the Cerebellum: Temporal Discrimination and the Timing of Responses Michael D. Mauk Dean V. Buonomano.

Neural Network of the Cerebellum: Temporal Discrimination and the Timing of Responses Michael D. Mauk Dean V. Buonomano.
Spike Train Statistics Sabri IPM. Review of spike train  Extracting information from spike trains  Noisy environment:  in vitro  in vivo  measurement.

Spike Train Statistics Sabri IPM. Review of spike train  Extracting information from spike trains  Noisy environment:  in vitro  in vivo  measurement.
An Introductory to Statistical Models of Neural Data SCS-IPM به نام خالق ناشناخته ها.

An Introductory to Statistical Models of Neural Data SCS-IPM به نام خالق ناشناخته ها.
What is the language of single cells? What are the elementary symbols of the code? Most typically, we think about the response as a firing rate, r(t),

What is the language of single cells? What are the elementary symbols of the code? Most typically, we think about the response as a firing rate, r(t),
Introduction: Neurons and the Problem of Neural Coding Laboratory of Computational Neuroscience, LCN, CH 1015 Lausanne Swiss Federal Institute of Technology.

Introduction: Neurons and the Problem of Neural Coding Laboratory of Computational Neuroscience, LCN, CH 1015 Lausanne Swiss Federal Institute of Technology.
The visual system V Neuronal codes in the visual system.

The visual system V Neuronal codes in the visual system.
NOISE and DELAYS in NEUROPHYSICS Andre Longtin Center for Neural Dynamics and Computation Department of Physics Department of Cellular and Molecular Medicine.

NOISE and DELAYS in NEUROPHYSICS Andre Longtin Center for Neural Dynamics and Computation Department of Physics Department of Cellular and Molecular Medicine.
1 3. Spiking neurons and response variability Lecture Notes on Brain and Computation Byoung-Tak Zhang Biointelligence Laboratory School of Computer Science.

1 3. Spiking neurons and response variability Lecture Notes on Brain and Computation Byoung-Tak Zhang Biointelligence Laboratory School of Computer Science.
Lecture 16 Spiking neural networks

Lecture 16 Spiking neural networks
Part II: Population Models BOOK: Spiking Neuron Models, W. Gerstner and W. Kistler Cambridge University Press, 2002 Chapters 6-9 Laboratory of Computational.

Part II: Population Models BOOK: Spiking Neuron Models, W. Gerstner and W. Kistler Cambridge University Press, 2002 Chapters 6-9 Laboratory of Computational.
Globally-Coupled Excitatory Izhikevich Neurons Coupling-Induced Population Synchronization in An Excitatory Population of Subthreshold Izhikevich Neurons.

Globally-Coupled Excitatory Izhikevich Neurons Coupling-Induced Population Synchronization in An Excitatory Population of Subthreshold Izhikevich Neurons.
Neural Coding 4: information breakdown. Multi-dimensional codes can be split in different components Information that the dimension of the code will convey.

Neural Coding 4: information breakdown. Multi-dimensional codes can be split in different components Information that the dimension of the code will convey.
Introduction to Mathematical Methods in Neurobiology: Dynamical Systems Oren Shriki 2009 Modeling Conductance-Based Networks by Rate Models 1.

Introduction to Mathematical Methods in Neurobiology: Dynamical Systems Oren Shriki 2009 Modeling Conductance-Based Networks by Rate Models 1.
Biological Modeling of Neural Networks: Week 11 – Continuum models: Cortical fields and perception Wulfram Gerstner EPFL, Lausanne, Switzerland 11.1 Transients.

Biological Modeling of Neural Networks: Week 11 – Continuum models: Cortical fields and perception Wulfram Gerstner EPFL, Lausanne, Switzerland 11.1 Transients.
Jochen Triesch, UC San Diego, 1 Pattern Formation in Neural Fields Goal: Understand how non-linear recurrent dynamics can.

Jochen Triesch, UC San Diego, 1 Pattern Formation in Neural Fields Goal: Understand how non-linear recurrent dynamics can.
Stable Propagation of Synchronous Spiking in Cortical Neural Networks Markus Diesmann, Marc-Oliver Gewaltig, Ad Aertsen Nature 402:529-533 Flavio Frohlich.

Stable Propagation of Synchronous Spiking in Cortical Neural Networks Markus Diesmann, Marc-Oliver Gewaltig, Ad Aertsen Nature 402: Flavio Frohlich.
Part I: Single Neuron Models BOOK: Spiking Neuron Models, W. Gerstner and W. Kistler Cambridge University Press, 2002 Chapters 2-5 Laboratory of Computational.

Part I: Single Neuron Models BOOK: Spiking Neuron Models, W. Gerstner and W. Kistler Cambridge University Press, 2002 Chapters 2-5 Laboratory of Computational.

Similar presentations

Ads by Google