Jochen Triesch, UC San Diego, 1 Pattern Formation in Neural Fields Goal: Understand how non-linear recurrent dynamics can.

Slides:



Advertisements
Similar presentations
Jochen Triesch, UC San Diego, 1 Pattern Formation Goal: See how globally ordered spatial structures can arise from local.
Advertisements

HMAX Models Architecture Jim Mutch March 31, 2010.
Un Supervised Learning & Self Organizing Maps. Un Supervised Competitive Learning In Hebbian networks, all neurons can fire at the same time Competitive.
A Theory of Biological Pattern Formation Presented by Xia Fan.
Introduction to Mathematical Methods in Neurobiology: Dynamical Systems Oren Shriki 2009 Modeling Conductance-Based Networks by Rate Models 1.
Biological Modeling of Neural Networks: Week 11 – Continuum models: Cortical fields and perception Wulfram Gerstner EPFL, Lausanne, Switzerland 11.1 Transients.
Jochen Triesch, UC San Diego, 1 Local Stability Analysis Step One: find stationary point(s) Step Two: linearize around.
The “Humpty Dumpty” problem
Jochen Triesch, UC San Diego, 1 Iterative Maps and Chaos Goals: what is deterministic chaos? how does it relate to randomness?
How Patterned Connections Can Be Set Up by Self-Organization D.J. Willshaw C. Von Der Malsburg.
1 EE 542 Antennas and Propagation for Wireless Communications Array Antennas.
Brain-like design of sensory-motor programs for robots G. Palm, Uni-Ulm.
Levels in Computational Neuroscience Reasonably good understanding (for our purposes!) Poor understanding Poorer understanding Very poorer understanding.
Pattern Formation Patrick Lucey.
1 A. Derivation of GL equations macroscopic magnetic field Several standard definitions: -Field of “external” currents -magnetization -free energy II.
Jochen Triesch, UC San Diego, 1 Review of Dynamical Systems Natural processes unfold over time: swinging of a pendulum.
Dissipation of Alfvén Waves in Coronal Structures Coronal Heating Problem T corona ~10 6 K M.F. De Franceschis, F. Malara, P. Veltri Dipartimento di Fisica.
A globally asymptotically stable plasticity rule for firing rate homeostasis Prashant Joshi & Jochen Triesch
The visual system Lecture 1: Structure of the eye
Derivation of the Gaussian plume model Distribution of pollutant concentration c in the flow field (velocity vector u ≡ u x, u y, u z ) in PBL can be generally.
Connected Populations: oscillations, competition and spatial continuum (field equations) Lecture 12 Course: Neural Networks and Biological Modeling Wulfram.
Radial Basis Function (RBF) Networks
1B50 – Percepts and Concepts Daniel J Hulme. Outline Cognitive Vision –Why do we want computers to see? –Why can’t computers see? –Introducing percepts.
GROUPING AND VISUAL RELATIONSHIPS Principle of Proximity.
Biological Modeling of Neural Networks: Week 15 – Population Dynamics: The Integral –Equation Approach Wulfram Gerstner EPFL, Lausanne, Switzerland 15.1.
Unsupervised learning
Orthogonal moments Motivation for using OG moments Stable calculation by recurrent relations Easier and stable image reconstruction - set of orthogonal.
Jochen Triesch, UC San Diego, 1 Short-term and Long-term Memory Motivation: very simple circuits can store patterns of.
Introduction to Mathematical Methods in Neurobiology: Dynamical Systems Oren Shriki 2009 Modeling Conductance-Based Networks by Rate Models 1.
Dynamics of Coupled Oscillators-Theory and Applications
Shape - Balance - Space. Visual Language Size & Weight Placement.
1 Computational Vision CSCI 363, Fall 2012 Lecture 3 Neurons Central Visual Pathways See Reading Assignment on "Assignments page"
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology Adaptive nonlinear manifolds and their applications to pattern.
Deriving connectivity patterns in the primary visual cortex from spontaneous neuronal activity and feature maps Barak Blumenfeld, Dmitri Bibitchkov, Shmuel.
Chapter 7. Network models Firing rate model for neuron as a simplification for network analysis Neural coordinate transformation as an example of feed-forward.
Advection-Dispersion Equation (ADE)
TEMPLATE DESIGN © One adjustment made on these models versus the simpler model is the difference of the diffusion part.
Jochen Triesch, UC San Diego, 1 Motivation: natural processes unfold over time: swinging of a pendulum decay of radioactive.
Session 3, Unit 5 Dispersion Modeling. The Box Model Description and assumption Box model For line source with line strength of Q L Example.
Lecture 21 Neural Modeling II Martin Giese. Aim of this Class Account for experimentally observed effects in motion perception with the simple neuronal.
Version 0.10 (c) 2007 CELEST VISI  N BRIGHTNESS CONTRAST: ADVANCED MODELING CLASSROOM PRESENTATION.
Chapter 2. From Complex Networks to Intelligent Systems in Creating Brain-like Systems, Sendhoff et al. Course: Robots Learning from Humans Baek, Da Som.
Effect of Small-World Connectivity on Sparsely Synchronized Cortical Rhythms W. Lim (DNUE) and S.-Y. KIM (LABASIS)  Fast Sparsely Synchronized Brain Rhythms.
Activity Dependent Conductances: An “Emergent” Separation of Time-Scales David McLaughlin Courant Institute & Center for Neural Science New York University.
1 Perception and VR MONT 104S, Fall 2008 Lecture 6 Seeing Motion.
1 Methods in Image Analysis – Lecture 3 Fourier CMU Robotics Institute U. Pitt Bioengineering 2630 Spring Term, 2004 George Stetten, M.D., Ph.D.
On the mechanism of eastward-propagation of super cloud clusters (SCCs) over the equator – Impact of precipitation activities on climate of East Asia –
Self-Organizing Maps (SOM) (§ 5.5)
The Rayleigh-Taylor Instability By: Paul Canepa and Mike Cromer Team Leftovers.
Biological Modeling of Neural Networks: Week 15 – Fast Transients and Rate models Wulfram Gerstner EPFL, Lausanne, Switzerland 15.1 Review Populations.
1 Computational Vision CSCI 363, Fall 2012 Lecture 16 Stereopsis.
How Recurrent Dynamics Explain Crowding Aaron Clarke & Michael H. Herzog Laboratory of Psychophysics, Brain Mind Institute, École Polytechnique Fédérale.
Biological Modeling of Neural Networks: Week 10 – Neuronal Populations Wulfram Gerstner EPFL, Lausanne, Switzerland 10.1 Cortical Populations - columns.
Jochen Triesch, UC San Diego, 1 Part 3: Hebbian Learning and the Development of Maps Outline: kinds of plasticity Hebbian.
1 9. Continuous attractor and competitive networks Lecture Notes on Brain and Computation Byoung-Tak Zhang Biointelligence Laboratory School of Computer.
Processing visual information - pathways
Psychology 304: Brain and Behaviour Lecture 28
Lateral inhibition through the
Ch10 : Self-Organizing Feature Maps
Neural Oscillations Continued
Early Processing in Biological Vision
9. Continuous attractor and competitive networks
Lecture 7 ACCELERATOR PHYSICS HT E. J. N. Wilson.
Carlos D. Brody, J.J. Hopfield  Neuron 
Reaction & Diffusion system
Brendan K. Murphy, Kenneth D. Miller  Neuron 
Nicholas J. Priebe, David Ferster  Neuron 
Neural Mechanisms of Visual Motion Perception in Primates
Ajay S. Pillai, Viktor K. Jirsa  Neuron 
Ajay S. Pillai, Viktor K. Jirsa  Neuron 
Presentation transcript:

Jochen Triesch, UC San Diego, 1 Pattern Formation in Neural Fields Goal: Understand how non-linear recurrent dynamics can lead to pattern formation in cortical layers. Discuss relation to visual hallucinations. Assumptions: just a single sheet of neurons Stereotypic pattern of lateral excitation (short) + inhibition (longer but not global) Wilson-Cowan dynamics Reminder: Dale’s law: inhibition mediated by inhibitory interneurons excit. inhib.

Jochen Triesch, UC San Diego, 2 Basic contribution to field potential at site x from neighbors is given by: where ‘*’ is the convolution operator. I.e. to collect all contributions to location x coming from the whole layer we have to integrate over the entire layer. Recall: g f x excit. inhib., for β constant Illustration of convolution

Jochen Triesch, UC San Diego, 3 The Basic Model Equation Difference of Gaussian (DoG) kernel: Integro-differential equation (IDE): Sigmoid non-linearity:

Jochen Triesch, UC San Diego, 4 Fluctuations can grow if: where: Step 1: homogenous stationary solution: Step 2: linear stability analysis: After linearizing and going into Fourier space, equation is linear in Fourier coefficients: The shape of lambda(k) follows that of F[g](k):

Jochen Triesch, UC San Diego, 5 maximum is at 4ln(2), where F[g](k)=1/(8π)

Jochen Triesch, UC San Diego, 6 Result of our analysis: instabilities (deviations from homogenous stationary solution) can only grow when γ above curve. Question: When is the maximum lambda greater than zero? (That’s when fluctuations will grow.) Answer:

Jochen Triesch, UC San Diego, 7 Simulation of system… h(x, t=0)h(x, t>0) (initialized per mouse)

Jochen Triesch, UC San Diego, 8 … leads to: h(x, t>>0) S(h(x, t>>0))

Jochen Triesch, UC San Diego, 9 Variety of different patterns: for different p,γ settings: regular and irregular stripes, hexagonal blobs and anti-blobs: Notes: Interesting to note that the exact same dynamics give rise to very different patterns if the parameters are slightly changed. The same abstract mechanism of short-range excitation and long-range inhibition is thought to underlie other biological patterns (zebra stripes, leopard spots) → reaction diffusion systems

Jochen Triesch, UC San Diego, 10 Visual Hallucinations A variety of drugs induce hallucinations of stereotypical geometric patterns: concentric circles, radial spokes, spirals, checkerboards with expanding check sizes towards periphery Ermentrout and Cowan (1979): such patterns can result from blob and stripe patterns on cortical surface, because of non-uniform mapping from retina to cortex Eric Schwartz Kolb et al.

Jochen Triesch, UC San Diego, 11 concentric retinal circles A-D mapped onto vertical lines in cortex radial spokes E-G in retina mapped onto horizontal lines spirals in retina mapped onto oblique lines Wilson, 1999 Mapping from retina to cortex Retina: polar coordinates (R, Θ) Cortex: (ln(1+R), Θ) Mapping from retina to cortex Retina: polar coordinates (R, Θ) Cortex: (ln(1+R), Θ)

Jochen Triesch, UC San Diego, 12 Pattern Formation Summary neurons wired up in this simple fashion show complex patterns of activity, nice example of self-organization formation of interesting patterns based on similar mechanisms as in other domains: long-ranging inhibition and short-ranging excitation exhibits spontaneous symmetry breaking: at macroscopic scale, system initially symmetric. Microscopic deviations from symmetry drive system to final state that is asymmetric at macroscopic scale relation to visual hallucinations experienced under certain drugs still no plasticity/learning