John Wordsworth, Peter Ashwin, Gabor Orosz, Stuart Townley Mathematics Research Institute University of Exeter.

Slides:



Advertisements
Similar presentations
Introduction to Neural Networks
Advertisements

Feature Selection as Relevant Information Encoding Naftali Tishby School of Computer Science and Engineering The Hebrew University, Jerusalem, Israel NIPS.
Hamiltonian Chaos and the standard map Poincare section and twist maps. Area preserving mappings. Standard map as time sections of kicked oscillator (link.
Neural Network of the Cerebellum: Temporal Discrimination and the Timing of Responses Michael D. Mauk Dean V. Buonomano.
A model for spatio-temporal odor representation in the locust antennal lobe Experimental results (in vivo recordings from locust) Model of the antennal.
Slide 1 Smell Olfaction brings both good news and bad news Pheromones Smell— a mode of communication as well as of detecting environment Important signals.
Rhythm sequence through the olfactory bulb layers during the time window of a respiratory cycle Buonviso, N., Amat, C., Litaudon, P., Roux, S., Royet,
WINNERLESS COMPETITION PRINCIPLE IN NEUROSCIENCE Mikhail Rabinovich INLS University of California, San Diego ’
Adaptive Resonance Theory (ART) networks perform completely unsupervised learning. Their competitive learning algorithm is similar to the first (unsupervised)
Presented by Suganya Karunakaran Reduction of Spike Afterdepolarization by Increased Leak Conductance Alters Interspike Interval Variability Fernando R.
1 Predator-Prey Oscillations in Space (again) Sandi Merchant D-dudes meeting November 21, 2005.
Leech Heart Half- Center Oscillator: Control of Burst Duration by Low- Voltage Activated Calcium Current Math 723: Mathematical Neuroscience Khaldoun Hamade.
Part II: Population Models BOOK: Spiking Neuron Models, W. Gerstner and W. Kistler Cambridge University Press, 2002 Chapters 6-9 Laboratory of Computational.
Membrane capacitance Transmembrane potential Resting potential Membrane conductance Constant applied current.
CH12: Neural Synchrony James Sulzer Background Stability and steady states of neural firing, phase plane analysis (CH6) Firing Dynamics (CH7)
Overview of Neuroscience Tony Bell Helen Wills Neuroscience Institute University of California at Berkeley.
Levels in Computational Neuroscience Reasonably good understanding (for our purposes!) Poor understanding Poorer understanding Very poorer understanding.
Last week…. Fourier Analysis Re-writing a signal as a sum of sines and cosines.
(Page 554 – 564) Ping Perez CS 147 Summer 2001 Alternative Parallel Architectures  Dataflow  Systolic arrays  Neural networks.
Biologically Inspired Robotics Group,EPFL Associative memory using coupled non-linear oscillators Semester project Final Presentation Vlad TRIFA.
Applying Edge Partitioning to SPFD's 1 Applying Edge Partitioning to SPFD’s 219B Project Presentation Trevor Meyerowitz Mentor: Subarna Sinha Professor:
ALLEGRO G Z LSC, Livingston 23 March, Calibration for the ALLEGRO resonant detector -- S2 and S4 Martin McHugh, Loyola University New Orleans.
Stochastic Resonance and its implications for the brain Jaeseung Jeong, Ph.D Department of Bio and Brain Engineering, KAIST.
Chaos in Neural Network Theme presentation Cui, Shuoyang 03/08/2005.
Dynamical Encoding by Networks of Competing Neuron Groups : Winnerless Competition M. Rabinovich 1, A. Volkovskii 1, P. Lecanda 2,3, R. Huerta 1,2, H.D.I.
5.5 Learning algorithms. Neural Network inherits their flexibility and computational power from their natural ability to adjust the changing environments.
Dynamics of Coupled Oscillators-Theory and Applications
Neural Networks Architecture Baktash Babadi IPM, SCS Fall 2004.
Lecture 10: Mean Field theory with fluctuations and correlations Reference: A Lerchner et al, Response Variability in Balanced Cortical Networks, q-bio.NC/ ,
Clustering of protein networks: Graph theory and terminology Scale-free architecture Modularity Robustness Reading: Barabasi and Oltvai 2004, Milo et al.
Ch 9.8: Chaos and Strange Attractors: The Lorenz Equations
Spatiotemporal dynamics of coupled nonlinear oscillators on complex networks Zhonghuai Hou( 侯中怀 ) Beijing Department of Chemical Physics Hefei.
Multiple attractors and transient synchrony in a model for an insect's antennal lobe Joint work with B. Smith, W. Just and S. Ahn.
Cycle 6: Oscillations and Synchrony
Synchronization in complex network topologies
Velleman Oscilloscope: Windows 7 by Mr. David Fritz.
Zoltán Somogyvári Hungarian Academy of Sciences, KFKI Research Institute for Particle and Nuclear Physics Department of Biophysics A model-based approach.
From brain activities to mathematical models The TempUnit model, a study case for GPU computing in scientific computation.
H. SAIBI November 25, Outline Generalities Superposition of waves Superposition of the wave equation Interference of harmonic waves.
Information encoding and processing via spatio-temporal spike patterns in cortical networks Misha Tsodyks, Dept of Neurobiology, Weizmann Institute, Rehovot,
Transition to Burst Synchronization on Complex Neuron Networks Zhonghuai Hou( 侯中怀 ) Nanjing Department of Chemical Physics Hefei National Lab of.
Ch 9. Rhythms and Synchrony 9.7 Adaptive Cooperative Systems, Martin Beckerman, Summarized by M.-O. Heo Biointelligence Laboratory, Seoul National.
Network Models (2) LECTURE 7. I.Introduction − Basic concepts of neural networks II.Realistic neural networks − Homogeneous excitatory and inhibitory.
BRAIN TISSUE IMPEDANCE ESTIMATION Improve the Brain’s Evoked Potential’s source Temporal and Spatial Inverse Problem Improve the Brain Tissue Impedance.
Spatiotemporal Networks in Addressable Excitable Media International Workshop on Bio-Inspired Complex Networks in Science and Technology Max Planck Institute.
1 Waves and Vibrations. 2 Waves are everywhere in nature Sound waves, visible light waves, radio waves, microwaves, water waves, sine waves, telephone.
Here is a plot which we call a raster plot
Spanning Trees Discrete Mathematics.
Collins Assisi, Mark Stopfer, Maxim Bazhenov  Neuron 
Signal, Noise, and Variation in Neural and Sensory-Motor Latency
OCNC Statistical Approach to Neural Learning and Population Coding ---- Introduction to Mathematical.
Generating Coherent Patterns of Activity from Chaotic Neural Networks
Test Case Test case Describes an input Description and an expected output Description. Test case ID Section 1: Before execution Section 2: After execution.
Carlos D. Brody, J.J. Hopfield  Neuron 
Volume 30, Issue 2, Pages (May 2001)
Hour 12 Driven Harmonic Oscillators
Volume 40, Issue 6, Pages (December 2003)
Divisive Normalization in Olfactory Population Codes
Thomas Akam, Dimitri M. Kullmann  Neuron 
H.Sebastian Seung, Daniel D. Lee, Ben Y. Reis, David W. Tank  Neuron 
Collins Assisi, Mark Stopfer, Maxim Bazhenov  Neuron 
Pattern Selection by Dynamical Biochemical Signals
Uma R. Karmarkar, Dean V. Buonomano  Neuron 
Learning by the Dendritic Prediction of Somatic Spiking
Neural Coding: Sparse but On Time
Volume 32, Issue 1, Pages (October 2001)
Volume 30, Issue 2, Pages (May 2001)
Superposition of Waves
Fig. 1 Fluctuation-induced dynamic response patterns.
Volume 27, Issue 2, Pages (January 2017)
Presentation transcript:

John Wordsworth, Peter Ashwin, Gabor Orosz, Stuart Townley Mathematics Research Institute University of Exeter

1. Motivation & Base Model 1.Olfaction, the Honey Bee, Objectives. 2.The Model, Core Dynamics and Spatial Coding. 2. Stimuli and Spatio-Temporal Codes 1.Adding Input and Temporal Coding. 2.Temporal Coding and Spatio-Temporal Codes. 3. Future Work and Uses 1.Other Cases and Introducing Noise. 2.Classifying Inputs from a Spatio-Temporal Code.

A brief look at background and the system of coupled phase oscillators at the heart of this work.

Honey Bee experiments show neurons in the Glomeruli fire in clusters; C. Galizia, S. Sachse, A. Rappert & R. Menzel, 1999

Spatio-Temporal Coding Emulate Olfaction Classify olfactory information in an interesting fashion. Suggest components of combined olfactory encoding. Steady Stimuli Input Coupled Oscillator Model Distinct Coding Output

Phase (Ѳ), Natural Frequencies (ω i ), Coupling Strength (K), Number of Oscillators (N), Coupling Function (g), Noise (η), Stimuli (X). Global All-to-All Coupling Phase Oscillator Model

Dynamics (with Noise) Synchrony (Alter Alpha) Anti-synchrony Clustering Chaos

Synchrony (Alter Alpha) Anti-synchrony Clustering Chaos Dynamics (with Noise)

Synchrony Anti-synchrony (Alter Beta) Clustering Chaos Dynamics (with Noise)

Synchrony Anti-synchrony Clustering (Alpha:1.7, Beta: -2) Chaos Dynamics (with Noise)

After Transients, we have; Yellow ‘Stable’ Cluster. Blue ‘Unstable’ Cluster. One Lone Oscillator. Cluster States (with Noise)

What Happens? 1. Initial Transient. 2. First Switches Fast. 3. Residence Time Increases. 4. System Stalls. Note; Considered as a Neural System - the system is still firing! Memory Effect; System does not change unless stimulated. Cluster States (Without Noise)

Residence times increase exponentially. The system becomes stalled. We need some form of stimuli to force the system. Cluster States (Without Noise)

Time Oscillator 5 Oscillator 4 Oscillator 3 Oscillator 2 Oscillator 1 BBWYY WYYBB YBBYW BWYBY YYBWB Linearizing around a state and taking Eigenvalues; Yellow is ‘stable’; Yellow -> Blue White -> Yellow Blue is ‘unstable’; Blue -> ? Turns out that the ‘fastest’ blue oscillator -> white. Spatial Coding

Heteroclinic Network; 30 Cluster States, 60 Orbits. Or a Directed Graph? Sample Coding; BBWYY (S1) WYYBB (S2) YBBYW (S3) BWYBW (S4) A Network of Cluster States

System of 5 coupled phase oscillators. Find (2,2,1) ‘clusters’ for certain parameters. Only 2 possible states at the next step once at a given state – which one is random when the system is driven by noise. This generates a system with 30 states and 60 connections. A spatial code can be seen as a series of state identifiers.

Next we add input to the System and generate a temporal code which we can combine with our spatial coding.

Using different frequencies as input. Detuning Frequencies as Input

Where Delta is the Amplitude of Detuning (Strength of Odor?) Uniform Detuning (No Noise) Regular Residence Times, Repeated Pattern.

Time Oscillator 5 Oscillator4 Oscillator 3 Oscillator 2 Oscillator 1 Spatial Coding of the Detuned System

Reduced State Graph / Spatio-Coding of Data Spatial Coding of the Detuned System

Large Amplitude of Detuning (Top), Very Small Amplitude (Bottom) Temporal Coding of the Detuned System

Just to prove we’re still thinking about Spiking States are a statement of when spikes are together. Rethink the meaning of residence times A Neuroscience View

Post transient residence times are fixed (Red). Evaluation of Residence Times

Four ‘levels’ of residence times, not 6 – lost info. Evaluation of Residence Times

Direct relation between residence times and δ. Can determine δ from code. Detuning Amplitude vs. Residence Times

Original Graph driven by noise; Combined Spatio-Temporal Coding

Spatio-Temporal Coding of Detuned Inputs Large Amplitude of Detuning (Top), Very Small Amplitude (Bottom) Spatio-Temporal Coding

Detune the frequencies of the oscillators as a method of inputting data to the system. Alters the spatial coding by removing edges that the system can follow (minimal amount remain with uniform detuning). Differences in the magnitudes of frequencies determines residence times (temporal code). Should be able to determine input frequencies from a given spatio-temporal code.

Finally, a brief look at work that we are currently focussing on and some applications of the work.

Alternative Detunings

If we run the system with both Detuning and Bounded Noise, which wins? Compare residence time-windows. Residence Time Case 3 Case 2 Case 1 DetuningNoise Detuning Noise Detuning Detuning & Noise Together

Non-Periodic cycles appear when we have noise and certain types of detuning. Have seen cases with 2 potential cycles of 6, in which the system traverses one a seemingly random number of times then the other once. Essentially a sliding scale for number of paths with probability of traversal > 0 between (a) when uniform detuning is far greater than noise and (b) when there is no detuning and just noise. These are the most interesting cases

Consider Spatial and Temporal components. Temporal Component will dictate magnitude of differences between natural frequencies. Spatial Component will dictate ordering of natural frequencies. Could be complex for non-uniform detunings.

We can generate one of two unique spatio-temporal code / firing pattern for a given input, depending on initial conditions. Non-Uniform detunings -> Other Patterns. Analysis of residence times can tell us whether noise or detuning is driving the system. Data is lost when considering spatial or temporal code alone, but is probably complete using both combined. Conclusion

Peter Ashwin, Stuart Townley, Gabor Orosz, University of Exeter Thank You