Spike Based Visual Encoding Activity level (a m ) Visual encoder implemented in the NEF as network of 1024 laterally inhibiting neural columns Network.

Slides:



Advertisements
Similar presentations
Spectral sensitivity of cones
Advertisements

Chapter 2.
Central Visual Processes. Anthony J Greene2 Central Visual Pathways I.Primary Visual Cortex Receptive Field Columns Hypercolumns II.Spatial Frequency.
Y A S O O B A L I b o r n o n 1 9 t h F e b r u a r y i n K a n p u r d i s t r i c t o f U t t a r P r a d e s h. H e s t a r t e d s i n g i.
Research Plans Computational Neuroscience Jutta Kretzberg University of Antwerp
Chapter 6 The Visual System
Study of double hypernuclei with a general scan Kyoto University Department of Physics Toshinao Tsunemi Masashi Hayata(Kyoto Univ.) Ken-ichi Imai (Kyoto.
Exam in 12 days in class assortment of question types including written answers.
Chenlei Guo Liming Zhang Image Processing 2010
1 Biological Neural Networks Example: The Visual System.
Exam 1 week from today in class assortment of question types including written answers.
How does the visual system represent visual information? How does the visual system represent features of scenes? Vision is analytical - the system breaks.
FYP Presentataion CK1 Intelligent Surface Modeler By Yu Wing TAI Kam Lun TANG Advised by Prof. Chi Keung TANG.
Beam File Analysis Carl Goodrich 10/9/07. Beam File Data.
Edge Detection Lecture 2: Edge Detection Jeremy Wyatt.
Visual Cognition I basic processes. What is perception good for? We often receive incomplete information through our senses. Information can be highly.
Extraction of Salient Contours in Color Images Vonikakis Vasilios, Ioannis Andreadis and Antonios Gasteratos Democritus University of Thrace
Selection Sort
Optic flow from dynamic anchor point attributes a feasibility study Bart Janssen.
Connected Populations: oscillations, competition and spatial continuum (field equations) Lecture 12 Course: Neural Networks and Biological Modeling Wulfram.
Overview of Back Propagation Algorithm
University Studies 15A: Consciousness I The Neurobiology of Vision.
-Gaurav Mishra -Pulkit Agrawal. How do neurons work Stimuli  Neurons respond (Excite/Inhibit) ‘Electrical Signals’ called Spikes Spikes encode information.
Olshausen’s Demo. 1.The Training set ?  Natural Images (Olhausen’s database)  How much do we learn ?  face database and car database 2.The Sparseness.
A Model of Saliency-Based Visual Attention for Rapid Scene Analysis Laurent Itti, Christof Koch, and Ernst Niebur IEEE PAMI, 1998.
Neural Information in the Visual System By Paul Ruvolo Bryn Mawr College Fall 2012.
Low Level Visual Processing. Information Maximization in the Retina Hypothesis: ganglion cells try to transmit as much information as possible about the.
1 Computational Vision CSCI 363, Fall 2012 Lecture 10 Spatial Frequency.
Sensory systems basics. Sensing the external world.
1 Computational Vision CSCI 363, Fall 2012 Lecture 3 Neurons Central Visual Pathways See Reading Assignment on "Assignments page"
REU Presentation Week 3 Nicholas Baker.  What features “pop out” in a scene?  No prior information/goal  Identify areas of large feature contrasts.
1 Bioinspired Compression Schemas 16/07/2009 Khaled MASMOUDI Pierre KORNPROBST INRIA Marc ANTONINII3S.
Projects: 1.Predictive coding in balanced spiking networks (Erwan Ledoux). 2.Using Canonical Correlation Analysis (CCA) to analyse neural data (David Schulz).
Chapter 7. Network models Firing rate model for neuron as a simplification for network analysis Neural coordinate transformation as an example of feed-forward.
Selection Sort
Image Stabilization by Bayesian Dynamics Yoram Burak Sloan-Swartz annual meeting, July 2009.
Convolutional LSTM Networks for Subcellular Localization of Proteins
Keith Clements Introduction to Neuroscience
Fundamentals of Sensation and Perception LIGHT AND THE EYES ERIK CHEVRIER NOVEMBER 9, 2015.
Object and face recognition
Sensory Neural Systems 5 February 2008 Rachel L. León
Biological Modeling of Neural Networks: Week 10 – Neuronal Populations Wulfram Gerstner EPFL, Lausanne, Switzerland 10.1 Cortical Populations - columns.
Implementation of a Biologically Inspired Stereoscopic Vision Model in C+CUDA Most of the depth perception processing is done in the visual cortex, mainly.
Image from
1 Basics of Computational Neuroscience. 2 Lecture: Computational Neuroscience, Contents 1) Introduction The Basics – A reminder: 1) Brain, Maps, Areas,
Basics of Computational Neuroscience. What is computational neuroscience ? The Interdisciplinary Nature of Computational Neuroscience.
Neural Networks An Information Theoretic Approach By Matthew Zurschmeide.
$200 $400 $600 $800 $1000 $200 $400 $600 $800 $1000 $200 $400 $600 $800 $1000 $200 $400 $600 $800 $1000 $200 $400 $600 $800 $1000 $200.
Psychology 304: Brain and Behaviour Lecture 28
fMRI and neural encoding models: Voxel receptive fields
BIOPHYSICS 6702 – ENCODING NEURAL INFORMATION
Outline Of Today’s Discussion
fMRI and neural encoding models: Voxel receptive fields (continued)
Visual Sensory System.
BY DR. MUDASSAR ALI ROOMI (MBBS, M. Phil.)
Human Vision Nov Wu Pei.
Week 8 Nicholas Baker.
The Visual System.
Visual Cortex   Vision Science Lectures in Ophthalmology Curtis Baker.
Binocular Stereo Vision
Developmental neuroplasticity
Perception: Structures
Question: how are neurons in the primary visual cortex encoding the visual scene?
Central Visual Pathways
What the Fish’s Eye Tells the Fish’s Brain
Outline Human Visual Information Processing – cont.
Background Task Fashion image inpainting Some conceptions
James P. Howard et al. JACEP 2019;j.jacep
Week 7 Presentation Ngoc Ta Aidean Sharghi
Fig. 2 Visualization of features.
Presentation transcript:

Spike Based Visual Encoding Activity level (a m ) Visual encoder implemented in the NEF as network of 1024 laterally inhibiting neural columns Network in Nengo To establish orientation- based saliency we must first encode an image using oriented receptive fields Samuel Shapero and Siddharth Joshi

Spike Based Encoding: Results Input Sparse Neural Encoding Image Reconstructed from Encoding We encoded 24x24 videos from the Silicon Retina in real time. (The silicon retina transmits events signifying change in luminance.) We were also able to encode static images

Spike Based Saliency Input Sparse Neural Encoding Reconstructed Image Once the image was encoded by orientation, we sorted the neural columns into channels Lateral inhibition within each channel created a mechanism for orientation based saliency Saliency Map