Neuromorphic Engineering

Slides:



Advertisements
Similar presentations
What is the neural code? Puchalla et al., What is the neural code? Encoding: how does a stimulus cause the pattern of responses? what are the responses.
Advertisements

Neural Network Models in Vision Peter Andras
Neuromorphic Analog VLSI West Virginia University
Biological Modeling of Neural Networks: Week 9 – Coding and Decoding Wulfram Gerstner EPFL, Lausanne, Switzerland 9.1 What is a good neuron model? - Models.
Neuronal Coding in the Retina and Fixational Eye Movements Christian Mendl, Tim Gollisch Max Planck Institute of Neurobiology, Junior Research Group Visual.
The free-energy principle: a rough guide to the brain? Karl Friston
Neural Cross Correlation For Radio Astronomy Chipo N Ngongoni Supervisor: Professor J Tapson Department of Electrical Engineering, University of Cape Town.
Writing Workshop Find the relevant literature –Use the review journals as a first approach e.g. Nature Reviews Neuroscience Trends in Neuroscience Trends.
Artificial Intelligence (CS 461D)
Hybrid Pipeline Structure for Self-Organizing Learning Array Yinyin Liu 1, Ding Mingwei 2, Janusz A. Starzyk 1, 1 School of Electrical Engineering & Computer.
The Brain is Embodied and the Body is Embedded in the Environment Jeff Krichmar Department of Cognitive Sciences University of California, Irvine.
Emergence of Machine Intelligence. “…Perhaps the last frontier of science – its ultimate challenge- is to understand the biological basis of consciousness.
Introduction to Neural Network Justin Jansen December 9 th 2002.
SME Review - September 20, 2006 Neural Network Modeling Jean Carlson, Ted Brookings.
Structure and function
Associative Learning in Hierarchical Self Organizing Learning Arrays Janusz A. Starzyk, Zhen Zhu, and Yue Li School of Electrical Engineering and Computer.
Cortical Neural Prosthetics Presented by Artie Wu.
Biologically Inspired Robotics Group,EPFL Associative memory using coupled non-linear oscillators Semester project Final Presentation Vlad TRIFA.
Artificial Neural Networks - Introduction -
Self-Organized Recurrent Neural Learning for Language Processing April 1, March 31, 2012 State from June 2009.
Introduction to Neural Networks. Neural Networks in the Brain Human brain “computes” in an entirely different way from conventional digital computers.
HYBRID COMPUTATION WITH SPIKES Rahul Sarpeshkar Robert J. Shillman Associate Professor MIT Electrical Engineering and Computer Science Banbury Sejnowski.
2 2  Background  Vision in Human Brain  Efficient Coding Theory  Motivation  Natural Pictures  Methodology  Statistical Characteristics  Models.
Lecture 2b Readings: Kandell Schwartz et al Ch 27 Wolfe et al Chs 3 and 4.
CS344 : Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 29 Introducing Neural Nets.
ACM 97 Semiconductors Carver Mead Gordon and Betty Moore Professor of Engineering and Applied Science, California Institute of Technology.
Grid-based Simulations of Mammalian Visual System Grzegorz M. Wójcik and Wiesław A. Kamiński Maria Curie-Sklodowska University, Lublin, Poland. Abstract.
The primate visual systemHelmuth Radrich, The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception.
Biomedical Sciences BI20B2 Sensory Systems Human Physiology - The basis of medicine Pocock & Richards,Chapter 8 Human Physiology - An integrated approach.
What is Neural Engineering Tae-Seong Kim, Ph.D.. Neural Engineering Neural engineering also known as Ne uroengineering is a discipline that uses engineering.
1 Machine Learning 1.Where does machine learning fit in computer science? 2.What is machine learning? 3.Where can machine learning be applied? 4.Should.
Neural codes and spiking models. Neuronal codes Spiking models: Hodgkin Huxley Model (small regeneration) Reduction of the HH-Model to two dimensions.
The Function of Synchrony Marieke Rohde Reading Group DyStURB (Dynamical Structures to Understand Real Brains)
Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel (office)
Mehdi Ghayoumi MSB rm 132 Ofc hr: Thur, a Machine Learning.
1 Discovery and Neural Computation Paul Thagard University of Waterloo.
Lecture 5 Neural Control
Chapter 2. From Complex Networks to Intelligent Systems in Creating Brain-like Systems, Sendhoff et al. Course: Robots Learning from Humans Baek, Da Som.
Neural Networks Presented by M. Abbasi Course lecturer: Dr.Tohidkhah.
Visual Computation I. Physiological Foundations
Dr.Abeer Mahmoud ARTIFICIAL INTELLIGENCE (CS 461D) Dr. Abeer Mahmoud Computer science Department Princess Nora University Faculty of Computer & Information.
Chapter 1: Introduction to Neuro-Fuzzy (NF) and Soft Computing (SC)
DMA 2 KAN Data-flexible multipurpose automated adaptive (k)omplex ANN (or autonomous ANN: A2N2) Neuronal Diversity Why important and prevalent? E.g. aspects:
Chapter 3. Stochastic Dynamics in the Brain and Probabilistic Decision-Making in Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning.
Neural Synchronization via Potassium Signaling. Neurons Interactions Neurons can communicate with each other via chemical or electrical synapses. Chemical.
Lecture 8 Neuromorphic Hearing 1. Outline The ear and the cochlea Silicon Cochlea 2.
Neuromorphic silicon chips
Chapter 2. From Complex Networks to Intelligent Systems in Creating Brain-Like Intelligence, Olaf Sporns Course: Robots Learning from Humans Park, John.
Sensation & Perception. Motion Vision I: Basic Motion Vision.
Object and face recognition
ACM 97 Semiconductors Carver Mead Gordon and Betty Moore Professor of Engineering and Applied Science, California Institute of Technology.
EDA Challenges in Neuromorphic Computing
The Human Visual System Background on Vision Human vision – the best system around Deep network models.
Biological Modeling of Neural Networks: Week 10 – Neuronal Populations Wulfram Gerstner EPFL, Lausanne, Switzerland 10.1 Cortical Populations - columns.
Where are we? What’s left? HW 7 due on Wednesday Finish learning this week. Exam #4 next Monday Final Exam is a take-home handed out next Friday in class.
Chapter 4. Analysis of Brain-Like Structures and Dynamics (2/2) Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning from Humans 09/25.
제 9 주. 응용 -4: Robotics Synthesis of Autonomous Robots through Evolution S. Nolfi and D. Floreano, Trends in Cognitive Science, vol. 6, no. 1, pp. 31~37,
Neuromorphic Engineering. Definitions Carver Mead introduce the term Neuromorphic Engineering to describe: A new field of engineering whose design principles.
Neural Codes. Neuronal codes Spiking models: Hodgkin Huxley Model (brief repetition) Reduction of the HH-Model to two dimensions (general) FitzHugh-Nagumo.
R epresentation O f S timuli A s N eural A ctivity ROSANA Project UCM-UAM-FrI-UPo-UEs.
November 30, 2011Colloquium1 Neurosynaptic computing chips s Tomotaka Kasahara Colloquium.
       January 3 rd, 2005 The signaling properties of the individual neuron. How we move from understanding individual nerve cells.
Chapter 13 Artificial Intelligence. Artificial Intelligence – Figure 13.1 The Turing Test.
Cognitive Computing…. Computational Neuroscience
Sistem Kecerdasan Buatan
Artificial Intelligence (CS 370D)
Artificial Intelligence ppt
OVERVIEW OF BIOLOGICAL NEURONS
? Dynamical properties of simulated MEG/EEG using a neural mass model
SENSOR BASED CONTROL OF AUTONOMOUS ROBOTS
Presentation transcript:

Neuromorphic Engineering University of Oxford Department of Engineering Science Natasha Chia

Outline Definition of neuromorphic systems Principles of neuromorphic technology Typical applications of neuromorphic technology The basic computational element Neural codes and information representation Future of Neuromorphic systems

Emulates the functional structure of neurobiological systems. Definitions Carver Mead introducec the term Neuromorphic Engineering to describe A new field of engineering whose design principles and architecture are biologically Inspired. Neuro “ to do with neurons i.e. neurally inspired” Morphic “ structure or form” Emulates the functional structure of neurobiological systems. Neuromorphic systems are systems implemented on silicon,whose architecture and design are based on neurobiology

Principles of neuromorphic technology Build machines that have similar perception capabilities as human perception Adaptable and self organising Robust to changing environments Realisation of future “THINKING” machines (intelligent and interactive systems) These understanding are creating new opportunities for intelligent systems design Provides promising methods to tackle a wide variety of design related problems

What does neuromorphic Engineering involve?

Applications of Neuromorphic Systems

Neuromorphic systems Silicon Retina Learning and adaptation silicon systems Koala-obstacle/tracking robot Silicon Cochlea Existing app are modest and the challenge of designing fully autonomous systems at the levels achieved by biological systems lies ahead. These devices are mostly analog and used as front end sensors TouchPad

Example of Modelling approaches Functional approach adopted (The goal is to construct a biologically constrained framework for speech recognition at the network level)so functional components are used in the models not actual biophysical components. Build a hierarchical speech system based on a model of the mammalian auditory system The undertaking is to construct a biologically constrained framework for speech recognition at the network level. Parallel distributed analog correlation based processing is the basis of VLSI systems that emulate the function of neural information processing in biological systems

The Basic computational element : The Neuron A typical neuron accepts input from its large dendritic tree and combines the information to produce a single output at its axon.

The Neuron Model

History of neuron modelling 1943 McCulloch & Pits 1963 Hodgkin & Huxley modelled axon of giant squid. 1970 Kiang & Gerstein numerical analysis of interactions in nerve cells 1983 Cohan & Mpitson Deterministic chaos used to describe behaviour of single neurons 1985 Meyer et al Discovery of electrical interaction between neurons 1992 Bower Quantitative evaluation of functional data 1993 Knopf and Gupta Fundamental neural processing element 1995 Bressler Parallel processing of information

Neural code and information representation How does spikes represent sensory information? Models of neuron spiking mechanism Stimulus Response features Group behaviour

Stimulus Response features Average firing rate Position of each neuronal discharge Instantaneous firing probability.(A ganglion’s firing rate depends on stimulation) Spike trains can only be encoded under two ideal conditions 1.Spike times must be precise 2.Distance between two events must be more than the spike time-jitter.

Spiking Neuron models Integrate and fire Stimulus Response Model (SRM) Neurons spike regularly in response to an external current. Rate of spiking increases with the magnitude of the stimulus current Stimulus Response Model (SRM) The stimulus is generalized into certain patterns in order to quantify the stimulus response

Neural coding Information is conveyed to the brain in parallel by spike trains of the nerve fibers.

Group behaviour of spikes One of the challenges has been to understand the relative contribution of various groups of spikes Oscillatory coupling effects and amplitude dynamics in two or more populations of neurons will be important topics for future research Some other examples: STDP(Spike Time-dependent plasticity) Group neurons with correlated inputs Brief talk on why the gp behaviour of spikes is not well understood

Future of neuromorphic systems Implantable medical electronics Increased human computer interaction Intelligent transportantion systems Learning, pattern recognition Robot control(self motion estimation) Learning higher order perceptual computation Neu en is still an evolving field and has not matured into an established discipline. Human computer interaction is shifted away from the keyboard monitor to other natural means of interaction s a speech. Neural based computation(learning,recognition and attention

Conclusion