Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 1 L. Itti: CS564 - Brain Theory and Artificial Intelligence University of Southern.

Slides:

Advertisements

Similar presentations

Chapter 4: The Visual Cortex and Beyond

Advertisements

Brian White Centre for Neuroscience Studies Queen’s, Kingston, Ontario, Canada Brian White Centre for Neuroscience Studies Queen’s, Kingston, Ontario,

Are We Paying Attention Yet? A review of the relation between attention and saccades By Travis McKinney.

Why do we move our eyes? - Image stabilization

The Physiology of Attention. Physiology of Attention Neural systems involved in orienting Neural correlates of selection.

Light Cornea Sclera Optic nerve Lens Vitreus humor Pigment epithelium Fovea Retina Light entering the eye is focused by the cornea and the lens. Then it.

Visual Attention Attention is the ability to select objects of interest from the surrounding environment A reliable measure of attention is eye movement.

Human (ERP and imaging) and monkey (cell recording) data together 1. Modality specific extrastriate cortex is modulated by attention (V4, IT, MT). 2. V1.

Chapter 6: Visual Attention. Overview of Questions Why do we pay attention to some parts of a scene but not to others? Do we have to pay attention to.

A possible representation of reward in the learning of saccades Cornelius Weber and Jochen Triesch Frankfurt Institute for Advanced Studies Johann Wolfgang.

Charles Pierrot-Deseilligny Dan Milea René M. Müri Eun H. Kim February 21, 2008 Eye Movement Control by the Cerebral Cortex.

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Didday Prey-Selector 1 Laurent Itti: CS564 - Brain Theory and Artificial Intelligence Lecture.

1.Exams due 9am 16 th. (grades due 10am 19 th ) 2.Describe the organization of visual signals in extra-striate visual cortex and the specialization of.

Covert Attention Mariel Velez What is attention? Attention is the ability to select objects of interest from the surrounding environment Involuntary.

Control of Attention and Gaze in the Natural World.

Physiology and Psychophysics of Eye Movements 1.Muscles and (cranial) nerves 2. Classes of eye movements/oculomotor behaviors 3. Saccadic Eye Movements,

THE BRAIN’S CONTROL OF HORIZONTAL SACCADIC EYE MOVEMENTS Shirley H. Wray, M.D., Ph.D.

Business Minor grade adjustments on Midterm 2 Opportunity to participate in Cognitive Neuroscience and Perception experiment - sign up for Tuesday, Wednesday.

Disorders of Orienting Lesions to parietal cortex can produce some strange behavioural consequences –patients fail to notice events on the contralesional.

Michael Arbib & Laurent Itti: CS664 – Spring Lecture 5: Visual Attention (bottom-up) 1 CS 664, USC Spring 2002 Lecture 7. Visual Attention (top-down)

Laurent Itti: CS599 – Computational Architectures in Biological Vision, USC. Lecture 12: Visual Attention 1 Computational Architectures in Biological Vision,

Alan L. Yuille. UCLA. Dept. Statistics and Psychology. Neural Prosthetic: Mind Reading. STATS 19 SEM Talk 6. Neural.

Active Vision Carol Colby Rebecca Berman Cathy Dunn Chris Genovese Laura Heiser Eli Merriam Kae Nakamura Department of Neuroscience Center for the Neural.

The oculomotor system Bijan Pesaran April 29, 2008.

Visually-induced auditory spatial adaptation in monkeys and humans Norbert Kopčo, I-Fan Lin, Barbara Shinn-Cunningham, Jennifer Groh Center for Cognitive.

EYE MOVEMENTS NBIO 401 Monday, November 22, 2010 Ric Robinson.

Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 1 CS564 - Brain Theory and Artificial Intelligence University of Southern California.

Michael Arbib & Laurent Itti: CS664 – Spring Lecture 5: Visual Attention (bottom-up) 1 CS 664, USC Spring 2002 Lecture 5. Visual Attention (bottom-up)

Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall Lecture 13. FARS 2 1 Michael Arbib: CS564 - Brain Theory and Artificial.

Arbib: CS564 - Brain Theory and Artificial Intelligence, USC, Fall Lecture 1. Introduction and Overview 1 The Aims of the Course: We will use the.

The oculomotor system Or Fear and Loathing at the Orbit Michael E. Goldberg, M.D.

Neural circuits for bias and sensitivity in decision-making Jan Lauwereyns Associate Professor, Victoria University of Wellington, New Zealand Long-term.

Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall Lecture 20. Schemas 1 1 Michael Arbib: CS564 - Brain Theory and Artificial.

Psych 216: Movement Attention. What is attention? Covert and overt selection appear to recruit the same areas of the brain.

Lateral Geniculate Nucleus (LGN) 1.Overview of central visual pathway 2.Projection from retina to LGN 3.LGN layers: P and M pathways 4.LGN receptive fields.

1 Computational Vision CSCI 363, Fall 2012 Lecture 3 Neurons Central Visual Pathways See Reading Assignment on "Assignments page"

Subject wearing a VR helmet immersed in the virtual environment on the right, with obstacles and targets. Subjects follow the path, avoid the obstacels,

Chapter 7. Network models Firing rate model for neuron as a simplification for network analysis Neural coordinate transformation as an example of feed-forward.

Chapter 8: Perceiving Motion

Chapter 3: Neural Processing and Perception. Neural Processing and Perception Neural processing is the interaction of signals in many neurons.

THE TOP TEN THINGS YOU SHOULD KNOW ABOUT THE OCULOMOTOR SYSTEM

NEUROBIOLOGY OF DECISION-MAKING, CSHL, May 2005 Choice, decision and action investigated with visually guided saccades. Jeffrey D. Schall With Leanne Boucher,

Active Vision: Memory, Attention and Spatial Representation in Parietal Cortex Carol Colby Rebecca Berman Cathy Dunn Chris Genovese Laura Heiser Eli Merriam.

Biological Modeling of Neural Networks: Week 12 – Decision models: Competitive dynamics Wulfram Gerstner EPFL, Lausanne, Switzerland 12.1 Review: Population.

VS131 Visual Neuroscience

Society for Psychophysiological Research

11 Attention Psychology 355.

The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand.

Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall Lecture 19. Systems Concepts 1 Michael Arbib: CS564 - Brain Theory and.

Visually guided attention during flying OR Pilots “do not like” fovea because they cannot pay attention to more than 1% of space at any one time.

September 2, 2009 Kamini Krishnan Tandra Toon. Article Focus Review of literature that combines use of functional or structural MRI and microelectrode.

THE TOP TEN THINGS YOU SHOULD KNOW ABOUT THE OCULOMOTOR SYSTEM.

Primary Cortical Sub-divisions The mapping of objects in space onto the visual cortex.

Laurent Itti: CS599 – Computational Architectures in Biological Vision, USC Lecture 12: Visual Attention 1 Computational Architectures in Biological.

Neural Control of Eye Movements

Copyright © 2007 Wolters Kluwer Health | Lippincott Williams & Wilkins Neuroscience: Exploring the Brain, 3e

Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall Lecture 14. FARS and Synthetic PET Michael Arbib: CS564 - Brain Theory.

Eye Movements – Target Selection & Control READING Schall JD (2002) The neural selection and control of saccades by frontal eye field. Philosophical Transactions.

1 Copyright © 2014 Elsevier Inc. All rights reserved. Chapter 19 Visual Network Moran Furman.

What is meant by “top-down” and “bottom-up” processing? Give examples of both. Bottom up processes are evoked by the visual stimulus. Top down processes.

The control of movement can be studied with the countermanding (stop signal) task success error.

Neural Circuitry underlying generation of saccades and pursuit Lab # 1 - Catching a ball - What to expect/ think about.

EYE MOVEMENTS NBIO 401 – Friday November 8, 2013.

Eye movements: Lab # 1 - Catching a ball

A neural test bed for simulating executive control deficits in saccade generation Uday Jagadisan Neeraj Gandhi University of Pittsburgh.

Visual Attention (neural mechanisms) Arash Afraz.

Lecture 22. Saccades 2 Reading Assignments: Reprint

Active Vision Carol Colby Rebecca Berman Cathy Dunn Chris Genovese

Posterior parietal cortex

Reading Assignments: Lecture 16. Saccades 2 The NSL Book

Presentation transcript:

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 1 L. Itti: CS564 - Brain Theory and Artificial Intelligence University of Southern California Lecture 15. Saccades 1 Reading Assignments: TMB 6.2 The Modular Design of the Oculomotor System in Monkeys Peter Dominey, Michael Arbib, and Amanda Alexander Sections: Description, Architecture Supplementary Reading: Crowley-Arbib Saccade Model M. Crowley, E. Oztop, and S. Marmol

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 2 From Schemas to Neural Networks - A Case Study: Modeling the Control of Saccades Classical Model of Reflex Saccades Expanding the Model to Bring in Cortical Functions

Filling in the Schemas: Neural Network Models Based on Monkey Neurophysiology Peter Dominey & Michael Arbib: Cerebral Cortex, 2: Develop hypotheses on Neural Networks that yield an equivalent functionality: mapping schemas (functions) to the cooperative cooperation of sets of brain regions (structures)

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 4 Experimental Protocols and Simulation Interfaces An experimental protocol defines a class of experiments based on:  Preparation used  External stimuli  Experimental manipulations : electrical stimulation, drug application, etc.  Measurements and observations The protocol can be translated into a simulation interface for “stimulating” a simulation and displaying the results.

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 5 Experiment - Double Saccade

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 6 Double Saccade -- Neural Array Activity Snapshot

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 7 Brain Stem Saccade Burst Generator LLBN-Long Lead Burst Neurons, MLBN-Medium Lead Burst Neurons, EBN- Excitatory Burst Neurons, PN-Omni-Pause Neurons, RI-Resettable Integrator, TN- Tonic Neurons, MN-Oculomotor Neurons. In the present Chapter/Lecture, this is treated as an unanalyzed module (available from the NSL Library) so that attention may focus on the other brain regions, which are described next.

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 8 Bringing in SC and FEF SC - Superior Colliculus: The midbrain’s path from vision (and other senses) to eye movement. FEF - Frontal Eye Field: The cortex’s path from vision to eye movement. Data point: A cat or monkey can still make saccades if one of SC or FEF is lesioned.

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 9 Simple Saccade Task time +

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 10 Experimental Setup

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 11 Timing Diagram for Simple Saccade Experiment "visinP3M3" is the stimulus for the first target, "fixation" is the fixation timing, "verticalTheta" is the vertical eye movement response, and "horizontalTheta" is the horizontal eye movement response. Notice that the eyes do not move until the "posteriorParietalCenter", a specific neuron in the model of LIP, goes low.

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 12 Memory Saccade Experiment time + + +

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 13 Timing Diagram for Memory Saccade Experiment "visinM2P2" is the stimulus for the target, "fixation" is the fixation timing, "verticalTheta" is the vertical eye movement response, and "horizontalTheta" is the horizontal eye movement response

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 14 Double Saccade Experiment time +

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 15 Timing Diagram for the Double Saccade Experiment "visinM3P0" is the stimulus for the first target and "visinM3P3" is the stimulus for the second target. "fixation" is the fixation timing, "verticalTheta" is the vertical eye movement response, and "horizontalTheta" is the horizontal eye movement response.

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 16 Timing Diagram for Lesioning of SC Experiment Output of SC is disabled. "visinP3M3" is the stimulus for the first target, "fixation" is the fixation timing, "verticalTheta" is the vertical eye movement response, and "horizontalTheta" is the horizontal eye movement response.

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 17 FEF Stimulation with SC Lesioned time + FEF Stimulation

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 18 Compensatory Saccade: Stimulation of FEF with Lesioning of SC A visual target is briefly presented and removed before a saccade can begin. Before the visual saccade can begin, an electrical stimulus is applied to the FEF. The monkey will first saccade to the stimulated location and then to the real target even though timewise the real target appeared first. This is due to the fact that the the visual signal takes time to get from the retina to the FEF.

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 19 The Full Dominey Model DCEP-Damped Change in Eye Position 7a/LIP-Oculomotor Region of Posterior Parietal Cortex

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 20

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 21

Laurent Itti: CS564 - Brain Theory and Artificial Intelligence. Saccades 1 22