A High-Performance Brain- Computer Interface 4.19.2012.

Slides:



Advertisements
Similar presentations
Perception Chapter 9: Event Perception Event Perception: an event is defined as a change in both time and space. Thus far we have discussed how our visual.
Advertisements

All materials are based on the following paper Meel Velliste, Sagi Perel, M. Chance Spalding, Andrew S. Whitford and Andrew B. Schwartz, Cortical control.
Population vector algorithm
A brain-machine interface instructed by direct intracortical microstimulation Joseph E. O’Doherty, Mikhail A. Lebedev, Timothy L. Hanson, Nathan A. Fitzsimmons.
Eye movements: Lab # 1 - Catching a ball. How do we use our eyes to catch balls? What information does the brain need? Most experiments look at simple.
Attention Part 2. Early Selection Model (Broadbent, 1958) inputdetectionrecognition FI L T E R Only information that passed the filter received further.
The Berlin Brain-Computer Interface: Machine Learning-Based Detection of User Specific Brain States Umar Farooq Berlin Brain Computer Interface.
Chapter 50 The Prefrontal Cortex and Executive Brain Functions Copyright © 2014 Elsevier Inc. All rights reserved.
Active Vision: Memory, Attention and Spatial Representation in Parietal Cortex Carol Colby Rebecca Berman Cathy Dunn Chris Genovese Laura Heiser Eli Merriam.
From: Davida Teller Award Lecture 2013: The importance of prediction and anticipation in the control of smooth pursuit eye movements Journal of Vision.
Journal of Vision. 2003;3(11):7. doi: / Figure Legend:
David L. Barack, Steve W.C. Chang, Michael L. Platt  Neuron 
Volume 20, Issue 5, Pages (May 1998)
A Source for Feature-Based Attention in the Prefrontal Cortex
Gijsbert Stoet, Lawrence H Snyder  Neuron 
Ranulfo Romo, Adrián Hernández, Antonio Zainos  Neuron 
Volume 51, Issue 6, Pages (September 2006)
Choosing Goals, Not Rules: Deciding among Rule-Based Action Plans
Differential Dynamics of Activity Changes in Dorsolateral and Dorsomedial Striatal Loops during Learning  Catherine A. Thorn, Hisham Atallah, Mark Howe,
Jung Hoon Sul, Hoseok Kim, Namjung Huh, Daeyeol Lee, Min Whan Jung 
Complex Movements Evoked by Microstimulation of Precentral Cortex
Coding of the Reach Vector in Parietal Area 5d
Choice Certainty Is Informed by Both Evidence and Decision Time
Goal-Related Activity in V4 during Free Viewing Visual Search
Braden A. Purcell, Roozbeh Kiani  Neuron 
Volume 20, Issue 5, Pages (May 1998)
Learning to Simulate Others' Decisions
A Neural Signature of Divisive Normalization at the Level of Multisensory Integration in Primate Cortex  Tomokazu Ohshiro, Dora E. Angelaki, Gregory C.
Alteration of Visual Perception prior to Microsaccades
Nils Kolling, Marco Wittmann, Matthew F.S. Rushworth  Neuron 
Volume 81, Issue 6, Pages (March 2014)
Computational Mechanisms of Sensorimotor Control
Activity in Posterior Parietal Cortex Is Correlated with the Relative Subjective Desirability of Action  Michael C. Dorris, Paul W. Glimcher  Neuron 
Banburismus and the Brain
Responses of Collicular Fixation Neurons to Gaze Shift Perturbations in Head- Unrestrained Monkey Reveal Gaze Feedback Control  Woo Young Choi, Daniel.
Volume 66, Issue 4, Pages (May 2010)
Volume 24, Issue 13, Pages (July 2014)
Volume 87, Issue 5, Pages (September 2015)
Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque  Matthew I. Leon, Michael N. Shadlen 
Volume 74, Issue 3, Pages (May 2012)
Sensory Population Decoding for Visually Guided Movements
Neural Correlates of Reaching Decisions in Dorsal Premotor Cortex: Specification of Multiple Direction Choices and Final Selection of Action  Paul Cisek,
Differences between Neural Activity in Prefrontal Cortex and Striatum during Learning of Novel Abstract Categories  Evan G. Antzoulatos, Earl K. Miller 
Volume 28, Issue 15, Pages e5 (August 2018)
Jeremy B. Wilmer, Ken Nakayama  Neuron 
Katherine M. Armstrong, Jamie K. Fitzgerald, Tirin Moore  Neuron 
Prefrontal Cortex Activity Related to Abstract Response Strategies
Moran Furman, Xiao-Jing Wang  Neuron 
Rapid Automatic Motor Encoding of Competing Reach Options
Eye Movement Preparation Modulates Neuronal Responses in Area V4 When Dissociated from Attentional Demands  Nicholas A. Steinmetz, Tirin Moore  Neuron 
Neural Mechanisms of Speed-Accuracy Tradeoff
Mosquitoes Use Vision to Associate Odor Plumes with Thermal Targets
Volume 95, Issue 5, Pages e5 (August 2017)
Redmond G. O’Connell, Michael N. Shadlen, KongFatt Wong-Lin, Simon P
Segregation of Object and Background Motion in Visual Area MT
Serial, Covert Shifts of Attention during Visual Search Are Reflected by the Frontal Eye Fields and Correlated with Population Oscillations  Timothy J.
Volume 87, Issue 5, Pages (September 2015)
Volume 76, Issue 4, Pages (November 2012)
Ethan S. Bromberg-Martin, Okihide Hikosaka  Neuron 
Learning to Simulate Others' Decisions
Sébastien Marti, Jean-Rémi King, Stanislas Dehaene  Neuron 
Cognitive neural prosthetics
Prefrontal Neurons Coding Suppression of Specific Saccades
Visual selection: Neurons that make up their minds
Gijsbert Stoet, Lawrence H Snyder  Neuron 
John B Reppas, W.Martin Usrey, R.Clay Reid  Neuron 
End-Stopping and the Aperture Problem
The Postsaccadic Unreliability of Gain Fields Renders It Unlikely that the Motor System Can Use Them to Calculate Target Position in Space  Benjamin Y.
Optimizing Visual Motion Perception during Eye Movements
Richard A. Andersen, He Cui  Neuron 
Presentation transcript:

A High-Performance Brain- Computer Interface

Introduction Problem: – The speed and accuracy with which keys can be selected using BCI’s is far lower than for systems relying on eye movement Competition with communication prostheses relying on saccades or speech At the time, current information transfer rates were around 1 bit/sec (human) and 1.6 bit/sec (monkey)

Background Most BCI’s are used to guide continuous motion, such as a cursor. – If this motion results in a discrete choice, why not train on the discrete choice specifically, “direct end- point control” – Focus on premotor cortex (PMd). Neural activity contains the end-point information of an upcoming reach. Good signal for horizontal/vertical directionality of upcoming reach Potentially occurs through rehearsal of movement

Instructed Delay Reach Trial a, Standard instructed-delay reach trial. Data from selected neural units are shown (grey shaded region); each row corresponds to one unit and black tick marks indicate spike times. Units are ordered by angular tuning direction (preferred direction) during the delay period. For hand (H) and eye (E) traces, blue and red lines show the horizontal and vertical coordinates, respectively. The full range of scale for these data is ^15 cm from the center touch cue.

Optimization of T int is based on two metrics Single-trial accuracy – Percentage of targets correctly predicted plateaus around 85-90% at ms Information Transfer Rate Capacity (bps) – Measures the rate at which information is conveyed from the subject, through the BCI, to the environment. Closely related to the single trial accuracy divided by the trial length length.

Prosthetic Cursor Trials b, Chain of three prosthetic cursor trials followed by a standard instructed-delay reach trial. Tskip is denoted by the orange parts of the time line. Neural activity was integrated (Tint) during the purple shaded interval and used to predict the reach target location. After a short processing time (Tdec+rend approximately 40 ms), a prosthetic cursor was briefly rendered and a new target was displayed. The dotted circles represent the reach target and prosthetic cursor from the previous trial, both of which were rapidly extinguished before the start of the trial indicated. Trials shown here are from experiment H with monkey H.

Neural Activity – Presence of neural activity in PMd after brief display of visual target, confirms that sustained neural activity is motor-related rather than purely sensory Neural Loss – Single-trial accuracy falls as neuron ensemble size decreases. However, it is possible to compensate partially for this performance loss by increasing Tint Controls

Results and Discussion At its fastest, this direct end-point control BCI demonstrates selection speeds (3.5 trials per second) on par with saccadic eye movements – Information transfer rate of up to 6.5 bits/sec, ~15 words/min The ITRC for saccades is much higher due to their exceptional precision and accuracy, but an advantage of BCI’s is they don’t rely on repurposing natural processes for a new use. While real patients may have to choose from several objects in their workspace, these objects will not ordinarily be presented immediately prior to a decision to execute a prosthetic reach. Furthermore, BCIs will typically rely on internally-generated target plans as opposed to externally presented stimuli

Fast Trial Video

ITRC