7 Attention and Scene Perception. Introduction Attention: Any of the very large set of selective processes in the brain To deal with the impossibility.

Slides:



Advertisements
Similar presentations
Reminder: extra credit experiments
Advertisements

Electrophysiology of Visual Attention. Does Visual Attention Modulate Visual Evoked Potentials? The theory is that Visual Attention modulates visual information.
The Physiology of Attention. Physiology of Attention Neural systems involved in orienting Neural correlates of selection.
Perceptual Processes: Attention & Consciousness Dr. Claudia J. Stanny EXP 4507 Memory & Cognition Spring 2009.
Chapter 4: Cortical Organization
Human (ERP and imaging) and monkey (cell recording) data together 1. Modality specific extrastriate cortex is modulated by attention (V4, IT, MT). 2. V1.
Chapter 6: Visual Attention. Overview of Questions Why do we pay attention to some parts of a scene but not to others? Do we have to pay attention to.
Visual Attention: Outline Levels of analysis 1.Subjective: perception of unattended things 2.Functional: tasks to study components of attention 3.Neurological:
This Lecture Unilateral Neglect Unilateral Neglect a representational deficit? a representational deficit? a deficit in orienting control? a deficit in.
Attention - Overview Definition Theories of Attention Neural Correlates of Attention Human neurophysiology and neuroimaging Change Blindness Deficits of.
Visual Attention. How much information can we process?
Spatial Neglect and Attention Networks Week 11 Group 1 Amanda Ayoub Alyona Koneva Kindra Akridge Barbara Kim.
Disorders of Visual Attention. Hemispatial Neglect Cause –often a stroke that has interrupted the flow of blood to the right parietal lobe that is thought.
NEUR 3680 Midterm II Review Megan Metzler
Psych 216: Movement Attention. What is attention? There is too much information available in the world to process it all. Demonstration: change-detection.
Read this article for next week: A Neural Basis for Visual Search in Inferior Temporal Cortex Leonardo Chelazzi et al. (1993) Nature.
Chapter 6: Visual Attention. Scanning a Scene Visual scanning – looking from place to place –Fixation –Saccadic eye movement Overt attention involves.
Chapter 6: Visual Attention. Scanning a Scene Visual scanning – looking from place to place –Fixation –Saccadic eye movement Overt attention involves.
Features and Objects in Visual Processing
Office Hours Today are Relocated to CCBN rm EP1216 (the receptionist can help you find me)
Read this article for Wednesday: A Neural Basis for Visual Search in Inferior Temporal Cortex Leonardo Chelazzi et al. (1993) Nature.
Attention Orienting System and Associated Disorders Neglect, Extinction and Balint’s Syndrome.
Visual Search: finding a single item in a cluttered visual scene.
Hemispatial Neglect Unilateral lesion to Parietal or Temporo- Parietal Junction Patients present with vision problems, but are not “blind” – Rather, they.
Searching for the NCC We can measure all sorts of neural correlates of these processes…so we can see the neural correlates of consciousness right? So what’s.
Upcoming Stuff: Finish attention lectures this week No class Tuesday next week – What should you do instead? Start memory Thursday next week – Read Oliver.
Attention Orienting System and Associated Disorders Neglect, Extinction and Balint’s Syndrome.
Post-test review session Tuesday Nov in TH241.
Final Review Session Neural Correlates of Visual Awareness Mirror Neurons
Pre-attentive Visual Processing: What does Attention do? What don’t we need it for?
Electrophysiology of Visual Attention. Does Visual Attention Modulate Visual Evoked Potentials? The theory is that Visual Attention modulates visual information.
Read article by Anne Treisman. Stages of Selection.
Attention I failures to select information. What is attention? How is the word used? Examples: –something bright caught my attention –I didn’t see you,
Disorders of Orienting Lesions to parietal cortex can produce some strange behavioural consequences –patients fail to notice events on the contralesional.
1 3 Processes of Pattern Recognition Sensation – you have to detect or see the pattern Perception – you have to organize the features into a whole Memory.
Visual Attention More information in visual field than we can process at a given moment Solutions Shifts of Visual Attention related to eye movements Some.
Next Week Memory: Articles by Loftus and Sacks (following week article by Vokey)
Visual search: Who cares?
Attention II Selective Attention & Visual Search.
Features and Object in Visual Processing. The Waterfall Illusion.
December 1, 2009Introduction to Cognitive Science Lecture 22: Neural Models of Mental Processes 1 Some YouTube movies: The Neocognitron Part I:
Selective Visual Attention & Visual Search
Cognitive Processes PSY 334 Chapter 3 – Attention July 10, 2003.
Attention II Theories of Attention Visual Search.
Features and Object in Visual Processing. The Waterfall Illusion.
Disorders of Attention Orienting
Attention I failures to select information. What is attention? How is the word used? Examples: –something bright caught my attention –I didn’t see you,
Orienting Attention Posner Cue - Target Paradigm: Subject presses a button as soon as x appears.
Beyond the Striate Cortex. Extrastriate Pathways  Parallel processing of visual information from the striate cortex.  Three pathways: Color processing.
Studying Visual Attention with the Visual Search Paradigm Marc Pomplun Department of Computer Science University of Massachusetts at Boston
Figure 7.1 Even though the letters are big enough to resolve while looking at the Xs, we simply cannot read the left-hand and right-hand sentences at the.
PSYC 368 – ATTENTION TO SCENES JOHN SECEN MSC CANDIDATE GRADUATE PROGRAM IN NEUROSCIENCE MARCH 11, 2010.
1 Perception and VR MONT 104S, Fall 2008 Session 13 Visual Attention.
Attention Part 2. Early Selection Model (Broadbent, 1958) inputdetectionrecognition FI L T E R Only information that passed the filter received further.
Psych 435 Attention. Issues Capacity –We can’t respond to everything in the environment –Too many pieces of information –we can only actively respond.
Lecture 4 – Attention 1 Three questions: What is attention? Are there different types of attention? What can we do with attention that we cannot do without.
R Driver, J. (1998). The Neuropsychology of Spatial Attention. In H. Pashler (Ed.), Attention (pp ). San Diego: Psychology Press. Reviewer: Jooyoung.
Attention Part 2 Page
Mind, Brain & Behavior Wednesday February 19, 2003.
Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.
Psych 335 Attention. Issues Capacity –We can’t respond to everything in the environment –Too many pieces of information –we can only actively respond.
Orienting Attention to Semantic Categories T Cristescu, JT Devlin, AC Nobre Dept. Experimental Psychology and FMRIB Centre, University of Oxford, Oxford,
Goals for Today’s Class
Fundamentals of Sensation and Perception
FMRI and Behavioral Studies of Human Face Perception Ronnie Bryan Vision Lab
Steven Dodd, Christian Kreitz, Lauren Landers, Kelsey Panter.
Chapter 4: Cortical Organization
Cognitive Psychology Chapter 4: Attention.
Chapter 7 - Visual Attention
Attention and Scene Perception
Presentation transcript:

7 Attention and Scene Perception

Introduction Attention: Any of the very large set of selective processes in the brain To deal with the impossibility of handling all inputs at once, the nervous system has evolved mechanisms that are able to restrict processing to a subset of things, places, ideas, or moments in time Selective attention: The form of attention involved when processing is restricted to a subset of the possible stimuli

Introduction Varieties of Attention External: Attending to stimuli in the world Internal: Attending to one line of thought over another or selecting one response over another Overt: Directing a sense organ toward a stimulus, like pointing your eyes or turning your head Covert: Attending without giving an outward sign you are doing so Divided: Splitting attention between two different stimuli Sustained: Continuously monitoring some stimulus

Figure 7.1 Even though the letters are big enough to resolve while looking at the Xs, we simply cannot read the left-hand and right-hand sentences at the same time

Figure 7.2 Search for the unicorn in this piece of a “Where’s Waldo?” picture

Selection in Space Reaction time (RT): A measure of the time from the onset of a stimulus to a response Cue: A stimulus that might indicate where (or what) a subsequent stimulus will be Cues can be valid (correct information), invalid (incorrect), or neutral (uninformative) Stimulus onset asynchrony (SOA): The time between the onset of one stimulus and the onset of another

Selection in Space Cueing as a tool for examining attention Simple probe detection experiment  Posner cueing paradigm Cues can be valid or invalid  RTs are shorter on valid cue trials  RTs are longer on invalid cue trials

Figure 7.3 The Posner cueing paradigm (Part 1)

Figure 7.3 The Posner cueing paradigm (Part 2)

Figure 7.3 The Posner cueing paradigm (Part 3)

Figure 7.4 The effect of a cue develops over time

Selection in Space Theories of Attention “Spotlight” model: Attention is restricted in space and moves from one point to the next. Areas within the spotlight receive extra processing “Zoom lens” model: The attended region can grow or shrink depending on the size of the area to be processed

Visual Search Visual search: Looking for a target in a display containing distracting elements Examples: Finding your car in a parking lot or a friend in a crowd Target: The goal of a visual search Distractor: In visual search, any stimulus other than the target Set size: The number of items in a visual search display

Visual Search The efficiency of visual search is the average increase in RT for each item added to the display Measured in terms of search slope, or ms/item The larger the search slope (more ms/item), the less efficient the search Some searches are efficient and have small slopes Some searches are inefficient and have large slopes

Figure 7.6 Laboratory visual search tasks

Visual Search Feature searches are efficient Feature search: Search for a target defined by a single attribute, such as a salient color or orientation Salience: The vividness of a stimulus relative to its neighbors Parallel: In visual attention, referring to the processing of multiple stimuli at the same time

Visual Search Many searches are inefficient Serial self-terminating search: A search from item to item, ending when a target is found

Visual Search In real-world searches, basic features guide visual search Guided search: Attention is restricted to a subset of possible items based on information about the item’s basic features (e.g., color or shape) Conjunction search: Search for a target defined by the presence of two or more attributes  No single feature defines the target  Defined by the co-occurrence of two or more features

Figure 7.9 A real-world conjunction search

Visual Search In real-world searches, the real world guides visual search Scene-based guidance: Information in our understanding of scenes that helps us find specific objects in scenes  For instance, a mug will typically be found on a horizontal surface and a picture will typically be found on a vertical surface

Figure 7.11 Search for arbitrary objects is not very efficient

Figure 7.12 Scene-based guidance would help you find the faucet in this scene

Visual Search The binding problem: The challenge of tying different attributes of visual stimuli, which are handled by different brain circuits, to the appropriate object so we perceive a unified object Example: A vertical red bar moving to the right  Color, motion, and orientation are represented by separate neurons  How do we combine these features when perceiving the bar?

Figure 7.13 A conjunction search with a binding problem

Visual Search Feature integration theory: Treisman’s theory of visual attention, which holds that a limited set of basic features can be processed in parallel preattentively, but that other properties, including the correct binding of features to objects, require attention Preattentive stage: The processing of a stimulus that occurs before selective attention is deployed to that stimulus

Visual Search Is there any evidence that features are represented independently of each other and need to be bound together? Yes. Illusory conjunction: An erroneous combination of two features in a visual scene Example: Seeing a red X when the display contains red letters and Xs but no red Xs Illusory conjunctions provide evidence that some features are represented independently and must be correctly bound together with attention

Figure 7.14 Illusory conjunctions

Attending in Time: RSVP and the Attentional Blink Rapid serial visual presentation (RSVP): An experimental procedure in which stimuli appear in a stream at one location (typically the point of fixation) at a rapid rate (typically about eight per second) RSVP is used to study the temporal dynamics of visual attention

Attending in Time: RSVP and the Attentional Blink Attentional blink: The difficulty in perceiving and responding to the second of two target stimuli amid a RSVP stream of distracting stimuli The second target is often missed if it appears within 200 to 500 ms of the first target Green and Bavelier (2003) reported that people who play first-person shooter video games have a reduced attentional blink This suggests that visual attention performance can be improved with practice

Figure 7.15 The attentional blink (AB) in video game and non–video game players (Part 1)

Figure 7.15 The attentional blink (AB) in video game and non–video game players (Part 2)

Figure 7.16 Marvin Chun’s fishing metaphor for attentional blink

Attending in Time: RSVP and the Attentional Blink Repetition blindness: A failure to detect the second occurrence of a letter, word, or picture in a RSVP stream of stimuli The second occurrence is often missed when it appears within 200 to 500 ms of the first occurrence This phenomenon is similar to the attentional blink but involves the inability to detect the same target if it appears twice

The Physiological Basis of Attention How might attention work, in terms of neural activity? Three ways responses of a cell could be changed by attention: 1.Response enhancement 2.Sharper tuning 3.Altered tuning

Figure 7.21 Three ways that the response of a cell could be changed as a result of attention

The Physiological Basis of Attention Attention could enhance neural activity Attention to a specific part of the visual field causes neurons coding those locations to have increased activity This increased activation has been detected using fMRI technology

Figure 7.17 Spotlights of attention in the human brain

The Physiological Basis of Attention Attention could enhance the processing of a specific type of stimulus Fusiform face area (FFA): An area in the fusiform gyrus of human extrastriate cortex that responds preferentially to faces according to fMRI studies Parahippocampal place area (PPA): A region of cortex in the temporal lobe of humans that appears to respond strongly to images of places (as opposed to isolated objects)

Figure 7.20 These images combine faces and houses

Figure 7.19 Functional MRI reveals that different pieces of the cortex are activated by faces and by places

The Physiological Basis of Attention Attention could alter the tuning of a neural receptive field Receptive fields of neurons are not completely fixed and can change in response to attentional demands

Figure 7.22 Each of these images is a map of part of the visual field

Disorders of Visual Attention Visual field defect: A portion of the visual field with no vision or with abnormal vision, typically resulting from damage to the visual nervous system Parietal lobe: In each cerebral hemisphere, a lobe that lies toward the top of the brain between the frontal and occipital lobes Damage to the parietal lobe can cause a visual field defect such that one side of the world is not attended to

The Physiological Basis of Attention Neglect: In visual attention, the inability to attend to or respond to stimuli in the contralesional visual field Typically, neglect of the left visual field after damage to the right parietal lobe Contralesional field: The visual field on the side opposite a brain lesion For example, points to the left of fixation are contralesional to damage to the right hemisphere of the brain Ipsilesional field: The visual field on the same side as a brain lesion

Figure 7.23 Five images through the brain of a neglect patient (viewed as though from above)

Figure 7.24 A neglect patient might produce this sort of result if asked to cross out all the lines

Figure 7.25 In copying a drawing like the one in (a), a neglect patient often omits one side of the object, as in (b)

The Physiological Basis of Attention Attention can be object-based Evidence from neglect patients indicates that they sometimes neglect one side of an object rather than one side of the visual field

Figure 7.26 Tipper and Behrmann’s (1996) experiment

The Physiological Basis of Attention Extinction: In visual attention, the inability to perceive a stimulus to one side of the point of fixation (e.g., to the right) in the presence of another stimulus, typically in a comparable position in the other visual field (e.g., on the left side)

The Physiological Basis of Attention Balint syndrome: Results from bilateral lesions of the parietal lobes Spatial localization abilities are greatly reduced Balint syndrome patients don’t move their eyes very much Balint syndrome patients have simultagnosia: An inability to perceive more than one object at a time

Perceiving and Understanding Scenes Two pathways to scene perception Selective pathway: Permits the recognition of one or a very few objects at a time. This pathway passes through the bottleneck of selective attention Nonselective pathway: Contributes information about the distribution of features across a scene as well as information about the “gist” of the scene. This pathway does not pass through the bottleneck of attention

Figure 7.27 From the world to our perception of the world

Perceiving and Understanding Scenes The nonselective pathway computes ensemble statistics Ensemble statistics: The average and distribution of properties, such as orientation or color, over a set of objects or a region in a scene

Figure 7.28 Some fishy ensemble statistics

Perceiving and Understanding Scenes The nonselective pathway computes scene gist and layout very quickly Spatial layout: The description of the structure of a scene (e.g., enclosed, open, rough, smooth) without reference to the identity of specific objects in the scene

Figure 7.30 Spatial layout from global information

Perceiving and Understanding Scenes Memory for objects and scenes is amazingly good Brady, et al. (2008) performed a task where subjects looked at 2500 objects in the training phase and then chose which of two objects they had seen in a test phase  When the objects were of different types (e.g., a sailboat and a telephone), the subjects got 92% correct  When the objects were the same category (e.g., an office chair and a dining room chair), the subjects got 88% correct  When the same objects were in different states (e.g., a breadbox with the bread inside or outside the box), the subjects got 87% correct

Figure 7.31 Spend a second or two looking at each of these pictures. Then move on to Figure 7.32

Figure 7.32 Without referring back to Figure 7.31, identify which of these pictures you already saw

Perceiving and Understanding Scenes Memory for objects and scenes is amazingly bad Change blindness: The failure to notice a change between two scenes If the change does not alter the gist, or meaning, of the scene, quite large changes can pass unnoticed Demonstrates that we don’t encode and remember as much of the world as we might think we do

Figure 7.33 There are four differences between these two images. Can you find them?

Figure 7.34 Here are the locations of the differences between the two images in Figure 7.33

Perceiving and Understanding Scenes What do we actually see? We feel like we see a lot of details in a scene Change blindness shows us that we are not encoding as many details as we might think What we see is often driven by our expectations of what we “should” be seeing Inattentional blindness: A failure to notice: or at least to report: a stimulus that would be easily reportable if it were attended If we don’t pay attention to something, it is as if we don’t see it