Psychological studies of face recognition:

Slides:



Advertisements
Similar presentations
Shape Matching and Object Recognition using Low Distortion Correspondence Alexander C. Berg, Tamara L. Berg, Jitendra Malik U.C. Berkeley.
Advertisements

Person Perception Whats in a Face? Who or What are You?
BEAUTY IS IT REALLY IN THE EYE OF THE BEHOLDER? IS IT REALLY IN THE EYE OF THE BEHOLDER?
Method Participants 36 healthy participants (19 females) aged from 17 to 24 years (mean = 20; SD = 1,67) Material Participants were randomly allocated.
Article review by Alexander Backus Distributed representations meeting article review.
(2) Face Recognition These notes are the second part of a two-part lecture roughly corresponding to (1) object recognition and (2) face recognition We'll.
Are faces special?. Brain damage can produce problems in face recognition - even own reflection (Bodamer, 1947) Prosopagnosia usually results from localized.
Chapter 3 Attention and Performance
Psy 260 Announcements All late CogLab Assignment #1’s due today CogLab #2 (Attention) is due Thurs. 9/21 at the beginning of class Coglab booklets and.
Are faces special?.
The neural basis of face recognition? Tim Andrews.
Chapter 7 Knowledge Terms: concept, categorization, prototype, typicality effect, object concepts, rule-governed, exemplars, hierarchical organization,
Face Recognition and Biometric Systems
Announcement MIDTERM When: 2/ PM Where: 128 Dennison.
Visual Processing in Fingerprint Experts and Novices
Prosopagnosia and Face-Specific Mechanisms Brad Duchaine Vision Sciences Laboratory Harvard University
Comparing Thompson’s Thatcher effect with faces and non-face objects Elyssa Twedt 1, David Sheinberg 2 & Isabel Gauthier 1 Vanderbilt University 1, Brown.
A Module in Human Extrastriate Cortex Specialized for Face Perception
Computer Vision Group University of California Berkeley Shape Matching and Object Recognition using Shape Contexts Jitendra Malik U.C. Berkeley (joint.
Real-time Embedded Face Recognition for Smart Home Fei Zuo, Student Member, IEEE, Peter H. N. de With, Senior Member, IEEE.
I. Face Perception II. Visual Imagery. Is Face Recognition Special? Arguments have been made for both functional and neuroanatomical specialization for.
Visual Cognition II Object Perception. Theories of Object Recognition Template matching models Feature matching Models Recognition-by-components Configural.
Recognising objects and faces. General problems Given that objects move on a surface, why do they not appear to change shape? How do we recognise objects.
Pattern Recognition Pattern - complex composition of sensory stimuli that the human observer may recognize as being a member of a class of objects Issue.
Visual Cognition II Object Perception. Theories of Object Recognition Template matching models Feature matching Models Recognition-by-components Configural.
Visual Expertise Is a General Skill Maki Sugimoto University of California, San Diego November 20, 2000.
Reading. Reading Research Processes involved in reading –Orthography (the spelling of words) –Phonology (the sound of words) –Word meaning –Syntax –Higher-level.
Physical Symbol System Hypothesis
George Lovell (Based on Roth & Bruce)
An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking.
Prosopagnosia Emotion recognition FFA.
The changing face of face research Vicki Bruce School of Psychology Newcastle University.
Pattern recognition = perception Template theory  has problems Prototype theory  better Distinctive features theory  better.

Visual Processing in Fingerprint Experts and Novices Tom Busey Indiana University, Bloomington John Vanderkolk Indiana State Police, Fort Wayne Expertise.
Prosopagnosia:. Prosopagnosia: Defined as a specific inability to recognise familiar faces. (Bodamer 1947). Contrasted with visual agnosia - inability.
CONNECTIONIST MODELLING
Cognitive Psychology PSYC231 Perception 2 Dr. Jan Lauwereyns, EA619, ext
S EPTEMBER 2008, S LOVENIA 2 ND B ALKAN V ISION S CIENCE M EETING Aspects of face perception: Aspects of face perception: gaze direction and emotional.
Korea University Dept.of Industrial System & Information Engineering User Interface Lab Chapter 3 _ Object Recognition + 이병용.
Horizontally split facial composites show improved identification Alex H. McIntyre, Peter J.B. Hancock and Charlie D. Frowd Department of Psychology University.
Introduction Processing of configurational information is often highly affected by inversion Previous research has focused on the perception of static.
An Unsupervised Connectionist Model of Rule Emergence in Category Learning Rosemary Cowell & Robert French LEAD-CNRS, Dijon, France EC FP6 NEST Grant.
Expertise, Millisecond by Millisecond Tim Curran, University of Colorado Boulder 1.
EMPATH: A Neural Network that Categorizes Facial Expressions Matthew N. Dailey and Garrison W. Cottrell University of California, San Diego Curtis Padgett.
3D Face Recognition Using Range Images
Face Recognition. Name these famous faces Cohen (1989) distinguishes between a) Face identification: looking at a person’s face and knowing who it is.
The anatomical basis of face recognition: evidence from studies of intact individuals:
Visual Agnosias Specification: Theories of perceptual organisation
Cognitive - perception.ppt © 2001 Laura Snodgrass, Ph.D.1 Perception The final image we are consciously aware of is a “constructed” representation of the.
Psychological studies of (normal) face recognition:
Ch. 13 A face in the crowd: which groups of neurons process face stimuli, and how do they interact? KARI L. HOFFMANN 2009/1/13 BI, Population Coding Seminar.
CONTENTS:  Introduction.  Face recognition task.  Image preprocessing.  Template Extraction and Normalization.  Template Correlation with image database.
Perception & Pattern Recognition 1 Perception Pattern Recognition Theories of Pattern Recognition Bottom-up vs. Top-Down Processing & Pattern Recognition.
Chapter 9 Knowledge. Some Questions to Consider Why is it difficult to decide if a particular object belongs to a particular category, such as “chair,”
Face recognition and visual agnosias Bruce and Young’s theory of face recognition, including case studies and explanations of prosopagnosia.
Do Expression and Identity Need Separate Representations?
Visual Computation and Learning Lab
CLPS0020: Introduction to Cognitive Science
Perceptual Disorders Agnosias.
Feature based vs. holistic processing
Prosopagnosia.
INTERVIEWING WITNESSES
Neuropsychology of Vision Anthony Cate April 19, 2001
Feature based vs. holistic processing
Crowding by a single bar
Visual Processing in Fingerprint Experts and Novices
Multi-level Crowding and the Paradox of Object Recognition in Clutter
Bruce & Young’s model of face recognition (1986)
Presentation transcript:

Psychological studies of face recognition:

The Bruce and Young (1986) model of face processing: Structural encoding: "this is a face" Expression Facial Speech Age, Gender Recognition Face Recognition Units: stored faces Person Identity Nodes: stored semantic information Name Generation

Interactive Activation and Competition (IAC) model (Burton, Bruce and Johnston 1990): Blair Politicians Charles Diana Royalty PIN's SIU's FRU's NIU's FRU - face recognition unit PIN - person identity node SIU - semantic information unit NIU - name input unit - +

Interactive Activation and Competition (IAC) model: Semantic priming: 1. Charles FRU activates Charles PIN. 2. Charles PIN activates Royalty SIU. 3. Royalty SIU activates Diana PIN. 4. Diana PIN now "primed". FRU's Charles Diana SIU's Charles Royalty PIN's Diana

Interactive Activation and Competition (IAC) model: Repetition priming: 1. Charles FRU activated. 2. Charles PIN activated. 3. FRU-PIN link strengthened. 4. Less Charles FRU activation now required for PIN to be activated. FRU's Charles Diana Charles Royalty PIN's SIU's Diana

What does the "structural encoding" consist of What does the "structural encoding" consist of? (a) Featural (piecemeal) processing: “Big nose” “Brown hair” “Chubby face” “Eyes close together”

(b) Configural / relational / holistic processing:

Evidence for existence of configural processing: The Inversion Effect: (e.g. Yin 1970, Diamond and Carey 1986). Upside-down faces are hard to recognise. The Thatcher Illusion: (Thompson 1980). Subtle relational changes are not apparent in inverted faces… Evidence for existence of featural processing: Recognition can still be achieved from features alone (e.g. in scrambled faces, and from isolated features).

Further evidence for configural processing: The “chimeric face effect” Aligned face halves give strong impression of a new face. Difficult to recognise either “donor” face. Upright faces evoke obligatory configural processing (Young, Hellawell and Hay 1987, Hole 1994, Hole et al 1999, Khurana et al 2000).

The composite face effect: Upright (but not inverted) faces are processed in an integrated "holistic" way, that prevents easy access to their constituent features.

Face superiority effects: Features are recognised better if they are presented within a whole face than if presented in isolation or within a scrambled face (Tanaka and Farah 1993).

Other aspects of structural encoding: Haig (1986): people are very sensitive to the precise location of the facial features, especially the eyes and mouth. Negative faces are poorly recognised - representation of shape from shading is important for recognition.

Valentine’s “Multidimensional Face Space” Nose length Long Short Eye separation Narrow Wide Valentine’s “Multidimensional Face Space” Distinctive (big nose, close-set eyes) Distinctive (small nose, widely-set eyes) Typical

What does configural processing actually involve? Hole et al (2003): effects of various affine transformations on familiar-face recognition: Vertical stretching Horizontal stretching Shearing Inversion

What does configural processing actually involve? Bindemann et al (2008): ERP N250r response to face repetition is unaffected by stretching: equivalent priming from stretched and normal faces. Hole (2011): Face Identity After-effect is same for normal and stretched faces.

Conclusions: Configurational processing tolerates linear and global distortions of input. Involves either – Something sophisticated (e.g. ratios of facial metrics); Or A normalisation process (using a prototypical face template?)

(a) Transform input to match prototypical template ("normalisation"): (b) Transform template to match input (“deformable template” theories, e.g. van der Malsburg 1993):

The relationship between configural and featural processing: parallel routes to recognition? Collishaw and Hole (2000): Investigated effects of disruptive manipulations in isolation and in combinations: Blurring impairs processing of local features more than processing of global configuration (Costen et al. 1994) Scrambling and inversion impair configural processing more than featural processing (Valentine, 1988)

If featural and configural processing are parallel routes to recognition, then: (a) Any single manipulation (scrambling, inversion or blurring) will lead to some but not total impairment. (b) Combinations of manipulations that affect the same process will produce no more impairment than the same manipulations singly (scrambling + inversion same as scrambling or inversion). (c) Combinations of manipulations that affect different processes will severely impair recognition (scrambling + blurring or inversion + blurring = chance performance.).

Recognising famous faces: % Correct Chance level

Is configural processing unique to faces?: Probably not - Diamond and Carey (1986): inversion effects with dog breeders. Rhodes and MacLean (1990): caricature effects with birds. Gauthier and Tarr(1997): inversion effects with greebles. greebles of different genders:

Is non-face configural processing equivalent to that for faces?: No – Robbins and McKone (2007): Dog experts showed no face-like processing for dogs on three tasks (inversion, CFE, negation).

Are faces "special"?: Yes in the sense that they require fine-grain within-class discriminations between category exemplars (e.g. individual faces). This type of processing may not be unique to faces; may be used with any stimulus class that requires subtle within-class discriminations (Bruce and Humphreys 1994). Gauthier: = general-purpose object-recognition mechanisms, which are most often used with faces. Bentin: = face-specific mechanisms which can be adapted for use with other stimulus classes, given experience.

Overall conclusions: Faces can be recognised by either configural or featural processing (though using both is probably best). Configural processing of upright faces is automatic and involuntary (chimeric face effect). Configural processing involves more than extraction of simple facial metrics (distortion studies). Faces are "special" in involving a type of processing used mainly (but not exclusively) with faces.