Development and Disintegration of Conceptual Knowledge: A Parallel-Distributed Processing Approach Jay McClelland Department of Psychology and Center for.

Slides:



Advertisements
Similar presentations
PDP: Motivation, basic approach. Cognitive psychology or “How the Mind Works”
Advertisements

Does the Brain Use Symbols or Distributed Representations? James L. McClelland Department of Psychology and Center for Mind, Brain, and Computation Stanford.
Emergence in Cognitive Science: Semantic Cognition Jay McClelland Stanford University.
Emergence of Semantic Structure from Experience Jay McClelland Stanford University.
Knowledge, Mental Models and HCI. Introduction 4 If we want to –predict learning time –identify “typical” errors –relative ease of performance of tasks.
Organizational Notes no study guide no review session not sufficient to just read book and glance at lecture material midterm/final is considered hard.
The Mind, The Brain, Intelligence, and Cognition.
What is Cognitive Science? … is the interdisciplinary study of mind and intelligence, embracing philosophy, psychology, artificial intelligence, neuroscience,
What is Cognitive Science? … is the interdisciplinary study of mind and intelligence, embracing philosophy, psychology, artificial intelligence, neuroscience,
What is Cognitive Science? … is the interdisciplinary study of mind and intelligence, embracing philosophy, psychology, artificial intelligence, neuroscience,
Categorization  How do we organize our knowledge?  How do we retrieve knowledge when we need it?
Cognitive Processes PSY 334 Chapter 2 – Perception.
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
THEORIES OF MIND: AN INTRODUCTION TO COGNITIVE SCIENCE Jay Friedenberg and Gordon Silverman.
Cooperation of Complementary Learning Systems in Memory Review and Update on the Complementary Learning Systems Framework James L. McClelland Psychology.
Information Processing Approach Define cognition and differentiate among the stage, levels-of-processing, parallel distributed processing, and connectionist.
Using Backprop to Understand Apects of Cognitive Development PDP Class Feb 8, 2010.
Representation, Development and Disintegration of Conceptual Knowledge: A Parallel-Distributed Processing Approach James L. McClelland Department of Psychology.
Emergence of Semantic Structure from Experience Jay McClelland Stanford University.
Integrating New Findings into the Complementary Learning Systems Theory of Memory Jay McClelland, Stanford University.
The PDP Approach to Understanding the Mind and Brain J. McClelland Cognitive Core Class Lecture March 7, 2011.
The PDP Approach to Understanding the Mind and Brain Jay McClelland Stanford University January 21, 2014.
Cognition at Stanford Jay McClelland & Lera Boroditsky Spring, 2009.
Disintegration of Conceptual Knowledge In Semantic Dementia James L. McClelland Department of Psychology and Center for Mind, Brain, and Computation Stanford.
Awakening from the Cartesian Dream: The PDP Approach to Understanding the Mind and Brain Jay McClelland Stanford University February 7, 2013.
© 2013 The McGraw-Hill Companies, Inc. All rights reserved. Thinking: Memory, Cognition, and Language Chapter 6.
Contrasting Approaches To Semantic Knowledge Representation and Inference Psychology 209 February 15, 2013.
MULTIPLE MEMORY SYSTEM IN HUMANS
Emergence of Semantic Knowledge from Experience Jay McClelland Stanford University.
The Influence of Feature Type, Feature Structure and Psycholinguistic Parameters on the Naming Performance of Semantic Dementia and Alzheimer’s Patients.
Memory and Cognition PSY 324 Chapter 2: Cognition and the Brain Part III: Neural Representation Dr. Ellen Campana Arizona State University.
Development, Disintegration, and Neural Basis of Semantic Cognition: A Parallel-Distributed Processing Approach James L. McClelland Department of Psychology.
Emergence of Semantic Structure from Experience Jay McClelland Stanford University.
Similarity and Attribution Contrasting Approaches To Semantic Knowledge Representation and Inference Jay McClelland Stanford University.
Cognitive Processes Chapter 8. Studying CognitionLanguage UseVisual CognitionProblem Solving and ReasoningJudgment and Decision MakingRecapping Main Points.
Rapid integration of new schema- consistent information in the Complementary Learning Systems Theory Jay McClelland, Stanford University.
Usability and Human Factors Cognition and Human Performance Lecture b This material (Comp15_Unit3b) was developed by Columbia University, funded by the.
Semantic Cognition: A Parallel Distributed Processing Approach James L. McClelland Center for the Neural Basis of Cognition and Departments of Psychology.
The PDP Approach to Understanding the Mind and Brain Jay McClelland Stanford University January 21, 2014.
James L. McClelland Stanford University
The Origins of Knowledge Debate How do people gain knowledge about the world around them? Are we born with some fundamental knowledge about concepts like.
Origins of Cognitive Abilities Jay McClelland Stanford University.
The Emergent Structure of Semantic Knowledge
Chapter 2: The Cognitive Science Approach
Memory: Its Nature and Organization in the Brain James L. McClelland Stanford University.
Emergent Semantics: Meaning and Metaphor Jay McClelland Department of Psychology and Center for Mind, Brain, and Computation Stanford University.
Biological and cognitive plausibility in connectionist networks for language modelling Maja Anđel Department for German Studies University of Zagreb.
Semantic Knowledge: Its Nature, its Development, and its Neural Basis James L. McClelland Department of Psychology and Center for Mind, Brain, and Computation.
Organization and Emergence of Semantic Knowledge: A Parallel-Distributed Processing Approach James L. McClelland Department of Psychology and Center for.
Development and Disintegration of Conceptual Knowledge: A Parallel-Distributed Processing Approach James L. McClelland Department of Psychology and Center.
Mental Organs. Phrenology An important part of popular culture in Victorian England and in Europe during the 19th century.
Long Term Memory LONG TERM MEMORY (LTM)  Variety of information stored in LTM:  The capital of Turkey  How to drive a car.
How Do Brain Areas Work Together When We Think, Perceive, and Remember? J. McClelland Stanford University.
Adapted from by E.Day THE COGNITIVE APPROACH TYPES OF PROCESSING.
Chapter 9 Knowledge. Some Questions to Consider Why is it difficult to decide if a particular object belongs to a particular category, such as “chair,”
Language and Brain Summer, 2017.
Psychology 209 – Winter 2017 January 31, 2017
What is cognitive psychology?
Learning linguistic structure with simple and more complex recurrent neural networks Psychology February 2, 2017.
Application of Our Problem: Biological Correlates of Language
Psychology 209 – Winter 2017 Feb 28, 2017
Development and Disintegration of Conceptual Knowledge: A Parallel-Distributed Processing Approach James L. McClelland Department of Psychology and Center.
Does the Brain Use Symbols or Distributed Representations?
Cooperation of Complementary Learning Systems in Memory
Dynamical Models of Decision Making Optimality, human performance, and principles of neural information processing Jay McClelland Department of Psychology.
Memory and Learning: Their Nature and Organization in the Brain
Emergence of Semantic Structure from Experience
Emergence of Semantics from Experience
CLS, Rapid Schema Consistent Learning, and Similarity-weighted Interleaved learning Psychology 209 Feb 26, 2019.
Presentation transcript:

Development and Disintegration of Conceptual Knowledge: A Parallel-Distributed Processing Approach Jay McClelland Department of Psychology and Center for Mind, Brain, and Computation Stanford University

Some Phenomena in Development Progressive differentiation of concepts Overgeneralization in naming Illusory correlations

Overgeneralization in Naming and “Illusory Correlations” Children often over-generalize object names, e.g. calling most animals “dog”. Rochel Gelman found that many children think that all animals have feet. –Even animals that look like small furry balls and don’t seem to have any feet at all.

Patients typically in 50s present with difficulty naming familiar objects. Intact executive functions, normal memory for unfamiliar stimuli (novel faces, random shapes), fluent speech, spared ability in abstract tests such as Raven’s matrices. Patients have increasingly severe deficits in tests of semantic knowledge both from words and pictures. Disease also progresses, from the temporal pole to encompass large parts of anterior and lateral temporal neocortex. language Semantic Dementia

Some Phenomena in Semantic Dementia Progressive loss of conceptual differentiation Overgeneralization of frequent names Illusory correlations

Picture naming and drawing in Sem. Demantia

Representation is a pattern of activation distributed over neurons within and across brain areas. Bidirectional propagation of activation underlies the ability to bring these representations to mind from given inputs. The knowledge underlying propagation of activation is in the connections. language Parallel Distributed Processing Approach to Semantic Cognition

A Principle of Learning and Representation Captured in PDP models Learning and representation are sensitive to coherent covariation of properties across experiences.

What is Coherent Covariation? The tendency of properties of objects to co- occur in clusters. e.g. –Has wings –Can fly –Is light Or –Has roots –Has rigid cell walls –Can grow tall

The Rumelhart Model

Target output for ‘robin can’ input

ExperienceExperience Early Later Later Still

Overgeneralization of Frequent Names to Similar Objects “dog” “goat” “tree”

Severity of DementiaFraction of Neurons Destroyed omissionswithin categ. superord. Patient Data Simulation Results Errors in Naming for As a Function of Severity

Ongoing Projects in the Lab Semantic Cognition: –Domain generality (Tim Rogers) –Bayesian vs. Connectionist Approaches –Relation of semantic and linguistic knowledge (Katia Dilkina) –Integration of semantic and episodic memory (Cynthia Hendersion) Explicit and implicit processes in causal reasoning and contingency learning (Daniel Sternberg) Where do biases and stereotypes come from? (Jeremy Glick) How do brain areas work together when we think, perceive and remember? (Cynthia Henderson)

Collaborations at Stanford Paul Thibadeau and Lera Boreditsky –How we share knowledge across content domains Analogy, metaphor, and cross-domain knowledge sharing Juan Gao (post-doc) and Bill Newsome –Dynamics of decision making; continuous representation of decision state Dharshan Kumaran (post-doc) and Anthony Wagner –Neural basis of new semantic learning You and {…} –???