1 How is knowledge stored? Human knowledge comes in 2 varieties: Concepts Concepts Relations among concepts Relations among concepts So any theory of how.

Slides:



Advertisements
Similar presentations
Copyright © Cengage Learning. All rights reserved.
Advertisements

Knowledge Representation
Ch 4. Multimedia Principle
Representations One of the major distinctions between ordinary software and AI is the need to represent domain knowledge (or other forms of worldly knowledge)
Unit 3 Review 1.Two processes that cause forgetting are decay and displacement. (a) Define each. (b) Both processes are examples of _____ failure.
Cognitive - knowledge.ppt © 2001 Laura Snodgrass, Ph.D.1 Knowledge Structure of semantic memory –relationships among concepts –organization of memory –memory.
Chapter 9 Knowledge.
Chapter 7 Knowledge Terms: concept, categorization, prototype, typicality effect, object concepts, rule-governed, exemplars, hierarchical organization,
Representation/organization in LTM Typical empirical testing paradigm: propositional verification task – rt to rose is flower, vs. rose is plant. Set Theoretical.
INTRODUCTION TO ARTIFICIAL INTELLIGENCE Massimo Poesio LECTURE 4: Semantic Networks and Description Logics.
Knowledge Engineering
 Contrary to the beliefs of early workers in AI, experience has shown that Intelligent Systems cannot achieve anything useful unless they contain a large.
Organization of Semantic Memory The study of Collins & Quillian (1969):Collins & Quillian (1969): The authors were interested in the organization of semantic.
Knowledge ß How do we organize our knowledge? ß How do we access our knowledge? ß Do we really use categories?
PSY 369: Psycholinguistics Mental representations II.
Knowing Semantic memory.
Cognitive Processes PSY 334 Chapter 5 – Meaning-Based Knowledge Representation July 24, 2003.
Natural Categories Hierarchical organization of categories –Superordinate (e.g., furniture) –Basic-level (e.g., chair) –Subordinate (e.g., armchair) Rosch.
1 Data & Database Development. 2 Data File Bit Byte Field Record File Database Entity Attribute Key field Key file management concepts include:
Knowledge information that is gained and retained what someone has acquired and learned organized in some way into our memory.
Categorization  How do we organize our knowledge?  How do we retrieve knowledge when we need it?
Objects Objects are at the heart of the Object Oriented Paradigm What is an object?
Cognitive Psychology, 2 nd Ed. Chapter 8 Semantic Memory.
Keystone Problems… Keystone Problems… next Set 19 © 2007 Herbert I. Gross.
Memory for General Knowledge
Lecture 10 – Semantic Networks 1 Two questions about knowledge of the world 1.How are concepts stored? We have already considered prototype and other models.
General Knowledge Dr. Claudia J. Stanny EXP 4507 Memory & Cognition Spring 2009.
Semantic Memory Memory for meaning
Semantic Memory Psychology Introduction This is our memory for facts about the world This is our memory for facts about the world How do we know.
Semantic Memory Knowledge memory Main questions How do we gain knowledge? How is our knowledge represented and organised in the mind-brain? What happens.
CS261 Data Structures Trees Introduction and Applications.
Conceptual Hierarchies Arise from the Dynamics of Learning and Processing: Insights from a Flat Attractor Network Christopher M. O’ConnorKen McRaeGeorge.
Knowledge Representation CPTR 314. The need of a Good Representation  The representation that is used to represent a problem is very important  The.
Psychology of Thinking: Embedding Artifice in Nature.
Memory for General Knowledge and Concepts and Categorization
Semantic Memory Knowledge memory Main questions How do we gain knowledge? How is our knowledge represented and organised in the mind-brain? What happens.
Emergence of Semantic Knowledge from Experience Jay McClelland Stanford University.
PSY 323 – COGNITION Chapter 9: Knowledge.  Categorization ◦ Process by which things are placed into groups  Concept ◦ Mental groupings of similar objects,
Psyc 1002 Dr Caleb Owens Cognitive Processes Lecture 4 : The structure of long term memory.
Category Structure Psychology 355: Cognitive Psychology Instructor: John Miyamoto 05/20 /2015: Lecture 08-2 This Powerpoint presentation may contain macros.
Memory--what’s in there?. The problem You have a great deal of stuff in memory: How do you get the right thing out when you need it?
Memory systems What kinds of things do we know? Is all memory the same? Types of memory systems Semantic and episodic memory.
Similarity and Attribution Contrasting Approaches To Semantic Knowledge Representation and Inference Jay McClelland Stanford University.
Long Term Memory: Semantic Kimberley Clow
GIS Data Models GEOG 370 Christine Erlien, Instructor.
Copyright © 2010, Pearson Education Inc., All rights reserved.  Prepared by Katherine E. L. Norris, Ed.D.  West Chester University of Pennsylvania This.
AP Lang and Comp April 8, 2014 Ms. Bugasch Goals 1. Compare/Contrast Essay - Edits and Revisions 2. AP Terms 3. Introduction to the rhetorical mode: definition.
Cognitive Processes PSY 334 Chapter 5 – Meaning-Based Knowledge Representation.
Introduction to the ERWC (Expository Reading and Writing Course)
The Emergent Structure of Semantic Knowledge
Organization of Semantic Memory Typical empirical testing paradigm: propositional verification task – rt to car has four wheels vs. car is a status symbol.
Associative Theories of Long- Term Memory. Network Theory The basic notion that we need to explore is that memory consists of a large number of associations.
Neuropsychological Evidence for Category Structure Then: The Functional Role of Mental Imagery Psychology 355: Cognitive Psychology Instructor: John Miyamoto.
Semantic Memory Psychology Introduction This is our memory for facts about the world How do we know that the capital of Viet Nam is Hanoi How is.
How to investigate Perception & Cognition n Ask your subjects (Introspectionism) n Look at S-R patterns (Behaviorism) n Infer mental processes (Cognitive.
Verbal Representation of Knowledge
Lecture 8 – Categories 1 great detail is needed for planning & executing current responses some detail about context of new learning can be emcoded with.
Determining the Main Idea. What do these three items have in common?
Chapter 9 Knowledge. Some Questions to Consider Why is it difficult to decide if a particular object belongs to a particular category, such as “chair,”
Module 5 Other Knowledge Representation Formalisms
What is cognitive psychology?
Artificial Intelligence (CS 370D)
Class Schedule In-text Citations Long-term Memory: Organization
[Human Memory] 10.Knowledge
Cognitive Psychology Chapter 7 Knowledge, Part I.
Psychology of Thinking: Embedding Artifice in Nature
How is knowledge stored?
Categories My dog sleeping. My dog. All golden retrievers. All dogs. All canines. All mammals… Each of these is a category. Categorization is the process.
Presentation transcript:

1 How is knowledge stored? Human knowledge comes in 2 varieties: Concepts Concepts Relations among concepts Relations among concepts So any theory of how knowledge is stored must explain both types. We’ll look at concepts a little later in the term. Today, it’s relations.

2 How are relations among concepts stored? Rosch argued for hierarchical knowledge, that is, knowledge using the contains relation: Animal contains mammal contains canine She argued that this explains both the speed of knowledge retrieval and our ability to make inferences. She argued that this explains both the speed of knowledge retrieval and our ability to make inferences.

3 Retrieving knowledge Is a mouse a mammal? Yes. But how do I know? How do I find this bit of information among all the many things that I know?

4. Making inferences Does a mouse bear live young? A mouse is a mammal. Mammals bear live young. Therefore, a mouse bears live young. But in order for me to be able to reason like this, my knowledge store must connect mouse to mammal & mammal to live young.

5 Two ways we could store knowledge Imagine that we have lots of facts that we need to store, and each fact is written on a 3X5 card. We are going to store these cards on tables in a large room. How do we do this? A mouse is a mammal

6 Storing knowledge in a list One way would be just to start piling cards on the nearest table as we get them. We would keep piling cards onto that table until they spilled onto the floor, then move on to the next table, and continue till all the tables were full. If you wanted a piece of information that was on one of those cards, how would you get it?

7 A list of problems with lists Retrieving any particular fact becomes more difficult the more facts you learn. Retrieving any particular fact becomes more difficult the more facts you learn. Lists do not capture relations between facts (e.g., dogs display dominance by snarling; wolves display dominance by snarling). Lists do not capture relations between facts (e.g., dogs display dominance by snarling; wolves display dominance by snarling). The list structure doesn’t have a mechanism for making inferences, so our knowledge would never be greater than the sum of the items on the list. The list structure doesn’t have a mechanism for making inferences, so our knowledge would never be greater than the sum of the items on the list.

8 Advantages of structured knowledge Faster access to concepts Faster access to concepts E.g., if you want farm animal information, go to the farm animal table E.g., if you want farm animal information, go to the farm animal table Going beyond knowledge-based-on- experience, by making inferences. Going beyond knowledge-based-on- experience, by making inferences. Generalizing to create new knowledge. Generalizing to create new knowledge.

9 Faster access to concepts Continuing with the “tables” metaphor, we could assign each table to a topic (e.g., seven tables for politics, nine tables for animals, six for gardening… The animal tables could each be used for one class (e.g., reptiles, farm animals, sea animals…). Now, if you wanted a particular piece of information about farm animals, what would you do? The principle, of course, is organization.

10 Making inferences Example: is spelt a food? Your knowledge store tells you 2 things: Spelt is a grainGrains are food You can answer the question even if you don’t have a card that says “spelt is a food”

11 Generalizing to create new knowledge Suppose we learn that: Tractors have large tires Combines have large tires We can now generalize: farm vehicles have large tires. Do hay-balers have large tires? Yes. We can work that out even without explicitly learning it.

12 What is the structure like? We can all agree that having structure in our knowledge store offers advantages. But what is that structure? A wall? A path? A tree? The most widely-accepted answer is, a network. A semantic network.

13 Network models of semantic memory Quillian (1968), Collins & Quillian (1969) First network model of semantic memory Collins & Loftus (1975) Revised network model of semantic memory Neural network models (later in the term)

14 Quillian’s (1968) model Quillian was a computer scientist. He wanted to build a program that would read and ‘understand’ English text. To do this, he had to give the program the knowledge a reader has. Constraint: computers were slow, and memory was very expensive, in those days.

15 Basic elements of Quillian’s model Nodes Nodes represent concepts. They are ‘placeholders’. They are empty. Links Connections between nodes. Nodes send signals to each other down these links.

16 Wren Animal Mammal Bird FeathersWings Air Live young breathes has bears isa

17 Things to notice about Quillian’s model All links are equivalent. Structure was rigidly hierarchical. Time to retrieve information based on number of links Cognitive economy – properties stored only at highest possible level (e.g., birds have wings) Made sense in late 1960s, when computer memory was very expensive, so efficiency was highly valued. Made sense in late 1960s, when computer memory was very expensive, so efficiency was highly valued.

18 Problems with Quillian’s model 1.How to explain typicality effect? Is a robin a bird? Is a chicken a bird? Easier to say ‘yes’ to robin. Why? 2.How to explain that it is easier to report that a bear is an animal than that a bear is a mammal? 3.Cognitive economy – do we learn by erasing links?

19 What’s new in Collins & Loftus (1975) A. Structure responded to data accumulated since original Collins & Quillian (1969) paper got rid of hierarchy got rid of cognitive economy allowed links to vary in length (not all equal)

20 animal mammal bird robin ostrich feathers wings fly bat fly skin cow

21 What’s new in Collins & Loftus (1975)? B. Process – Spreading Activation Activation – arousal level of a node Spreading – down links Mechanism used to extract information from network Allowed neat explanation of a very important empirical effect: Priming

22 Priming An effect on response to one stimulus (TARGET) produced by processing another stimulus immediately before (PRIME) If prime is related to target (e.g., bread-butter), reading prime improves response to target). Usually measured on RT; sometimes on accuracy RT (related)

23 Priming RelatedUnrelatedTask breadnurseread only BUTTERBUTTERread, respond Difference in RT to two types of trials = priming effect. (Related shorter RT than unrelated.)

24 Why is the Priming effect important? The priming effect is an important observation that models of semantic memory must account for. Any model of semantic memory must be the kind of thing that could produce a priming effect. A network through which activation spreads is such a model. (Score one point for networks.)

25 Review Knowledge has structure Our representation of that structure makes new knowledge available (things not experienced) The most popular models are network models, containing links and nodes. Nodes are empty. They are just placeholders.

26 Review Knowledge is stored in the structure – the pattern of links, and the lengths of the links. The pattern of links and the lengths of links are consequences of experience (learning). Network models provide a handy explanation of priming effects.