ICCS2004 — explaining the brain How we might be able to Understand the Brain Brian D. Josephson Department of Physics University of Cambridge

Slides:



Advertisements
Similar presentations
ARCHITECTURES FOR ARTIFICIAL INTELLIGENCE SYSTEMS
Advertisements

1 GPS, A Program That Simulates Human Thought 신 동 호신 동 호 Allen Newell & H.A. Simon.
The Logic of Intelligence Pei Wang Department of Computer and Information Sciences Temple University.
1 Chapter 2 The Digital World. 2 Digital Data Representation.
Week 11 Review: Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution.
Chapter 4 Introduction to Cognitive Science
Knowledge Representation
© Cambridge International Examinations 2013 Component/Paper 1.
Project management Project manager must;
Transitions The Writing Center University of North Carolina at Chapel Hill.
Self-organised Reality
Team Task Choose 1 Progression to READ: Number and Operations--Fractions Ratios and Proportional Relationships Develop “Content” Knowledge.
Best-First Search: Agendas
© Curriculum Foundation1 Section 3 Assessing Skills Section 3 Assessing Skills There are three key questions here: How do we know whether or not a skill.
Consistency of Assessment
Using the ICF as a Framework for Washington Group Measures Barbara M. Altman Jennifer Madans Elizabeth Rasch National Center for Health Statistics.
System Design and Analysis
Planning Value of Planning What to consider when planning a lesson Learning Performance Structure of a Lesson Plan.
Introduction to Systems CSCI102 - Systems ITCS905 - Systems MCS Systems.
Physical Symbol System Hypothesis
Scientific method - 1 Scientific method is a body of techniques for investigating phenomena and acquiring new knowledge, as well as for correcting and.
Conceptual modelling. Overview - what is the aim of the article? ”We build conceptual models in our heads to solve problems in our everyday life”… ”By.
Foundations This chapter lays down the fundamental ideas and choices on which our approach is based. First, it identifies the needs of architects in the.
Lecture 1 Introduction: Linguistic Theory and Theories
Centralian Senior College. Examples  Add and subtract  Write a paragraph  An amoeba  The conventions of punctuation  When oppression meets resistance,
Quantum One: Lecture 7. The General Formalism of Quantum Mechanics.
Theories of Development. Cognitive Development Early psychologists believed that children were not capable of meaningful thought and that there actions.
Philosophical Foundations Chapter 26. Searle v. Dreyfus argument §Dreyfus argues that computers will never be able to simulate intelligence §Searle, on.
Chapter 9 Architecture Alignment. 9 – Architecture Alignment 9.1 Introduction 9.2 The GRAAL Alignment Framework  System Aspects  The Aggregation.
RESEARCH DESIGN.
RSBM Business School Research in the real world: the users dilemma Dr Gill Green.
Chapter 6 System Engineering - Computer-based system - System engineering process - “Business process” engineering - Product engineering (Source: Pressman,
Cognitive Development
Chapter 8 Architecture Analysis. 8 – Architecture Analysis 8.1 Analysis Techniques 8.2 Quantitative Analysis  Performance Views  Performance.
Describing and Exploring Data Initial Data Analysis.
Planning and Integrating Curriculum: Unit 4, Key Topic 1http://facultyinitiative.wested.org/1.
Linguistics Introduction.
Lecture2: Database Environment Prepared by L. Nouf Almujally & Aisha AlArfaj 1 Ref. Chapter2 College of Computer and Information Sciences - Information.
Formal Models in AGI Research Pei Wang Temple University Philadelphia, USA.
The Problem page, Coherence, ideology How an ideological message is conveyed through language, and particularly through the following aspects of textual.
LOGIC AND ONTOLOGY Both logic and ontology are important areas of philosophy covering large, diverse, and active research projects. These two areas overlap.
DataBase Management System What is DBMS Purpose of DBMS Data Abstraction Data Definition Language Data Manipulation Language Data Models Data Keys Relationships.
Introduction to programming in the Java programming language.
The Next Generation Science Standards: 4. Science and Engineering Practices Professor Michael Wysession Department of Earth and Planetary Sciences Washington.
Lyra – A service-oriented and component-based method for the development of communicating systems (by Sari Leppänen, Nokia/NRC) Traditionally, the design,
WHAT IS THE NATURE OF SCIENCE?. SCIENTIFIC WORLD VIEW 1.The Universe Is Understandable. 2.The Universe Is a Vast Single System In Which the Basic Rules.
PROBLEM AREAS IN MATHEMATICS EDUCATION By C.K. Chamasese.
Philosophy 224 Responding to the Challenge. Taylor, “The Concept of a Person” Taylor begins by noting something that is going to become thematic for us.
Paper III Qualitative research methodology. Objective 1.3 To what extent can findings be generalized from qualitative studies.
© NOKIAmind.body.PPT / / PHa page: 1 Conscious Machines and the Mind-Body Problem Dr. Pentti O A Haikonen, Principal Scientist, Cognitive Technology.
SOFTWARE DESIGN. INTRODUCTION There are 3 distinct types of activities in design 1.External design 2.Architectural design 3.Detailed design Architectural.
Kherson, May 20-22, Nikolaj S. Nikitchenko Kyiv National Taras Shevchenko University, Ukraine Integration of Informatics-Programming Disciplines.
1 Knowledge Acquisition and Learning by Experience – The Role of Case-Specific Knowledge Knowledge modeling and acquisition Learning by experience Framework.
Developing the theoretical and conceptual framework From R.E.Khan ( J199 lecture)
INSTRUCTIONAL OBJECTIVES
Plan Introducing the SINTELNET white paper The background: agent-based models, social simulations, logical analysis, and mirror-neuron system... Where.
Formal Specification: a Roadmap Axel van Lamsweerde published on ICSE (International Conference on Software Engineering) Jing Ai 10/28/2003.
Levels of Linguistic Analysis
RULES Patty Nordstrom Hien Nguyen. "Cognitive Skills are Realized by Production Rules"
Artificial Intelligence: Research and Collaborative Possibilities a presentation by: Dr. Ernest L. McDuffie, Assistant Professor Department of Computer.
Pattern Recognition. What is Pattern Recognition? Pattern recognition is a sub-topic of machine learning. PR is the science that concerns the description.
Formulating a research problem R esearch areas and topics.
What is qualitative data analysis? Different approaches to analysing qualitative data.
What is cognitive psychology?
Syntax Lecture 9: Verb Types 1.
Draft for factual comments, suggestions on overlaps welcome.
Knowledge Representation
Quantum One.
Levels of Linguistic Analysis
Toward a Great Class Project: Discussion of Stoianov & Zorzi’s Numerosity Model Psych 209 – 2019 Feb 14, 2019.
Presentation transcript:

ICCS2004 — explaining the brain How we might be able to Understand the Brain Brian D. Josephson Department of Physics University of Cambridge

ICCS2004 — explaining the brain Thanks to: Hermann Hauser David Blair Nils Baas Andrée Ehresmann presentation created using OpenOffice.org running on MacOS

ICCS2004 — explaining the brain for example: language Important point: describing phenomena (e.g. as in linguistics) is not the same as modelling them with a mechanism linguists do one, neuroscientists the other and rarely the twain do meet! The problem: explaining phenomena generated by brain (complexity is the issue)

ICCS2004 — explaining the brain We need an integration of the phenomenal and mechanistic points of view that does not ignore questions of complexity e.g. computer programs, electronic circuits, machines, life what is special about these is the way they possess structured analyses Assume that the brain, is in some sense, similar. There exist complicated systems that we do (more or less) understand

ICCS2004 — explaining the brain Implicated here is the design issue, a point of contention in the neurosciences. The ‘neural constructivists’, seemingly ignorant of the way in which, in AI, General Problem Solver was superseded by Expert System, appear to ascribe, on the basis of generalisation from successes with comparatively simple skills, corresponding miraculous powers to general-purpose neural networks. But experiment suggests there is such a thing as ‘domain-relevant mechanisms’ (Karmiloff-Smith). The consideration they leave out (with apologies to President Clinton) is this: ‘It’s the efficiency question, stupid’

ICCS2004 — explaining the brain It would be curious indeed if the brain were (uniquely) not specifically designed to be good at the things it is good at, and had to learn everything from scratch instead. Now we begin the details... The design is hidden from immediate view: as with circuits and computer programs, when things get complicated “we cannot see the trees (functional components) for the wood (the entire system)”; but the design is there nevertheless and the effectiveness of the system crucially depends upon it.

ICCS2004 — explaining the brain Comment concerning design and implementation: In general, the physical device used in a mechanism (e.g. transistor, pump) is merely the means of realising the requirements of a design. Similarly, we assume that the nervous system is merely the means of realising a design: its status is secondary; it is just something for achieving what the design requires (comparatively basic information processing, and relationship learning, no magical powers).

ICCS2004 — explaining the brain Our understanding of a design is in terms of models, formal or informal. Models allow us to calculate, or estimate behaviour. We understand a mechanism in terms of a collection of models. Models model

ICCS2004 — explaining the brain level 3 level 1 level 2 p1 p2 p3 p4 p5 p6 p7 p n are propositions re the various systems: we infer from each level to the level above. Structured analysis/hierarchical inference

ICCS2004 — explaining the brain The inference difficulty Such an inference scheme is applicable with ordinary mechanisms. With the brain, the difficulty is that the model-based inferences we require cannot be built in: indeed, the higher levels only manifest through development. The problem is resolved through the Baas hyperstructure concept/observer mechanism. Baas distinguishes between the deducible emergence just discussed, and observational emergence.

ICCS2004 — explaining the brain Deducible emergence: we can infer the behaviour of a given system (e.g. system for driving walking) from that of its component subsystems: S1 S2 S5 system p1 p2 p5 properties

ICCS2004 — explaining the brain S1 S2 S5 system obser v ational emergence we now don’t have p1 p2 p5 (desired property) so we add an observer mechanism observe/analyse but instead: p1 p2 ~p5 (not p5) (inference failure)

ICCS2004 — explaining the brain observe/analyse S1 S2 S5 system In the Baas approach, the various subsystems don’t start off working together in a way associated with an inferential hierarchy. Instead, the behaviour of various combinations is observed and analysed, and adjustments are made in accord with the outcome of the analysis. This leads to the following progression:

ICCS2004 — explaining the brain p1 p2 p5 p1 p2 ~p5 (not p5) observer mechanism

ICCS2004 — explaining the brain Thus, piece by piece we might generate our hierarchy: But obviously this is too schematic! level 3 level 1 level 2 p1 p2 p3 p4 p5 p6 p7

ICCS2004 — explaining the brain The hierarchy portrayed is actually a collection of localised inferences interrelated by the conclusion of one being the premiss of another, but each individual proposition can apply to many systems. } p2{x i } (x i are parameters that can vary with time, and from system to system) propositions in hierarchy (contained within model) systems p1{x i }

ICCS2004 — explaining the brain These processes of construction keep going on, involving many kinds of systems, each kind governed by its own model. The systems run themselves in accord with the various models, gradually achieving higher levels of the hierarchical scheme. observe/analyse S1 S2 S5 system Note: Such constructions can involve abstract processes as well as physical ones.

ICCS2004 — explaining the brain With each skill, there is a specific ladder of development with the steps being levels in the hierarchy. Systems are established at one level and then used to form the next (e.g. rising to the vertical, standing in balance, taking a step, taking a number of steps), each transition being governed by its own model (similarly for steps in language, where there is a more complex structure).

ICCS2004 — explaining the brain Comment on top-down aspect We have described system generation in a bottom- up manner, but there is also a top-down aspect. There is no incompatibility here, any more than a photograph of an object taken from above is incompatible with one taken from below! The observer mechanism is responsible for endowing higher level systems with special properties in this case, making it useful to think of them as wholes (cf. computer programs).

ICCS2004 — explaining the brain Systems Models are defined within systems The inferences concerning models are made on the basis of the assumptions of the system Inferences may also be made concerning the effectiveness of any observer/analysis mechanisms The systems concerned may be of an abstract or concrete character

ICCS2004 — explaining the brain Abstract levels Cognition involves abstract activity as well as concrete (physical) actions. Physical actions are modelled by physical models, abstract activity by abstract models, whose significance will be discussed later.

ICCS2004 — explaining the brain The picture we have developed is highly abstract, and about as far removed from the real world as is the M- theory of the high-energy physics community (joke!). But, just as we flesh out the general proposition “life is based on chemistry” by finding out which molecules and chemical reactions do what, we can (hopefully) turn the present proposals into a realistic theory of brain and behaviour by filling in some details.

ICCS2004 — explaining the brain What details? Create a corresponding more formal specification Specify the systems and the observer mechanisms informally Investigate the neural implementation There is partial overlap between these aspects, but in this approach the neural aspects come late in the game rather than forming the starting point — the nervous system is seen as a resource, a means to an end. Integrate with the behavioural aspects

ICCS2004 — explaining the brain How the models work 1. They involve model of world + model of network (e.g. balance, edges in visual field) 2. The network model is ‘mathematised’, i.e. described in terms of signals and numbers 3. The models take into account the context- dependence of effective performance, in 2 ways: (a) using parameters (b) using distinct systems for significantly different situations

ICCS2004 — explaining the brain What the neural architecture does 1. does necessary computations on the basis of representational schemes 2. builds circuits in the ways dictated by models, i.e. so as to perform the necessary operations (consider the way electronic circuits are dictated by the requirement that their processes produce the desired outcome)

ICCS2004 — explaining the brain Different subsystems are highlighted in different contexts, to be ‘where the action is’ in the nervous system in that context. The relevance of context ordinary ground slippery ground Different circuits are built in different situations, and invoked again when the situations repeat.

ICCS2004 — explaining the brain Our whole approach stresses the importance of abstract systems and models in design. In this respect it is consistent with standard neuroscience, but conflicts with constructivist dogmas which hypothesise general learning abilities of neural networks. Unlike standard neuroscience, it has the capacity to cope with complexity, on the basis of the observer mechanism and its ability to construct hierarchies.

ICCS2004 — explaining the brain We now discuss the relevance of these ideas to two concepts discussed in the literature: (a) abstraction via ‘representational redescription’ (Karmiloff- Smith) (b) Jackendoff’s theories of language RR says basically that when we have developed a skill we ‘redescribe’ our successful behaviour, representing it by another mechanism. We learn to apply this new representation in various ways, affording a generality not available with the original mechanism, where behaviour tends to be frozen to preserve it.

ICCS2004 — explaining the brain The new feature of our approach is the idea that very specific, model-based, mechanisms (which should be accessible to developmental studies), underlie such processes. These models typically involve abstract relationships, such as membership of a class, or generalisation. AI algorithms, for which justification can in principle be given on logical or mathematical grounds, give some insight into what may be involved.

ICCS2004 — explaining the brain Now we come to language, which has been extensively studied by linguists, who have proposed many descriptive models. Jackendoff’s models are of particular interest as they do not extract a part such as syntax, and claim to get a proper account on that basis. The proposed approach offers the possibility of extending his ideas and integrating them into neuroscience.

ICCS2004 — explaining the brain proposed evolutionary steps

ICCS2004 — explaining the brain

Our approach, since it links together skills, models, and mechanisms, should have much to say about these details. What is going on in all of these processes is that various connections are being explored and exploited, all on the basis of models applicable to particular things in particular situations. e.g. ‘use of symbols to convey basic semantic relations.’ This is already an informal model, which can be refined into a formal model. Then can come circuit analysis, and finally linkage to the real nervous system.

ICCS2004 — explaining the brain Representational redescription and syntax At every stage, circuits are being constructed to accomplish particular things on the basis of particular models; each such circuit is used to do more things in more contexts at the next level. Syntactic structure can be viewed as the mechanism underlying a modification of representational redescription.

ICCS2004 — explaining the brain The basic formulation of RR states that after we have developed a skill we ‘redescribe’ our successful behaviour, representing it by another mechanism, and then learn to apply this new representation in various ways, affording a generality (power) not available with the original mechanism. Syntactic structures can be seen as derived structures offering ways of improving access to the semantic intent of a speaker. Specialised forms of observation and analysis are involved in developing a capacity.

ICCS2004 — explaining the brain It has been argued that models are the basis on which the nervous system is designed observer mechanisms make use of model-related behaviour to generate hierarchies On the basis of the picture described in this paper, the brain can be seen to ‘make sense’, and the neurosciences can now proceed to unravel the complexties of the brain in a way that has formerly been denied to workers in the field. Conclusion

ICCS2004 — explaining the brain How we might be able to Understand the Brain THE END