© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-1 Chapter 11 Knowledge Acquisition,

Slides:



Advertisements
Similar presentations
Modelling with expert systems. Expert systems Modelling with expert systems Coaching modelling with expert systems Advantages and limitations of modelling.
Advertisements

CHAPTER 13 Inference Techniques. Reasoning in Artificial Intelligence n Knowledge must be processed (reasoned with) n Computer program accesses knowledge.
Rulebase Expert System and Uncertainty. Rule-based ES Rules as a knowledge representation technique Type of rules :- relation, recommendation, directive,
© 2005 by Prentice Hall Appendix 2 Automated Tools for Systems Development Modern Systems Analysis and Design Fourth Edition Jeffrey A. Hoffer Joey F.
© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 10-1 Chapter 10 Intelligent Decision Support.
Chapter 11 Artificial Intelligence and Expert Systems.
Artificial Intelligence
Knowledge Acquisition. Knowledge Aquisition Definition – The process of acquiring, organising, & studying knowledge. Identified by many researchers and.
Marakas: Decision Support Systems, 2nd Edition © 2003, Prentice-Hall Chapter Chapter 7: Expert Systems and Artificial Intelligence Decision Support.
© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 4-1 Chapter 4 Modeling and Analysis Turban,
Building Knowledge-Driven DSS and Mining Data
Business Driven Technology Unit 3 Streamlining Business Operations Copyright © 2015 McGraw-Hill Education. All rights reserved. No reproduction or distribution.
DASHBOARDS Dashboard provides the managers with exactly the information they need in the correct format at the correct time. BI systems are the foundation.
© 2005 by Prentice Hall Appendix 2 Automated Tools for Systems Development Modern Systems Analysis and Design Fourth Edition Jeffrey A. Hoffer Joey F.
Sepandar Sepehr McMaster University November 2008
Expert Systems.
CHAPTER 12 ADVANCED INTELLIGENT SYSTEMS © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang.
Chapter 9 Database Planning, Design, and Administration Sungchul Hong.
Overview of the Database Development Process
Data Management Turban, Aronson, and Liang Decision Support Systems and Intelligent Systems, Seventh Edition.
Ihr Logo Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization Turban, Aronson, and Liang.
Knowledge Acquisition. Concepts of Knowledge Engineering Knowledge engineering The engineering discipline in which knowledge is integrated into computer.
Business Analysis and Essential Competencies
13: Inference Techniques
Chapter 6 Supplement Knowledge Engineering and Acquisition Chapter 6 Supplement.
Revision. Mintzberg’s 10 Management Roles Interpersonal – Figurehead : symbolic head – Leader : Responsible for the motivation and activation of subordinates;
 Knowledge Acquisition  Machine Learning. The transfer and transformation of potential problem solving expertise from some knowledge source to a program.
11 C H A P T E R Artificial Intelligence and Expert Systems.
Copyright R. Weber INFO 629 Concepts in Artificial Intelligence Expert Systems Fall 2004 Professor: Dr. Rosina Weber.
Explanation Facility دكترمحسن كاهاني
© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-1 Chapter 11 Knowledge Acquisition,
School of Computer Science and Technology, Tianjin University
Chapter 10 Information Systems Analysis and Design
© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 5-1 Chapter 5 Business Intelligence: Data.
1 CHAPTER 13 Decision Support Systems and Intelligent Systems, Efraim Turban and Jay E. Aronson 6th ed, Copyright 2001, Prentice Hall, Upper Saddle River,
1 Introduction to Software Engineering Lecture 1.
Ihr Logo Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization Turban, Aronson, and Liang.
Knowledge Acquisition, Representation, and Reasoning By Dr.S.Sridhar,Ph.D., RACI(Paris),RZFM(Germany),RMR(USA),RIEEEProc.
 Dr. Syed Noman Hasany 1.  Review of known methodologies  Analysis of software requirements  Real-time software  Software cost, quality, testing.
Chapter 13 Artificial Intelligence and Expert Systems.
CS62S: Expert Systems Requirements Specification and Design Based on Chap. 12: The Engineering of Knowledge-based Systems: Theory and Practice, A. J. Gonzalez.
Chapter 5: Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization DECISION SUPPORT SYSTEMS AND BUSINESS.
© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 12-1 Chapter 12 Advanced Intelligent Systems.
Chapter 4 Decision Support System & Artificial Intelligence.
Week 8 MSE614 – SP 08 Ileana Costea. HW Questions on KA Due today, Week 8 Assigned last session, Week 7 A few verbal questions (see Transparency)
KNOWLEDGE ACQUISITION, REPRESENTATION, AND REASONING
11-1 Chapter 11 Expert system architecture, representation of knowledge, Knowledge Acquisition, and Reasoning Turban, Aronson, and Liang Decision Support.
1 CHAPTER 11 Knowledge Acquisition and Validation Decision Support Systems and Intelligent Systems, Efraim Turban and Jay E. Aronson 6th ed, Copyright.
Of An Expert System.  Introduction  What is AI?  Intelligent in Human & Machine? What is Expert System? How are Expert System used? Elements of ES.
Artificial Intelligence
ITEC 1010 Information and Organizations Chapter V Expert Systems.
 Knowledge Acquisition  Machine Learning. The transfer and transformation of potential problem solving expertise from some knowledge source to a program.
© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 6-1 Chapter 6 Decision Support System Development.
1 Knowledge Acquisition, Representation and Organization Dr. Jeffrey M. Sta. Ines.
Decision Support and Business Intelligence Systems (9 th Ed., Prentice Hall) Chapter 12: Artificial Intelligence and Expert Systems.
Knowledge Representation. A knowledge base can be organised in several different configurations to facilitate fast inferencing Knowledge Representation.
Chapter 11 Knowledge Acquisition, Representation, and Reasoning
Knowledge Representation Techniques
Intelligent Systems Development
Architecture Components
MANAGING KNOWLEDGE FOR THE DIGITAL FIRM
Intro to Expert Systems Paula Matuszek CSC 8750, Fall, 2004
Chapter 12 Advanced Intelligent Systems
Chapter 1 Management Support Systems: An Overview
Chapter 11 Expert system architecture, representation of knowledge, Knowledge Acquisition, and Reasoning.
Chapter 1 Management Support Systems: An Overview
전문가 시스템(Expert Systems)
Modeling and Analysis Tutorial
Chapter 12 Analyzing Semistructured Decision Support Systems
Chapter 1 Management Support Systems: An Overview
Presentation transcript:

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-1 Chapter 11 Knowledge Acquisition, Representation, and Reasoning Turban, Aronson, and Liang Decision Support Systems and Intelligent Systems, Seventh Edition

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-2 Learning Objectives Understand the nature of knowledge. Learn the knowledge engineering processes. Evaluate different approaches for knowledge acquisition. Examine the pros and cons of different approaches. Illustrate methods for knowledge verification and validation. Examine inference strategies. Understand certainty and uncertainty processing.

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-3 Development of a Real-Time Knowledge-Based System at Eli Lilly Vignette Problems with fermentation process –Quality parameters difficult to control –Many different employees doing same task –High turnover Expert system used to capture knowledge –Expertise available 24 hours a day Knowledge engineers developed system by: –Knowledge elicitation Interviewing experts and creating knowledge bases –Knowledge fusion Fusing individual knowledge bases –Coding knowledge base –Testing and evaluation of system

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-4 Knowledge Engineering Process of acquiring knowledge from experts and building knowledge base –Narrow perspective Knowledge acquisition, representation, validation, inference, maintenance –Broad perspective Process of developing and maintaining intelligent system

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Knowledge Engineering Process Acquisition of knowledge –General knowledge or metaknowledge –From experts, books, documents, sensors, files Knowledge representation –Organized knowledge Knowledge validation and verification Inferences –Software designed to make inferences based on knowledge to non expert. Explanation and justification capabilities

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-6

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-7 Knowledge Sources –Documented Written, viewed, sensory, behavior –Undocumented Memory –Acquired from Human senses Machines ( dbases, Via Internet)

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-8 Levels of Knowledge –Shallow: IF gasoline tank is empty, THEN car will not start. Surface level to deal with very specific situation Input-output If – Then rules Insufficient in describing complex situation –Deep : Investigate deeper the relation between lack of gasoline and car won’t start. Human Problem solving Difficult to collect, validate Interactions between system components

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-9 Categories of Knowledge –Declarative Descriptive representation that tells facts –Procedural How things work under different circumstances How to use declarative knowledge –Problem solving step-by-step –Metaknowledge Knowledge about knowledge. About the operation of Knowledge-based sys. About their reasoning capabilities.

11.4 Methods of Knowledge acquisition from experts The roles of important participants: 1.Knowledge Eng. Knowledge structuring, tool designer, catalyst between expert and end-user. 1.The Expert. 1.The End-User © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-10

Difficulties in Know. Eng. Acquiring knowledge from expert is not an easy task. Experts in ability to articulate their knowledge. Experts lack of time or unwilling to cooperate. Testing and refining know. Is complicated. Poor definition of knowledge elicitation. Collecting know. From one source. Problematic interpersonal comm. Factors. © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-11

Know. Eng. Skills Know. Eng. are human professionals who are able to comm. with experts & consolidate knowledge fro various sources to build a valid Knowledge-Base. Computer skills. Tolerance and ambivalence (Unsure) Effective Comm. abilities (Sensitive, Tactful, Diplomatic) Broad educational background. Advanced socially sophisticated social skills. Fast-Learning capabilities. Wide experience in Knowledge Engineering. Empathy, patience. Logical thinking., Persistence Versatility and inventiveness Self-Confidence. © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-12

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Knowledge Engineers Professionals who elicit knowledge from experts –Empathetic, patient –Broad range of understanding, capabilities Integrate knowledge from various sources –Creates and edits code –Operates tools Build knowledge base –Validates information –Trains users

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-14

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Elicitation Methods Manual –Based on interview –Track reasoning process –Observation Semiautomatic –Build base with minimal help from knowledge engineer –Allows execution of routine tasks with minimal expert input Automatic –Minimal input from both expert and knowledge engineer

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Manual Methods Interviews –Structured Goal-oriented Walk through –Unstructured Complex domains Data unrelated and difficult to integrate –Semistructured

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Manual Methods Process tracking –Track reasoning processes Protocol analysis –Document expert’s decision-making –Think aloud process Observation –Motor movements –Eye movements

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Manual Methods Case analysis Critical incident User discussions Expert commentary Graphs and conceptual models Brainstorming Prototyping Multidimensional scaling for distance matrix Clustering of elements Iterative performance review

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Semiautomatic Methods Repertory grid analysis –Personal construct theory Organized, perceptual model of expert’s knowledge Expert identifies domain objects and their attributes Expert determines characteristics and opposites for each attribute Expert distinguishes between objects, creating a grid Expert transfer system –Computer program that elicits information from experts –Rapid prototyping –Used to determine sufficiency of available knowledge

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-20

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Semiautomatic Methods, continued Computer based tools features: –Ability to add knowledge to base –Ability to assess, refine knowledge –Visual modeling for construction of domain –Creation of decision trees and rules –Ability to analyze information flows –Integration tools

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Automatic Methods Data mining by computers Inductive learning from existing recognized cases Neural computing mimicking human brain Genetic algorithms using natural selection

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Multiple Experts Scenarios –Experts contribute individually –Primary expert’s information reviewed by secondary experts –Small group decision –Panels for verification and validation Approaches –Consensus methods –Analytic approaches –Automation of process through software usage –Decomposition

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Automated Knowledge Acquisition Induction –Activities Training set with known outcomes Creates rules for examples Assesses new cases –Advantages Limited application Builder can be expert –Saves time, money

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Automated Knowledge Acquisition –Difficulties Rules may be difficult to understand Experts needed to select attributes Algorithm-based search process produces fewer questions Rule-based classification problems Allows few attributes Many examples needed Examples must be cleansed Limited to certainties Examples may be insufficient

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Automated Knowledge Acquisition Interactive induction –Incrementally induced knowledge General models –Object Network –Based on interaction with expert interviews –Computer supported Induction tables IF-THEN-ELSE rules

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Evaluation, Validation, Verification Dynamic activities –Evaluation Assess system’s overall value –Validation Compares system’s performance to expert’s Concordance and differences –Verification Building and implementing system correctly Can be automated

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-28

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Production Rules IF-THEN Independent part, combined with other pieces, to produce better result Model of human behavior Examples –IF condition, THEN conclusion –Conclusion, IF condition –If condition, THEN conclusion1 (OR) ELSE conclusion2

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Artificial Intelligence Rules Types –Knowledge rules Declares facts and relationships Stored in knowledge base –Inference Given facts, advises how to proceed Part of inference engines Metarules

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Artificial Intelligence Rules Advantages –Easy to understand, modify, maintain –Explanations are easy to get. –Rules are independent. –Modification and maintenance are relatively easy. –Uncertainty is easily combined with rules. Limitations –Huge numbers may be required –Designers may force knowledge into rule-based entities –Systems may have search limitations; difficulties in evaluation

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Semantic Networks Graphical depictions Nodes and links Hierarchical relationships between concepts Reflects inheritance

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Frames All knowledge about object Hierarchical structure allows for inheritance Allows for diagnosis of knowledge independence Object-oriented programming –Knowledge organized by characteristics and attributes Slots Subslots/facets –Parents are general attributes –Instantiated to children Often combined with production rules

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Knowledge Relationship Representations Decision tables –Spreadsheet format –All possible attributes compared to conclusions Decision trees –Nodes and links –Knowledge diagramming Computational logic –Propositional True/false statement –Predicate logic Variable functions applied to components of statements

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 11-35

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Reasoning Programs Inference Engine –Algorithms –Directs search of knowledge base Forward chaining –Data driven –Start with information, draw conclusions Backward chaining –Goal driven –Start with expectations, seek supporting evidence –Inference/goal tree Schematic view of inference process –AND/OR/NOT nodes –Answers why and how Rule interpreter

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Explanation Facility Justifier –Makes system more understandable –Exposes shortcomings –Explains situations that the user did not anticipate –Satisfies user’s psychological and social needs –Clarifies underlying assumptions –Conducts sensitivity analysis Types –Why –How –Journalism based Who, what, where, when, why, how Why not

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Generating Explanations Static explanation –Preinsertion of text Dynamic explanation –Reconstruction by rule evaluation Tracing records or line of reasoning Justification based on empirical associations Strategic use of metaknowledge

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Uncertainty Widespread Important component Representation –Numeric scale 1 to 100 –Graphical presentation Bars, pie charts –Symbolic scales Very likely to very unlikely

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Uncertainty Probability Ratio –Degree of confidence in conclusion –Chance of occurrence of event Bayes Theory –Subjective probability for propositions Imprecise Combines values Dempster-Shafer –Belief functions –Creates boundaries for assignments of probabilities Assumes statistical independence

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Certainty Certainty factors –Belief in event based on evidence –Belief and disbelief independent and not combinable –Certainty factors may be combined into one rule –Rules may be combined

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Expert System Development Phases –Project initialization –Systems analysis and design –Prototyping –System development –Implementation –Postimplementation

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Project Initialization Identify problems Determine functional requirements Evaluate solutions Verify and justify requirements Conduct feasibility study and cost-benefit analysis Determine management issues Select team Project approval

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Systems Analysis and Design Create conceptual system design Determine development strategy –In house, outsource, mixed Determine knowledge sources Obtain cooperation of experts Select development environment –Expert system shells –Programming languages –Hybrids with tools General or domain specific shells Domain specific tools

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Prototyping Rapid production Demonstration prototype –Small system or part of system –Iterative –Each iteration tested by users –Additional rules applied to later iterations

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang System Development Development strategies formalized Knowledge base developed Interfaces created System evaluated and improved

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Implementation Adoption strategies formulated System installed All parts of system must be fully documented and security mechanisms employed Field testing if it stands alone; otherwise, must be integrated User approval

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Postimplementation Operation of system Maintenance plans –Review, revision of rules –Data integrity checks –Linking to databases Upgrading and expansion Periodic evaluation and testing

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang Internet Facilitates knowledge acquisition and distribution Problems with use of informal knowledge Open knowledge source