Intelligent Agents CMPT 463. Outline Agents and environments PEAS of task environment (Performance measure, Environment, Actuators, Sensors) Environment.

Slides:



Advertisements
Similar presentations
Chapter 2: Intelligent Agents
Advertisements

Additional Topics ARTIFICIAL INTELLIGENCE
Artificial Intelligent
Intelligent Agents Chapter 2.
Intelligent Agents Chapter 2.
Artificial Intelligence CS482, CS682, MW 1 – 2:15, SEM 201, MS 227 Prerequisites: 302, 365 Instructor: Sushil Louis,
Intelligent Agents Russell and Norvig: 2
ICS-171: 1 Intelligent Agents Chapter 2 ICS 171, Fall 2009.
Intelligent Agents Chapter 2. Outline Agents and environments Agents and environments Rationality Rationality PEAS (Performance measure, Environment,
Intelligent Agents CPS
January 11, 2006AI: Chapter 2: Intelligent Agents1 Artificial Intelligence Chapter 2: Intelligent Agents Michael Scherger Department of Computer Science.
Artificial Intelligence Intelligent Agents 1 Russell and Norvig, Ch. 2.
AI CSC361: Intelligent Agents1 Intelligent Agents -1 CSC361.
ICS-271: 1 Intelligent Agents Chapter 2 ICS 279 Fall 09.
© Copyright 2008 STI INNSBRUCK Intelligent Systems Intelligent Agents – Lecture 9 Prof. Dieter Fensel (& Francois.
CSCE 580 Artificial Intelligence Ch.2: Intelligent Agents
ICS-171: Notes 2: 1 Intelligent Agents Chapter 2 ICS 171, Fall 2005.
Intelligent Agents Chapter 2 ICS 171, Fall 2005.
Intelligent Agents Chapter 2.
Rutgers CS440, Fall 2003 Lecture 2: Intelligent Agents Reading: AIMA, Ch. 2.
Russell and Norvig: Chapter 2 CMSC421 – Fall 2006
ICS-171: Notes 2: 1 Intelligent Agents Chapter 2 ICS 171, spring 2007.
Rational Agents (Chapter 2)
Introduction to Logic Programming WS2004/A.Polleres 1 Introduction to Artificial Intelligence MSc WS 2009 Intelligent Agents: Chapter 2.
Rational Agents (Chapter 2)
Intelligent Agents Chapter 2. Outline Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types.
Intelligent Agents Chapter 2. Outline Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types.
CPSC 7373: Artificial Intelligence Jiang Bian, Fall 2012 University of Arkansas at Little Rock.
INTELLIGENT AGENTS Chapter 2 02/12/ Outline  Agents and environments  Rationality  PEAS (Performance measure, Environment, Actuators, Sensors)
MIDTERM REVIEW. Intelligent Agents Percept: the agent’s perceptual inputs at any given instant Percept Sequence: the complete history of everything the.
Artificial Intelligence
CHAPTER 2 Intelligent Agents. Outline Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types.
© Copyright 2008 STI INNSBRUCK Introduction to A rtificial I ntelligence MSc WS 2009 Intelligent Agents: Chapter.
Chapter 2 Intelligent Agents. Chapter 2 Intelligent Agents What is an agent ? An agent is anything that perceiving its environment through sensors and.
Intelligent Agents Chapter 2 Some slide credits to Hwee Tou Ng (Singapore)
Lection 3. Part 1 Chapter 2 of Russel S., Norvig P. Artificial Intelligence: Modern Approach.
Outline Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types Agent types Artificial Intelligence.
Intelligent Agents Chapter 2. CIS Intro to AI - Fall Outline  Brief Review  Agents and environments  Rationality  PEAS (Performance measure,
Chapter 2 Agents & Environments. © D. Weld, D. Fox 2 Outline Agents and environments Rationality PEAS specification Environment types Agent types.
Intelligent Agents Chapter 2. Outline Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types.
Intelligent Agents Chapter 2. Agents An agent is anything that can be viewed as perceiving its environment through sensors and acting upon that environment.
Chapter 2 Hande AKA. Outline Agents and Environments Rationality The Nature of Environments Agent Types.
CE An introduction to Artificial Intelligence CE Lecture 2: Intelligent Agents Ramin Halavati In which we discuss.
CS 8520: Artificial Intelligence Intelligent Agents Paula Matuszek Fall, 2008 Slides based on Hwee Tou Ng, aima.eecs.berkeley.edu/slides-ppt, which are.
CHAPTER 2 Intelligent Agents. Outline Artificial Intelligence a modern approach 2 Agents and environments Rationality PEAS (Performance measure, Environment,
Intelligent Agents Chapter 2. Outline Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types.
Dr. Alaa Sagheer Chapter 2 Artificial Intelligence Ch2: Intelligent Agents Dr. Alaa Sagheer.
Intelligent Agents Chapter 2. Outline Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types.
Intelligent Agents Chapter 2. Outline Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types.
1/23 Intelligent Agents Chapter 2 Modified by Vali Derhami.
Intelligent Agents Introduction Rationality Nature of the Environment Structure of Agents Summary.
CSC 9010 Spring Paula Matuszek Intelligent Agents Overview Slides based in part on Hwee Tou Ng, aima.eecs.berkeley.edu/slides-ppt, which are in turn.
Intelligent Agents Chapter 2 Dewi Liliana. Outline Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment.
CPSC 420 – Artificial Intelligence Texas A & M University Lecture 2 Lecturer: Laurie webster II, M.S.S.E., M.S.E.e., M.S.BME, Ph.D., P.E.
Intelligent Agents. Outline Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types Agent types.
1 CSC AI Intelligent Agents. Outline Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment.
CSC AI Intelligent Agents.
EA C461 – Artificial Intelligence Intelligent Agents
Artificial Intelligence Lecture No. 5
Intelligent Agents Chapter 2.
Intelligent Agents Chapter 2.
Hong Cheng SEG4560 Computational Intelligence for Decision Making Chapter 2: Intelligent Agents Hong Cheng
Intelligent Agents Chapter 2.
Intelligent Agents Chapter 2.
Intelligent Agents Chapter 2.
EA C461 – Artificial Intelligence Intelligent Agents
Artificial Intelligence
Intelligent Agents Chapter 2.
Intelligent Agents Chapter 2.
Presentation transcript:

Intelligent Agents CMPT 463

Outline Agents and environments PEAS of task environment (Performance measure, Environment, Actuators, Sensors) Environment types Agent types

Agents An AI program = An intelligent Agent An agent is anything that can be viewed as perceiving its environment though sensors and acting upon that environment though actuators. Perception-Action Cycle

Application of Intelligent Agents AI has successfully been used in o Finance? o Robotics? o Games? o Medicine? o The Web?

AI in Finance Stock Market Bonds Commodities Market Trading Agent Rates Online News Trades (Buy/Sell)

AI in Robotics Physical actuators Environment Robot Cameras, microphones, infrared range finders Touch Motors: wheels, legs, arms, grippers Voice

AI in Games Chess game Characters in games You Game Agent Your moves Its own moves

AI in Medicine You Diagnostic Agent Vital Signals: blood pressures, heart signals Diagnostics Doctor

Simple Diagnostic Expert System: tools/search-by-symptom.html tools/search-by-symptom.html

AI and the Web Search engines World Wide Web CrawlerRetrieve Web Pages through programs DB You Query List of hits

Percept : the agent’s perceptual inputs at any given instant Percept Sequence : the complete history of everything the agent has ever perceived The agent function maps from percept histories to actions: [f: P*  A ] (abstract) The agent program runs on the physical architecture to produce f. (implementation)

Vacuum-Cleaner World Percepts: location and contents, e.g., [A, Dirty] Actions: Left, Right, Suck, NoOp

Agent Function Percept sequenceAction [A, Clean]Right [A, Dirty]Suck [B, Clean]Left [B, Dirty]Suck [A, Clean] Right [A, Clean] [A, Dirty]Suck …… [A, Clean] [A, Clean] [A, Clean]Right [A, Clean] [A, Clean] [A, Dirty]Suck …… Can it be implemented in a small program?

A Vacuum-Cleaner Agent function REFLEX-VACUUM-AGENT ([location,status]) returns an action if status = Dirty then return Suck else if location = A then return Right else if location = B then return Left

Good Behavior and Rationality Rational Agent – an agent that does the “right” thing for each possible percept sequence, a rational agent should select an action that is expected to maximize its performance measure, given the evidence provided by the percept sequence and what ever built- in knowledge the agent has.

Task Environment To design a rational agent we must specify its task environment. PEAS description of the environment: o P erformance measure o E nvironment o A ctuators o S ensors

PEAS Example Consider the task of designing an automated taxi: Performance measure : safety, destination, profits, legality, comfort… Environment : US streets/freeways, traffic, pedestrians, weather… Actuators : steering, accelerator, brake, horn, speaker/display… Sensors : camera, sonar, GPS, odometer, engine sensor…

PEAS Example Agent: Part-picking robot Performance measure: o Percentage of parts in correct bins Environment: o Conveyor belt with parts, bins Actuators: o Jointed arm and hand Sensors: o Camera, joint angle sensors

Internet Shopping Agent Performance measure? o price, quality, appropriateness, efficiency Environment? o WWW sites, vendors, shippers Actuators? o display to user, follow URL, fill in form Sensors? o HTML pages (text, graphics, scripts)

Environment Types Fully observable (vs. partially observable): An agent’s sensors give it access to the complete state of the environment at each point in time. o An environment is full observable when the sensors can detect all aspects that are relevant to the choice of action. o Set game vs. poker (needs internal memory)

Environment Types Deterministic (vs. stochastic): The next state of the environment is completely determined by the current state and the action executed by the agent. o Chess vs. game with dice (uncertainty, unpredictable) o An environment is uncertain if it is not fully observable or not deterministic.

Environment Types Episodic (vs. sequential): The agent’s experience is divided into atomic “episodes” (each episode consists of the agent perceiving and then performing a single action), and the choice of action in each episode depends only on the episode itself. o In sequential environments, the current decision could affect all future decisions. o Vacuum cleaner and part-picking robot o Chess and taxi driving

Environment Types Single agent (vs. multiagent): An agent operating by itself in an environment. o Crossword puzzle vs. chess

Environment Types Static (vs. dynamic): The environment is unchanged while an agent is deliberating. (The environment is semidynamic if the environment itself does not change with the passage of time but the agent’s performance score does.) o Taxi driving vs. chess (when played with a clock) vs. crossword puzzles

Environment Types Discrete (vs. continuous): A limited number of distinct, clearly defined state of the environment, percepts and actions. o Chess vs. taxi driving (infinite: speed and location are continuous values)

SolitaireChess with a clock BackgammonTaxiVacuum Cleaner Observable? Deterministic? Episodic? Static? Discrete? Single-agent?

SolitaireChess with a clock BackgammonTaxiVacuum Cleaner Observable?NoYes NoYes Deterministic? Episodic? Static? Discrete? Single-agent?

SolitaireChess with a clock BackgammonTaxiVacuum Cleaner Observable?NoYes NoYes Deterministic?Yes No Yes Episodic? Static? Discrete? Single-agent?

SolitaireChess with a clock BackgammonTaxiVacuum Cleaner Observable?NoYes NoYes Deterministic?Yes No Yes Episodic?No Yes Static? Discrete? Single-agent?

SolitaireChess with a clock BackgammonTaxiVacuum Cleaner Observable?NoYes NoYes Deterministic?Yes No Yes Episodic?No Yes Static?YesSemiYesNoYes Discrete? Single-agent?

SolitaireChess with a clock BackgammonTaxiVacuum Cleaner Observable?NoYes NoYes Deterministic?Yes No Yes Episodic?No Yes Static?YesSemiYesNoYes Discrete?Yes NoYes Single-agent?

SolitaireChess with a clock BackgammonTaxiVacuum Cleaner Observable?NoYes NoYes Deterministic?Yes No Yes Episodic?No Yes Static?YesSemiYesNoYes Discrete?Yes NoYes Single-agent?YesNo Yes

Environment Types The simplest environment is o Fully observable, deterministic, episodic, static, discrete and single-agent. Most real situations are o partially observable, stochastic, sequential, dynamic, continuous, multi-agent.

The Structure of Agents How does the inside of the agent work? o Agent = Architecture + Program Basic algorithm for a rational agent oWhile (true) do Get percept from sensors into memory Determine best action based on memory Record action in memory Perform action Most AI programs are a variation of this theme

Agent Types Function TABLE-DRIVEN_AGENT(percept) returns an action static: percepts, a sequence initially empty table, a table of actions, indexed by percept sequence append percept to the end of percepts action  LOOKUP(percepts, table) return action Drawbacks: Huge table Take a long time to build the table This approach is doomed to failure

Agent Types Four basic types: - simple reflex agents - model-based reflex agents - goal-based agents - utility-based agents

Simple Reflex Agents Select action on the basis of only the current percept. o E.g. the vacuum- agent Large reduction in possible percept/action situations(next page). Implemented through condition-action rules o If dirty then suck

The vacuum-cleaner world function REFLEX-VACUUM-AGENT ([location,status]) returns an action if status = Dirty then return Suck else if location = A then return Right else if location = B then return Left

The Structure of Agents Simple Reflex Agent function Simple-Reflex-Agent (percept) return action static:rules, a set of condition-action rules state <- INTERPRET-INPUT( percept ) rule <- RULE-MATCH( state, rules ) action <- RULE-ACTION[ rule ] return action

Model-Based Reflex Agents To tackle partially observable environments. o Maintain internal state Over time update state using world knowledge o How does the world change. o How do actions affect world.  Model of World

The Structure of Agents Reflex Agent With State function Reflex-Agent-With-State (percept) return action static: state, a description of the current world state rules, a set of condition-action rules action, the most recent action, initially none state <- UPDATE-STATE( state, action, percept ) rule <- RULE-MATCH( state, rules ) action <- RULE-ACTION[ rule ] return action

Goal-Based Agents The agent needs a goal to know which situations are desirable. Typically investigated in search and planning research. Major difference: future is taken into account

Utility-Based Agents Certain goals can be reached in different ways. o Some are better, have a higher utility. Utility function maps a (sequence of) state(s) onto a real number.

Summary An agent perceives and acts in an environment, has an architecture, and is implemented by an agent program. Task environment – PEAS (P erformance, E nvironment, A ctuators, S ensors ) An ideal agent always chooses the action which maximizes its expected performance, given its percept sequence so far. An agent program maps from percept to action and updates internal state. o Reflex agents respond immediately to percepts. simple reflex agents model-based reflex agents o Goal-based agents act in order to achieve their goal(s). o Utility-based agents maximize their own utility function.

Try out some intelligent agents! A Chatbot is a computer program designed to simulate an intelligent conversation with one or more human users via auditory or textual methods, primarily for engaging in small talk. ALICE : o Won the Loebner Prize three times (in 2000, 2001 and 2004) ELIZA : o One of the classic chat bots, written at MIT by Joseph Weizenbaum between 1964 and 1966