COMP14112 : Artificial Intelligence Fundamentals L ecture 0 –Very Brief Overview Lecturer: Xiao-Jun Zeng

Slides:



Advertisements
Similar presentations
CS433: Modeling and Simulation
Advertisements

Week 21 Basic Set Theory A set is a collection of elements. Use capital letters, A, B, C to denotes sets and small letters a 1, a 2, … to denote the elements.
1 Counting. 2 Situations where counting techniques are used  You toss a pair of dice in a casino game. You win if the numbers showing face up have a.
AI – CS364 Uncertainty Management Introduction to Uncertainty Management 21 st September 2006 Dr Bogdan L. Vrusias
SA-1 Probabilistic Robotics Probabilistic Sensor Models Beam-based Scan-based Landmarks.
Thurs., March 4, 1999 n Homework 2 due n Handout Homework 3 (Due Thurs., March 18) n Turing Test n Multivariate Logic and Event Spaces n Week 8: Subjective.
Ordering and Consistent Cuts Presented By Biswanath Panda.
Vector Spaces (10/27/04) The spaces R n which we have been studying are examples of mathematical objects which have addition and scalar multiplication.
Chapter 4 Probability.
Stats Probability Theory.
2-1 Sample Spaces and Events Conducting an experiment, in day-to-day repetitions of the measurement the results can differ slightly because of small.
© 2016 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part, except for use as permitted in a license.
COMP14112: Artificial Intelligence Fundamentals L ecture 3 - Foundations of Probabilistic Reasoning Lecturer: Xiao-Jun Zeng
Chapter 1 Basics of Probability.
Fuzzy Logic. Lecture Outline Fuzzy Systems Fuzzy Sets Membership Functions Fuzzy Operators Fuzzy Set Characteristics Fuzziness and Probability.
Theory of Probability Statistics for Business and Economics.
Nor Fashihah Mohd Noor Institut Matematik Kejuruteraan Universiti Malaysia Perlis ІМ ќ INSTITUT MATEMATIK K E J U R U T E R A A N U N I M A P.
Simultaneous Localization and Mapping Presented by Lihan He Apr. 21, 2006.
KINEMATICS ANALYSIS OF ROBOTS (Part 2)
Probability and Independence 1 Krishna.V.Palem Kenneth and Audrey Kennedy Professor of Computing Department of Computer Science, Rice University.
Ch.3 PROBABILITY Prepared by: M.S Nurzaman, S.E, MIDEc. ( deden )‏
LECTURE 15 THURSDAY, 15 OCTOBER STA 291 Fall
Introduction to Probability  Probability is a numerical measure of the likelihood that an event will occur.  Probability values are always assigned on.
1 1 Slide © 2016 Cengage Learning. All Rights Reserved. Probability is a numerical measure of the likelihood Probability is a numerical measure of the.
Chapter 4 Probability ©. Sample Space sample space.S The possible outcomes of a random experiment are called the basic outcomes, and the set of all basic.
Week 11 What is Probability? Quantification of uncertainty. Mathematical model for things that occur randomly. Random – not haphazard, don’t know what.
Computing & Information Sciences Kansas State University Wednesday, 25 Oct 2006CIS 490 / 730: Artificial Intelligence Lecture 26 of 42 Wednesday. 25 October.
1 Set Theory Foundation of Relational Database Systems E.F. Codd.
Dr. Ahmed Abdelwahab Introduction for EE420. Probability Theory Probability theory is rooted in phenomena that can be modeled by an experiment with an.
Lecture V Probability theory. Lecture questions Classical definition of probability Frequency probability Discrete variable and probability distribution.
Copyright © Cengage Learning. All rights reserved.
BIOSTAT 3 Three tradition views of probabilities: Classical approach: make certain assumptions (such as equally likely, independence) about situation.
1 3. Random Variables Let ( , F, P) be a probability model for an experiment, and X a function that maps every to a unique point the set of real numbers.
Probability is a measure of the likelihood of a random phenomenon or chance behavior. Probability describes the long-term proportion with which a certain.
PROBABILITY, PROBABILITY RULES, AND CONDITIONAL PROBABILITY
Uncertainty ECE457 Applied Artificial Intelligence Spring 2007 Lecture #8.
Discrete Structures By: Tony Thi By: Tony Thi Aaron Morales Aaron Morales CS 490 CS 490.
Instructional Objective  Define an agent  Define an Intelligent agent  Define a Rational agent  Discuss different types of environment  Explain classes.
EMIS 7300 SYSTEMS ANALYSIS METHODS Spring 2006 Dr. John Lipp Copyright © Dr. John Lipp.
Basic Definitions of Set Theory Lecture 23 Section 5.1 Wed, Mar 8, 2006.
Lecture 7 Dustin Lueker. 2STA 291 Fall 2009 Lecture 7.
Probabilistic Robotics Introduction.  Robotics is the science of perceiving and manipulating the physical world through computer-controlled devices.
Lecture 6 Dustin Lueker.  Standardized measure of variation ◦ Idea  A standard deviation of 10 may indicate great variability or small variability,
+ Chapter 5 Overview 5.1 Introducing Probability 5.2 Combining Events 5.3 Conditional Probability 5.4 Counting Methods 1.
UNIVERSITY OF SOUTH CAROLINA Department of Computer Science and Engineering Introduction to Probability (CSCE 317) January 21, 2016 Marco Valtorta SWRG.
Basic probability Sep. 16, Introduction Our formal study of probability will base on Set theory Axiomatic approach (base for all our further studies.
Basic Concepts of Information Theory A measure of uncertainty. Entropy. 1.
2.5 Additive Rules: Theorem 2.10: If A and B are any two events, then: P(A  B)= P(A) + P(B)  P(A  B) Corollary 1: If A and B are mutually exclusive.
Module #1 - Logic 1 Based on Rosen, Discrete Mathematics & Its Applications. Prepared by (c) , Michael P. Frank and Modified By Mingwu Chen Probability.
CS 3630 Database Design and Implementation. 2 Set Theory Foundation of Relational Database Systems E.F. Codd.
Lecture 2 Probability By Aziza Munir. Summary of last lecture Why QBA What is a model? Why to develop a model Types of models Flow chart of transformation.
Probabilistic Robotics Introduction. SA-1 2 Introduction  Robotics is the science of perceiving and manipulating the physical world through computer-controlled.
Basic Probability. Introduction Our formal study of probability will base on Set theory Axiomatic approach (base for all our further studies of probability)
Onur DOĞAN.  The Classical Interpretation of Probability  The Frequency Interpretation of Probability  The Subjective Interpretation of Probability.
Computing & Information Sciences Kansas State University Wednesday, 25 Oct 2006CIS 490 / 730: Artificial Intelligence Lecture 26 of 42 Wednesday. 25 October.
STATISTICS AND PROBABILITY IN CIVIL ENGINEERING
CHAPTER 2 RANDOM VARIABLES.
CS 3630 Database Design and Implementation
Module #16: Probability Theory
STA 291 Spring 2008 Lecture 6 Dustin Lueker.
CS 188: Artificial Intelligence Fall 2008
CS 188: Artificial Intelligence Fall 2007
Module #16: Probability Theory
3. Random Variables Let (, F, P) be a probability model for an experiment, and X a function that maps every to a unique point.
Sets and Probabilistic Models
Sets and Probabilistic Models
Experiments, Outcomes, Events and Random Variables: A Revisit
Sets and Probabilistic Models
Module #16: Probability Theory
Sets and Probabilistic Models
Presentation transcript:

COMP14112 : Artificial Intelligence Fundamentals L ecture 0 –Very Brief Overview Lecturer: Xiao-Jun Zeng

1 Overview This course will focus mainly on probabilistic methods in AI –We shall present probability theory as a general theory of reasoning –We shall develop (recapitulate) the mathematical details of that theory –We shall investigate two applications of that probability theory in AI which rely on these mathematical details: Robot localization Speech recognition

2 Structure of this course Part One -The first 4 weeks + week 10 WeekLectureExamples classLaboratory exercise 1Robot localization I 2Robot localization IIProbability I 3Foundations of probability Probability II1.1 Robot localization I 4Brief history of AIProbability III 5……Turing’s paper1.2D Robot localization II …..……….. 10Part 1 RevisionRevision

COMP14112 : Artificial Intelligence Fundamentals L ecture 1 - Probabilistic Robot Localization I

4 Probabilistic Robot Localization I Outline Background Introduction of probability Definition of probability distribution Properties of probability distribution Robot localization problem

5 Background Consider a mobile robot operating in a relatively static (hence, known) environment cluttered with obstacles.

6 Background The robot is equipped with (noisy) sensors and (unreliable) actuators, enabling it to perceive its environment and move around within it. We consider perhaps the most basic question in mobile robotics: how does the robot know where it is? This is a classic case of reasoning under uncertainty: almost none of the information the robot has about its position (its sensor reports and the actions it has tried to execute) yield certain information. The theory we shall use to manage this uncertainty is probability theory.

7 Introduction of Probability Sample space –Definition. The sample space,, is the set of all possible outcomes of an experiment. –Example. Assume that the experiment is to check the exam marks of students in the school of CS, then the sample space is In the following, let M(s) represents the exam mark for student s and be a natural number in [0, 100], we define

8 Introduction of Probability Event: –Definition. An event, E, is any subset of the sample space. –Examples Event 1={40}, i.e., the set of all students with 40% mark Event 2={≥40}, i.e., the set of all students who have passed

9 Definition of probability distribution Probability distribution –Definition. Given sample space, a probability distribution is a function which assigns a real number in [0,1] for each event in and satisfies (i) (K1) (ii) If (i.e., if and are mutually exclusive ), then (K2) where means ; means. –Example. Let as the percentage of students whose marks are in, then is a probability distribution on.

10 Definition of Probability Distribution Some notes on probability distribution –For an event E, we refer to p(E) as the probability of E –Think of p(E) as representing one’s degree of belief in E: if p(E) = 1, then E is regarded as certainly true; if p(E) = 0.5, then E is regarded as just as likely to be true as false; if p(E) = 0, then E is regarded as certainly false. –So the probability can be experimental or subjective based dependent on the applications

11 Properties of Probability Distribution Basic Properties of probability distribution: Let be the probability on, then –For any event,, where is complementary (i.e., not ) event; –If events, then ; –For any two events and, –For empty event (i.e., empty set),

12 Properties of Probability Distribution Example: Let be the sample space for checking the exam marks of students, Let: –, i.e., the event of “pass” –, i.e., the event of “1 st class” –Then as –If –then the probability of event (i.e., the event of “fail”) is

13 Properties of Probability Distribution Example (continue) : Assume –Question: what is the probability of event i.e., the event of “fail or 1 st class” –Answer:

14 Properties of Probability Distribution The following notions help us to perform basic calculations with probabilities. Definition: –Events are mutually exclusive if –Events are jointly exhaustive if –Eventsform a partition (of ) if they are mutually exclusive and jointly exhaustive. Example. Events form a partition of which is defined in the previous examples.

15 Properties of Probability Distribution Property related to partition: –If Events are mutually exclusive, then –If events form a partition

16 Properties of Probability Distribution Example: Consider the following events –, i.e., the event of “fail” –, i.e., the event of “pass but less than 2.1” –,i.e., the event of “2.1” –, i.e., the event of “1 st class” Then form a partition of –If, then –Further let ( i.e., the event of “pass”), then

17 Robot Localization Problem The robot localization problem is one of the most basic problems in the design of autonomous robots: –Let a robot equipped with various sensors move freely within a known, static environment. Determine, on the basis of the robot’s sensor readings and the actions it has performed, its current pose (position and orientation). –In other words: Where am I?

18 Robot Localization Problem Any such robot must be equipped with sensors to perceive its environment and actuators to change it, or move about within it. Some types of actuator –DC motors (attached to wheels) –Stepper motors (attached to gripper arms) –Hydraulic control –‘Artificial muscles’ –...

19 Robot Localization Problem Some types of sensor –Camera(s) –Tactile sensors Bumpers Whiskers –Range-finders Infra-red Sonar Laser range-finders –Compasses –Light-detectors

20 Robot Localization Problem In performing localization, the robot has the following to work with: –knowledge about its initial situation –knowledge of what its sensors have told it –knowledge of what actions it has performed The knowledge about its initial situation may be incomplete (or inaccurate). The sensor readings are typically noisy. The effects of trying to perform actions are typically unpredictable.

21 Robot Localization Problem We shall consider robot localization in a simplified setting: a single robot equipped with rangefinder sensors moving freely in a square arena cluttered with rectangular obstacles: In this exercise, we shall model the robot as a point object occupying some position in the arena not contained in one of the obstacles.

22 Robot Localization Problem We impose a 100×100 square grid on the arena, with the grid lines numbered 0 to 99 (starting at the near left-hand corner). We divide the circle into 100 units of π/50 radians each, again numbered 0 to 99 (measured clockwise from the positive x-axis. We take that the robot always to be located at one of these grid intersections, and to have one of these orientations. The robot’s pose can then be represented by a triple of integers (i, j, t) in the range [0, 99], thus: as indicated.

23 Robot Localization Problem Now let us apply the ideas of probability theory to this situation. Let L i,j,t be the event that the robot has pose (i, j, t) (where i, j, t are integers in the range [0,99]). The collection of events {L i,j,t | 0 ≤ i, j, t < 100} forms a partition! The robot will represent its beliefs about its location as a probability distribution Thus, p(L i,j,t ) is the robot’s degree of belief that its current pose is (i, j, t).

24 Robot Localization Problem The probabilities p(L i,j,t ) can be stored in a 100 × 100 × ×100-matrix. But this is hard to display visually, so we proceed as follows. Let L i,j be the event that the robot has position (i, j), and let L t be the event that the robot has orientation t Thus

25 Robot Localization Problem As the events form a partition, then, based on the property related to partition, we have

26 Robot Localization Problem These summations can be viewed graphically:

27 Robot Localization Problem The robot’s degrees of belief concerning its position can then be viewed as a surface, and its degrees of belief concerning its orientation can be viewed as a curve, thus: The question before us is: how should the robot assign these degrees of belief?

28 Robot Localization Problem There are two specific problems: –what probabilities does the robot start with? –how should the robot’s probabilities change? A reasonable answer to the first question is to assume all poses equally likely, except those which correspond to positions occupied by obstacles: We shall investigate the second question in the next lecture.