Bayes’ Theorem Susanna Kujanpää OUAS 6.12.2012. Bayes’ Theorem This is a theorem with two distinct interpretations. 1) Bayesian interpretation: it shows.

Slides:



Advertisements
Similar presentations
Day 16 More on conditional probability, independence and total probability formula.
Advertisements

Bayesian analysis with a discrete distribution Source: Stattrek.com.
Decision Making Under Risk Continued: Bayes’Theorem and Posterior Probabilities MGS Chapter 8 Slides 8c.
Bayes Rule The product rule gives us two ways to factor a joint probability: Therefore, Why is this useful? –Can get diagnostic probability P(Cavity |
Introduction to Probability The problems of data measurement, quantification and interpretation.
Psychology 290 Special Topics Study Course: Advanced Meta-analysis April 7, 2014.
Chapter 4 Probability: Probabilities of Compound Events
Probability and Statistics for Data Mining COMP5318.
Intro to Bayesian Learning Exercise Solutions Ata Kaban The University of Birmingham 2005.
Review Probabilities –Definitions of experiment, event, simple event, sample space, probabilities, intersection, union compliment –Finding Probabilities.
Slide 1 Statistics for HEP Roger Barlow Manchester University Lecture 1: Probability.
Bayes Theorem Mutually exclusive events A collection of events (B1, B2, …, Bk) is said to be mutually exclusive if no two of them overlap. If mutually.
Engineering Probability and Statistics - SE-205 -Chap 2 By S. O. Duffuaa.
Keller: Stats for Mgmt & Econ, 7th Ed
EXAMPLE 6 Find probability of three dependent events Costume Party You and two friends go to the same store at different times to buy costumes for a costume.
Review: Probability Random variables, events Axioms of probability
EXAMPLE 6 Find probability of three dependent events Costume Party
Statistics Continued. Purpose of Inferential Statistics Try to reach conclusions that extend beyond the immediate data Make judgments about whether an.
Probability and inference General probability rules IPS chapter 4.5 © 2006 W.H. Freeman and Company.
6 Probability Chapter6 p Operations on events and probability An event is the basic element to which probability can be applied. Notations Event:
Chapter 4 Probability See.
Chapter 7 Sets & Probability
Conditional Probability.  The probability that event, B, will occur given that another event, A, has already happened.  Exists when two events depend.
Dr. Gary Blau, Sean HanMonday, Aug 13, 2007 Statistical Design of Experiments SECTION I Probability Theory Review.
Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Chapter 4 Probability.
AP Statistics Chapter 6 Notes. Probability Terms Random: Individual outcomes are uncertain, but there is a predictable distribution of outcomes in the.
©The McGraw-Hill Companies, Inc. 2008McGraw-Hill/Irwin A Survey of Probability Concepts Chapter 5.
Introduction to Probability  Probability is a numerical measure of the likelihood that an event will occur.  Probability values are always assigned on.
Ch Counting Techniques Product Rule If the first element or object of an ordered pair can be used in n 1 ways, and for each of these n1 ways.
Warm-up – for my history buffs…  A general can plan a campaign to fight one major battle or three small battles. He believes that he has probability 0.6.
VENN DIAGRAMS Slideshow 57, Mathematics Mr Richard Sasaki, Room 307.
1 Business System Analysis & Decision Making - Lecture 10 Zhangxi Lin ISQS 5340 July 2006.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
 P(A c ∩ B) + P(A ∩ B)=P(B)  P(A c ∩ B) and P(A ∩ B) are called joint probability.  P(A) and P(B) are called marginal probability.  P(A|B) and P(B|A)
Baye’s Theorem Working with Conditional Probabilities.
Chapter 4 Probability ©. Sample Space sample space.S The possible outcomes of a random experiment are called the basic outcomes, and the set of all basic.
Probability 2.0. Independent Events Events can be "Independent", meaning each event is not affected by any other events. Example: Tossing a coin. Each.
Warm-up A statistical report states that 68% of adult males in China smoke. What is the probability that five randomly selected adult males from China.
Mathematics Conditional Probability Science and Mathematics Education Research Group Supported by UBC Teaching and Learning Enhancement Fund
Recap from last lesson Compliment Addition rule for probabilities
©The McGraw-Hill Companies, Inc. 2008McGraw-Hill/Irwin A Survey of Probability Concepts Chapter 5.
1 Chapter 12 Probabilistic Reasoning and Bayesian Belief Networks.
Review: Probability Random variables, events Axioms of probability Atomic events Joint and marginal probability distributions Conditional probability distributions.
12/7/20151 Math b Conditional Probability, Independency, Bayes Theorem.
2. Introduction to Probability. What is a Probability?
Conditional Probability: the likelihood that an event will occur GIVEN that another event has already occurred. A two way table & tree diagrams can represent.
5.3 Conditional Probability and Independence Objectives SWBAT: CALCULATE and INTERPRET conditional probabilities. USE the general multiplication rule to.
Rules of Probability. The additive rule P[A  B] = P[A] + P[B] – P[A  B] and if P[A  B] =  P[A  B] = P[A] + P[B]
The Study of Randomness
Jeopardy $100 Adverbs Adverb Clauses Adverb Adverbial Phrases ConnectorsConditionals $200 $300 $400 $500 $400 $300 $200 $100 $500 $400 $300 $200 $100 $500.
Probability. Probability Probability is fundamental to scientific inference Probability is fundamental to scientific inference Deterministic vs. Probabilistic.
Chapter 4 Probability Concepts Events and Probability Three Helpful Concepts in Understanding Probability: Experiment Sample Space Event Experiment.
Probability The Study of Randomness The language of probability Random is a description of a kind of order that emerges only in the long run even though.
2.5 Additive Rules: Theorem 2.10: If A and B are any two events, then: P(A  B)= P(A) + P(B)  P(A  B) Corollary 1: If A and B are mutually exclusive.
HL2 Math - Santowski Lesson 93 – Bayes’ Theorem. Bayes’ Theorem  Main theorem: Suppose we know We would like to use this information to find if possible.
Probability. Definitions Probability: The chance of an event occurring. Probability Experiments: A process that leads to well- defined results called.
Chapter 4, part E Download this file. Download this file.
MGS3100_07.ppt/Apr 7, 2016/Page 1 Georgia State University - Confidential MGS 3100 Business Analysis Decision Tree & Bayes’ Theorem Apr 7, 2016.
Bayes’ Theorem Suppose we have estimated prior probabilities for events we are concerned with, and then obtain new information. We would like to a sound.
Intro to Bayesian Learning Exercise Solutions Ata Kaban The University of Birmingham.
Warm-up – for my history buffs…
Bayesian inference, Naïve Bayes model
COMP61011 : Machine Learning Probabilistic Models + Bayes’ Theorem
In-Class Exercise: Bayes’ Theorem
Chapter 4. Probability
posterior probability
If A and B are any two events, then: P(AB)= P(A) + P(B)  P(AB)
posterior probability
posterior probability
Presentation transcript:

Bayes’ Theorem Susanna Kujanpää OUAS

Bayes’ Theorem This is a theorem with two distinct interpretations. 1) Bayesian interpretation: it shows how a subjective degree of belief should rationally change to account for evidence

Bayes’ Theorem 2) Frequentist interpretation: it relates inverse representations of the probalilities concerning two events.

Bayes’ Theorem If A and B are events, then where P(A|B) is conditional probability and

Bayes’ Theorem In the special case of binary partition

Bayes’ Theorem EXAMPLE: Lisa can decide to go study by car or bus. Because of high traffic, if she decides to go by car, there is a 50% chance she will be late. If she goes by bus, the probability of being late is only 20%.

Bayes’ Theorem Suppose that Lisa is late one day, and her teacher wishes to estimate the probability that she drove to school that one day by car. Since she doesn’t know which mode of transportation Lisa usually uses, she gives a prior probability of 1/3 to both possibilities. What is the teacher’s estimate of the probability that Lisa drove to the school ?

Bayes’ Theorem Solution: This information is given A = event Lisa comes by a car = Lisa comes by a bus B= event Lisa is late from school and P(A) = P( ) = 1/3 P(B|A) = 0.5 P(B| ) = 0.2

Bayes’ Theorem We want to calculate P (A|B) and by Bayes Theorem, this is =

Bayes’ Theorem This example can be visualized with tree diagrams:

Bayes’ Theorem And the values are:

Bayes’ Theorem EXAMPLE Lisa is graduating at outdoor ceremony tomorrow. In recent years, it has rained only one week each year. Now, the weatherman has predicted rain for tomorrow. When it actually rains, the weatherman correctly forecasts rain 90% of the time. What is the probability that it will rain on graduating day ?

Bayes’ Theorem Solution: A = It rains on graduating day = It doesn’t rain on graduating day B= weatherman predicts rain and P(A) = 7/365 = P( ) = 358/365 = P(B|A) = 0.9 P(B| ) = 0.1

Bayes’ Theorem Now by Bayes Theorem, this is

EXERCISES: 1) Suppose that Mike can decide to go work by bus, car or train. If he decides to go by car, there is 45% chance he will be late. If he goes by bus, there is 25% chance of being late. The train is almost never late, with probability of 2%, but it is more expensive than the bus. Suppose that Mike is late one day and his friend wishes to estimate the probability that he drove to work that day by car (he gives the probability of 1/3 to each possibilities). What is the friend’s estimate of the probability that Mike drove to work ?

2) In the village, 51% of the adults are males. One of the adult is randomly selected for a survey involving credit card usage. Later was noticed that the selected survey subject was using headache medicin. Also, 9.5% of males use medicin and 1.7% of females. Use this additional information to find the probability that the selected subject is male.

3) A first company makes 80% of the products, the second makes 15% of them and the third makes the other 5%. The first company have a 4% rate of defects, the second have a 6% rate of defects and the third have a 9%. If a randomly selected product is then tested and is found to be defective, find the probability that it was made by the first company.

ANSWERS: 1) ) ) 0.703