ASV Chapters 1 - Sample Spaces and Probabilities

Slides:



Advertisements
Similar presentations
NORMAL OR GAUSSIAN DISTRIBUTION Chapter 5. General Normal Distribution Two parameter distribution with a pdf given by:
Advertisements

Let X 1, X 2,..., X n be a set of independent random variables having a common distribution, and let E[ X i ] = . then, with probability 1 Strong law.
Chapter 2 Multivariate Distributions Math 6203 Fall 2009 Instructor: Ayona Chatterjee.
Joint and marginal distribution functions For any two random variables X and Y defined on the same sample space, the joint c.d.f. is For an example, see.
Use of moment generating functions. Definition Let X denote a random variable with probability density function f(x) if continuous (probability mass function.
Probability Theory STAT 312 STAT 312 Dr. Zakeia AlSaiary.
Review of Basic Probability and Statistics
Continuous Random Variables. For discrete random variables, we required that Y was limited to a finite (or countably infinite) set of values. Now, for.
Sep 16, 2005CS477: Analog and Digital Communications1 LTI Systems, Probability Analog and Digital Communications Autumn
Probability Theory Part 2: Random Variables. Random Variables  The Notion of a Random Variable The outcome is not always a number Assign a numerical.
Probability Densities
Today Today: Chapter 5 Reading: –Chapter 5 (not 5.12) –Suggested problems: 5.1, 5.2, 5.3, 5.15, 5.25, 5.33, 5.38, 5.47, 5.53, 5.62.
1 Review of Probability Theory [Source: Stanford University]
CSE 221: Probabilistic Analysis of Computer Systems Topics covered: Continuous random variables Uniform and Normal distribution (Sec. 3.1, )
Probability and Statistics Review
Discrete Probability Distributions
The moment generating function of random variable X is given by Moment generating function.
Section 5.6 Important Theorem in the Text: The Central Limit TheoremTheorem (a) Let X 1, X 2, …, X n be a random sample from a U(–2, 3) distribution.
Sep 20, 2005CS477: Analog and Digital Communications1 Random variables, Random processes Analog and Digital Communications Autumn
5-1 Two Discrete Random Variables Example Two Discrete Random Variables Figure 5-1 Joint probability distribution of X and Y in Example 5-1.
5-1 Two Discrete Random Variables Example Two Discrete Random Variables Figure 5-1 Joint probability distribution of X and Y in Example 5-1.
Chapter 21 Random Variables Discrete: Bernoulli, Binomial, Geometric, Poisson Continuous: Uniform, Exponential, Gamma, Normal Expectation & Variance, Joint.
Distribution Function properties. Density Function – We define the derivative of the distribution function F X (x) as the probability density function.
Chapter6 Jointly Distributed Random Variables
Sampling Distributions  A statistic is random in value … it changes from sample to sample.  The probability distribution of a statistic is called a sampling.
Statistics for Engineer Week II and Week III: Random Variables and Probability Distribution.
Functions of Random Variables. Methods for determining the distribution of functions of Random Variables 1.Distribution function method 2.Moment generating.
ENGR 610 Applied Statistics Fall Week 3 Marshall University CITE Jack Smith.
Copyright © 2010 Pearson Addison-Wesley. All rights reserved. Chapter 6 Some Continuous Probability Distributions.
2.1 Introduction In an experiment of chance, outcomes occur randomly. We often summarize the outcome from a random experiment by a simple number. Definition.
Math b (Discrete) Random Variables, Binomial Distribution.
Appendix : Probability Theory Review Each outcome is a sample point. The collection of sample points is the sample space, S. Sample points can be aggregated.
4.1 Probability Distributions Important Concepts –Random Variables –Probability Distribution –Mean (or Expected Value) of a Random Variable –Variance and.
MATH 4030 – 4B CONTINUOUS RANDOM VARIABLES Density Function PDF and CDF Mean and Variance Uniform Distribution Normal Distribution.
Chapter 3 Discrete Random Variables and Probability Distributions  Random Variables.2 - Probability Distributions for Discrete Random Variables.3.
Probability Distributions, Discrete Random Variables
Section Means and Variances of Random Variables AP Statistics
Chapter 3 Discrete Random Variables and Probability Distributions  Random Variables.2 - Probability Distributions for Discrete Random Variables.3.
Chapter 3 Discrete Random Variables and Probability Distributions  Random Variables.2 - Probability Distributions for Discrete Random Variables.3.
1 Probability: Introduction Definitions,Definitions, Laws of ProbabilityLaws of Probability Random VariablesRandom Variables DistributionsDistributions.
CHAPTER Discrete Models  G eneral distributions  C lassical: Binomial, Poisson, etc Continuous Models  G eneral distributions 
Copyright © 2010 Pearson Addison-Wesley. All rights reserved. Chapter 3 Random Variables and Probability Distributions.
Unit 4 Review. Starter Write the characteristics of the binomial setting. What is the difference between the binomial setting and the geometric setting?
Chapter 5 Joint Probability Distributions and Random Samples  Jointly Distributed Random Variables.2 - Expected Values, Covariance, and Correlation.3.
Chapter 9: Joint distributions and independence CIS 3033.
ASV Chapters 1 - Sample Spaces and Probabilities
ASV Chapters 1 - Sample Spaces and Probabilities
Probability.
Probability for Machine Learning
Example: X = Cholesterol level (mg/dL)
Chapter 5 Joint Probability Distributions and Random Samples
The distribution function F(x)
ASV Chapters 1 - Sample Spaces and Probabilities
Probability Review for Financial Engineers
Advanced Artificial Intelligence
ASV Chapters 1 - Sample Spaces and Probabilities
ASV Chapters 1 - Sample Spaces and Probabilities
ASV Chapters 1 - Sample Spaces and Probabilities
ASV Chapters 1 - Sample Spaces and Probabilities
Chapter 6 Some Continuous Probability Distributions.
... DISCRETE random variables X, Y Joint Probability Mass Function y1
ASV Chapters 1 - Sample Spaces and Probabilities
ASV Chapters 1 - Sample Spaces and Probabilities
Chapter 3 : Random Variables
Each Distribution for Random Variables Has:
Chapter 3-2 Discrete Random Variables
Part II: Discrete Random Variables
1/2555 สมศักดิ์ ศิวดำรงพงศ์
Presentation transcript:

ASV Chapters 1 - Sample Spaces and Probabilities 2 - Conditional Probability and Independence 3 - Random Variables 4 - Approximations of the Binomial Distribution 5 - Transforms and Transformations 6 - Joint Distribution of Random Variables - cont’d 7 - Sums and Symmetry 8 - Expectation and Variance in the Multivariate Setting 9 - Tail Bounds and Limit Theorems 10 - Conditional Distribution 11 - Appendix A, B, C, D, E, F

... DISCRETE random variables X, Y Joint Probability Mass Function y1 … yc X x1 p(x1, y1) p(x1, y2) ... p(x1, yc) x2 p(x2, y1) p(x2, y2) p(x2, yc) xr p(xr, y1) p(xr, y2) p(xr, yc)

... DISCRETE random variables X, Y Joint Probability Mass Function y1 … yc X x1 p(x1, y1) p(x1, y2) ... p(x1, yc) pX (x1) x2 p(x2, y1) p(x2, y2) p(x2, yc) pX (x2) xr p(xr, y1) p(xr, y2) p(xr, yc) pX (xr) pY (y1) pY (y2) pY (yc) 1

Y = X =

X and Y are not independent! Probabilities… X and Y are not independent!

X and Y are not independent! Probabilities… X and Y are not independent! cdf

X and Y are not independent! Probabilities… X and Y are not independent! cdf

Cumulative Probability X = Event T = t Outcomes (AM, PM) Probability Cumulative Probability 2 (1, 1) .25 3 (1, 2), (2, 1) .45 = .20 + .25 .70 = .25 + .45 4 (1, 3), (2, 2) .25 = .15 + .10 .95 = .70 + .25 5 (2, 3) .05 1.00 = .95 + .05

... DISCRETE random variables X, Y Joint Probability Mass Function y1 … yc X x1 p(x1, y1) p(x1, y2) ... p(x1, yc) pX (x1) x2 p(x2, y1) p(x2, y2) p(x2, yc) pX (x2) xr p(xr, y1) p(xr, y2) p(xr, yc) pX (xr) pY (y1) pY (y2) pY (yc) 1

... CONTINUOUS random variables X, Y Joint Probability Density Function Joint Probability Mass Function Y y1 y2 … yc X x1 p(x1, y1) p(x1, y2) ... p(x1, yc) pX (x1) x2 p(x2, y1) p(x2, y2) p(x2, yc) pX (x2) xr p(xr, y1) p(xr, y2) p(xr, yc) pX (xr) pY (y1) pY (y2) pY (yc) 1

Joint Probability Density Function CONTINUOUS Joint Probability Density Function Volume under density f(x, y) over A. “area element” Area A

... Corollary ~ CONTINUOUS random variables X, Y Joint Probability Density Function Joint Probability Mass Function Y y1 y2 … yc X x1 p(x1, y1) p(x1, y2) ... p(x1, yc) pX (x1) x2 p(x2, y1) p(x2, y2) p(x2, yc) pX (x2) xr p(xr, y1) p(xr, y2) p(xr, yc) pX (xr) pY (y1) pY (y2) pY (yc) 1 Corollary ~ If X and Y are independent, then the joint cdf satisfies Proof: Exercise

Extension to multiple random variables X1, X2, X3,…, Xn For simplicity, take n = 3: Discrete Continuous (e.g, Multinomial distribution)