Central Limit Theorem and Normal Distribution EE3060 Probability Yi-Wen Liu November 2010.

Slides:



Advertisements
Similar presentations
SADC Course in Statistics Importance of the normal distribution (Session 09)
Advertisements

Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Copyright R.J. Marks II EE 505 Sums of RV’s and Long-Term Averages (The Central Limit Theorem)
Central Limit Theorem. So far, we have been working on discrete and continuous random variables. But most of the time, we deal with ONE random variable.
REVIEW – APPLICATIONS OF THE NORMAL DISTRIBUTION.
Tutorial 10, STAT1301 Fall 2010, 30NOV2010, By Joseph Dong.
Distribution of Sample Means, the Central Limit Theorem If we take a new sample, the sample mean varies. Thus the sample mean has a distribution, called.
1 Chap 5 Sums of Random Variables and Long-Term Averages Many problems involve the counting of number of occurrences of events, computation of arithmetic.
Section 5.7 Suppose X 1, X 2, …, X n is a random sample from a Bernoulli distribution with success probability p. Then Y = X 1 + X 2 + … + X n has a distribution.
Probability theory 2010 Outline  The need for transforms  Probability-generating function  Moment-generating function  Characteristic function  Applications.
Lesson #17 Sampling Distributions. The mean of a sampling distribution is called the expected value of the statistic. The standard deviation of a sampling.
Section 10.6 Recall from calculus: lim= lim= lim= x  y  — x x — x kx k 1 + — y y eekek (Let y = kx in the previous limit.) ekek If derivatives.
Chapter 7: Variation in repeated samples – Sampling distributions
The moment generating function of random variable X is given by Moment generating function.
Approximations to Probability Distributions: Limit Theorems.
Normal and Sampling Distributions A normal distribution is uniquely determined by its mean, , and variance,  2 The random variable Z = (X-  /  is.
Chapter 21 Random Variables Discrete: Bernoulli, Binomial, Geometric, Poisson Continuous: Uniform, Exponential, Gamma, Normal Expectation & Variance, Joint.
Continuous Probability Distribution  A continuous random variables (RV) has infinitely many possible outcomes  Probability is conveyed for a range of.
Standard error of estimate & Confidence interval.
Statistics for Engineer Week II and Week III: Random Variables and Probability Distribution.
4.4 Normal Approximation to Binomial Distributions
Random Variables and Stochastic Processes –
Poisson Random Variable Provides model for data that represent the number of occurrences of a specified event in a given unit of time X represents the.
Recall: By the distributive property, we have x ( x + 2 ) = x² + 2x Now we’re given a polynomial expression and we want to perform the “opposite” of the.
Geoff Scott Robert Minello Andrew Rivas
Chapter 10 – Sampling Distributions Math 22 Introductory Statistics.
Bernoulli Trials Two Possible Outcomes –Success, with probability p –Failure, with probability q = 1  p Trials are independent.
Convergence in Distribution
Chapter 12 Probability. Chapter 12 The probability of an occurrence is written as P(A) and is equal to.
Chapter 7 Sampling and Sampling Distributions ©. Simple Random Sample simple random sample Suppose that we want to select a sample of n objects from a.
8 Sampling Distribution of the Mean Chapter8 p Sampling Distributions Population mean and standard deviation,  and   unknown Maximal Likelihood.
Estimation Chapter 8. Estimating µ When σ Is Known.
Physics 270. o Experiment with one die o m – frequency of a given result (say rolling a 4) o m/n – relative frequency of this result o All throws are.
7 sum of RVs. 7-1: variance of Z Find the variance of Z = X+Y by using Var(X), Var(Y), and Cov(X,Y)
Normal approximation of Binomial probabilities. Recall binomial experiment:  Identical trials  Two outcomes: success and failure  Probability for success.
Using the Tables for the standard normal distribution.
1 Central Limit Theorem The theorem states that the sum of a large number of independent observations from the same distribution has, under certain general.
By Satyadhar Joshi. Content  Probability Spaces  Bernoulli's Trial  Random Variables a. Expectation variance and standard deviation b. The Normal Distribution.
6.2 BINOMIAL PROBABILITIES.  Features  Fixed number of trials (n)  Trials are independent and repeated under identical conditions  Each trial has.
Joint Moments and Joint Characteristic Functions.
Central Limit Theorem Let X 1, X 2, …, X n be n independent, identically distributed random variables with mean  and standard deviation . For large n:
Probability Generating Functions Suppose a RV X can take on values in the set of non-negative integers: {0, 1, 2, …}. Definition: The probability generating.
Geology 6600/7600 Signal Analysis 04 Sep 2014 © A.R. Lowry 2015 Last time: Signal Analysis is a set of tools used to extract information from sequences.
DATA ANALYSIS AND MODEL BUILDING LECTURE 4 Prof. Roland Craigwell Department of Economics University of the West Indies Cave Hill Campus and Rebecca Gookool.
Sums of Random Variables and Long-Term Averages Sums of R.V. ‘s S n = X 1 + X X n of course.
Probability and Statistics Dr. Saeid Moloudzadeh Poisson Random Variable 1 Contents Descriptive Statistics Axioms of Probability Combinatorial.
ELEC 303 – Random Signals Lecture 14 – Sample statistics, Limit Theorems Dr. Farinaz Koushanfar ECE Dept., Rice University Oct 21, 2010.
Background for Machine Learning (I) Usman Roshan.
Basic statistics Usman Roshan.
Sampling and Sampling Distributions
Statistical Quality Control, 7th Edition by Douglas C. Montgomery.
Binomial Distribution
Press Using randomisation on spreadsheets to enhance statistical understanding Neil Sheldon Manchester Grammar School Royal Statistical Society Centre.
Simple stochastic models 1
5.6 The Central Limit Theorem
Normal Density Curve. Normal Density Curve 68 % 95 % 99.7 %
Probability & Statistics Probability Theory Mathematical Probability Models Event Relationships Distributions of Random Variables Continuous Random.
Using the Tables for the standard normal distribution
Lecture Slides Elementary Statistics Twelfth Edition
BINOMIAL DISTRIBUTION
ASV Chapters 1 - Sample Spaces and Probabilities
Lecture Slides Elementary Statistics Twelfth Edition
Approximating distributions
Central Limit Theorem Accelerated Math 3.
Introduction to Probability Distributions
Chapter 3 : Random Variables
Bernoulli Trials Two Possible Outcomes Trials are independent.
Introduction to Probability Distributions
1/2555 สมศักดิ์ ศิวดำรงพงศ์
Statistics 101 Chapter 8 Section 8.1 c and d.
Presentation transcript:

Central Limit Theorem and Normal Distribution EE3060 Probability Yi-Wen Liu November 2010

Binomial approximated by normal distributions N=25 N=50 N=100

Binomial, now approximated by normal distributions N=25 N=50 N=100

Binomial, now approximated by normal distributions N=25 N=50 N=100

Review: Binomial(40,p) with Poisson Approximation

Conclusions Recall that binomial(N,p) is an independent sum of N Bernoulli r.v.’s N ↑, Central Limit Theorem applicable, Gaussian fits better and better –True for all p –Useful because, for large N, N! cannot be calculated by Matlab double-precision floating point