Randomized Algorithms Randomized Algorithms CS648 Lecture 8 Tools for bounding deviation of a random variable Markov’s Inequality Chernoff Bound Lecture.

Slides:



Advertisements
Similar presentations
Probability Distribution
Advertisements

Occupancy Problems m balls being randomly assigned to one of n bins. (Independently and uniformly) The questions: - what is the maximum number of balls.
The Randomization Repertoire Rajmohan Rajaraman Northeastern University, Boston May 2012 Chennai Network Optimization WorkshopThe Randomization Repertoire1.
Randomized Algorithms Randomized Algorithms CS648 Lecture 9 Random Sampling part-I (Approximating a parameter) Lecture 9 Random Sampling part-I (Approximating.
Randomized Algorithms Randomized Algorithms CS648 Lecture 2 Randomized Algorithm for Approximate Median Elementary Probability theory Lecture 2 Randomized.
Randomized Algorithms Randomized Algorithms CS648 Lecture 3 Two fundamental problems Balls into bins Randomized Quick Sort Random Variable and Expected.
Randomized Algorithms Randomized Algorithms CS648 Lecture 14 Expected duration of a randomized experiment Part II Lecture 14 Expected duration of a randomized.
Chain Rules for Entropy
ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition Objectives: Jensen’s Inequality (Special Case) EM Theorem.
Randomized Algorithms Randomized Algorithms CS648 Lecture 20 Probabilistic Method (part 1) Lecture 20 Probabilistic Method (part 1) 1.
Chernoff Bounds, and etc.
Probability Theory Part 2: Random Variables. Random Variables  The Notion of a Random Variable The outcome is not always a number Assign a numerical.
PMAI 2003/04 Targil 1: Basic Probability (see further details in handouts)
2003/02/13 Chapter 4 1頁1頁 Chapter 4 : Multiple Random Variables 4.1 Vector Random Variables.
2003/04/23 Chapter 3 1頁1頁 3.6 Expected Value of Random Variables.
PMAI 2001/02 Targil 1: Basic Probability and Information theory
The moment generating function of random variable X is given by Moment generating function.
511 Friday Feb Math/Stat 511 R. Sharpley Lecture #15: Computer Simulations of Probabilistic Models.
Mutually Exclusive: P(not A) = 1- P(A) Complement Rule: P(A and B) = 0 P(A or B) = P(A) + P(B) - P(A and B) General Addition Rule: Conditional Probability:
Normal and Sampling Distributions A normal distribution is uniquely determined by its mean, , and variance,  2 The random variable Z = (X-  /  is.
Standard error of estimate & Confidence interval.
Poisson Random Variable Provides model for data that represent the number of occurrences of a specified event in a given unit of time X represents the.
CS433 Modeling and Simulation Lecture 16 Output Analysis Large-Sample Estimation Theory Dr. Anis Koubâa 30 May 2009 Al-Imam Mohammad Ibn Saud University.
ENGR 610 Applied Statistics Fall Week 3 Marshall University CITE Jack Smith.
Probability Theory Overview and Analysis of Randomized Algorithms Prepared by John Reif, Ph.D. Analysis of Algorithms.
The Mean of a Discrete RV The mean of a RV is the average value the RV takes over the long-run. –The mean of a RV is analogous to the mean of a large population.
COMP 170 L2 L17: Random Variables and Expectation Page 1.
Lecture 2 Forestry 3218 Lecture 2 Statistical Methods Avery and Burkhart, Chapter 2 Forest Mensuration II Avery and Burkhart, Chapter 2.
Week11 Parameter, Statistic and Random Samples A parameter is a number that describes the population. It is a fixed number, but in practice we do not know.
Chapter 7 Sampling and Sampling Distributions ©. Simple Random Sample simple random sample Suppose that we want to select a sample of n objects from a.
Instructor: Shengyu Zhang. First week Part I: About the course Part II: About algorithms and complexity  What are algorithms?  Growth of functions 
Math b (Discrete) Random Variables, Binomial Distribution.
Stat 13 Lecture 19 discrete random variables, binomial A random variable is discrete if it takes values that have gaps : most often, integers Probability.
The Binomial Distribution
Using the Tables for the standard normal distribution.
Chapter 4-5 DeGroot & Schervish. Conditional Expectation/Mean Let X and Y be random variables such that the mean of Y exists and is finite. The conditional.
Week 121 Law of Large Numbers Toss a coin n times. Suppose X i ’s are Bernoulli random variables with p = ½ and E(X i ) = ½. The proportion of heads is.
By Satyadhar Joshi. Content  Probability Spaces  Bernoulli's Trial  Random Variables a. Expectation variance and standard deviation b. The Normal Distribution.
1 Probability and Statistical Inference (9th Edition) Chapter 5 (Part 2/2) Distributions of Functions of Random Variables November 25, 2015.
Chapter 31Introduction to Statistical Quality Control, 7th Edition by Douglas C. Montgomery. Copyright (c) 2012 John Wiley & Sons, Inc.
Central Limit Theorem Let X 1, X 2, …, X n be n independent, identically distributed random variables with mean  and standard deviation . For large n:
Computer Performance Modeling Dirk Grunwald Prelude to Jain, Chapter 12 Laws of Large Numbers and The normal distribution.
Chebyshev’s Inequality Markov’s Inequality Proposition 2.1.
ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition Objectives: Jensen’s Inequality (Special Case) EM Theorem.
Theory of Computational Complexity Probability and Computing Ryosuke Sasanuma Iwama and Ito lab M1.
Andrey Markov, public domain image
Basic statistics Usman Roshan.
Sampling and Sampling Distributions
Basic statistics Usman Roshan.
Probability Theory Overview and Analysis of Randomized Algorithms
Al-Imam Mohammad Ibn Saud University Large-Sample Estimation Theory
LECTURE 10: EXPECTATION MAXIMIZATION (EM)
آشنايی با اصول و پايه های يک آزمايش
Today (1/19/15) Learning objectives:
3.4 The Binomial Distribution
Today (1/21/15) Learning objectives:
Using the Tables for the standard normal distribution
Lecture Slides Elementary Statistics Twelfth Edition
ASV Chapters 1 - Sample Spaces and Probabilities
Lecture Slides Elementary Statistics Twelfth Edition
Chernoff bounds The Chernoff bound for a random variable X is
Real-time risk analysis – elements of Large Deviation Theory
Chebychev, Hoffding, Chernoff
Sampling Distribution of the Mean
Tomado del libro Cormen
9. Limit Theorems.
Randomized Algorithms CS648
Bernoulli Trials Two Possible Outcomes Trials are independent.
Chap 11 Sums of Independent Random Variables and Limit Theorem Ghahramani 3rd edition 2019/5/16.
The Binomial Distributions
Presentation transcript:

Randomized Algorithms Randomized Algorithms CS648 Lecture 8 Tools for bounding deviation of a random variable Markov’s Inequality Chernoff Bound Lecture 8 Tools for bounding deviation of a random variable Markov’s Inequality Chernoff Bound 1

Markov’s Inequality and Chernoff bound were stated and proved in this lecture class in an interactive manner providing all intuition and reasoning for each step of the proof.

Markov’s Inequality 3

Chernoff’s Bound

Where to use: If given random variable X can be expressed as a sum of n mutually independent Bernoulli random variables.

Homework For various problems till now, we used our knowledge of binomial coefficients, elementary probability theory and Stirling’s approximation for getting a bound on the probability of error or probability of deviation from average running time. Try to use Chernoff’s bound to analyze these problems.