# Estimating a Population Proportion

## Presentation on theme: "Estimating a Population Proportion"— Presentation transcript:

Estimating a Population Proportion
Chapter 9 Estimating a Population Proportion Created by Kathy Fritz

Selecting an Estimator

What makes a statistic a good estimator of a population characteristic?
1. Choose a statistic that is unbiased Unbiased, since the distribution is centered at the true value In other words, a statistic that does not consistently tend to underestimate or to overestimate the value of a population characteristic is an unbiased estimator of that characteristic. Biased, since the distribution is NOT centered at the true value A statistic with a sampling distribution that is centered at the actual value of the population characteristic is an unbiased estimator of that population characteristic. Unbiased, since the distribution is centered at the true value

What makes a statistic a good estimator of a population characteristic?
Choose a statistic that is unbiased Choose a statistic with a small standard error Unbiased, but has a smaller standard error so it is more precise. The standard deviation of a sampling distribution is called the standard error. If a sampling distribution is centered very close to the actual value of the population characteristic, a small standard error ensures that values of the statistic will cluster tightly around the actual value of the population characteristic. Unbiased, but has a larger standard error so it is not as precise. A statistic that is unbiased and has a small standard error is likely to result in an estimate that is close to the actual value of that population characteristic.

In a review of ALL criminal cases heard by the Supreme Courts of 11 states from 2000 to 2004, of the 1488 cases were decided in favor of the defendant. Let p be the proportion of all cases reviewed that decided in favor of the defendant. 𝑝= =0.263 Suppose that the proportion p = was not known. To estimate this proportion, you plan to select a sample and compute 𝑝 , the sample proportion that were decided in favor of the defendant. If n = 25, then the standard error of 𝑝 is standard error of 𝑝 = 𝑝(1−𝑝) 𝑛 = (1−0.263) 25 =0.088

How does the sample size affect the standard error of 𝑝 ?
Supreme Court Cases Continued . . . Let p be the proportion of all cases reviewed that decided in favor of the defendant. If n = 25, then the standard error of 𝑝 is standard error of 𝑝 = 𝑝(1−𝑝) 𝑛 = (1−0.263) 25 =0.088 If n = 100, then the standard error of 𝑝 is How does the sample size affect the standard error of 𝑝 ? standard error of 𝑝 = 𝑝(1−𝑝) 𝑛 = (1−0.263) 100 =0.044

Supreme Court Cases Continued . . .
Suppose that p = How does this affect the standard error of 𝑝 ? If n = 25 and p = 0.263, then the standard error of 𝑝 is standard error of 𝑝 = 𝑝(1−𝑝) 𝑛 = (1−0.263) 25 =0.088 If n = 25 and p = 0.40, then the standard error of 𝑝 is standard error of 𝑝 = 𝑝(1−𝑝) 𝑛 = (1−0.40) 25 =0.098

Supreme Court Cases Continued . . .
Suppose that p = How does this affect the standard error of 𝑝 ? If n = 25 and p = 0.263, then the standard error of 𝑝 is standard error of 𝑝 = 𝑝(1−𝑝) 𝑛 = (1−0.263) 25 =0.088 Does it surprise you that 𝑝 tends to produce more precise estimates the farther the population proportion is from 0.5? If n = 25 and p = 0.04, then the standard error of 𝑝 is standard error of 𝑝 = 𝑝(1−𝑝) 𝑛 = (1−0. 04) 25 =0.039 For a fixed sample size, the standard error of 𝑝 is greatest when p = 0.5.

Estimating a Population Proportion
Margin of Error

The value of the sample proportion 𝑝 provides an estimate of the population proportion p. Let p = 0.484 If 𝑝 =0.426, then the estimate is “off” by This difference represents the error in the estimate. A different sample might produce an estimate of 𝑝 =0.498, resulting in an estimation error of The margin of error of a statistic is the maximum likely estimation error. Notice that different samples will produce different 𝑝 estimates that will have different estimation errors. It is unusual for an estimate to differ from the actual value of the population characteristic by more than the margin of error.

Recall the General Properties for Sampling Distributions of 𝑝
The mean of the 𝑝 sampling distribution is p. 𝜇 𝑝 =𝑝 When these properties hold, we can use what we know about normal distributions to tell us about how 𝑝 behaves as an estimator of p. 2. The standard error (deviation) of the 𝑝 sampling distribution is 𝜎 𝑝 = 𝑝(1−𝑝) 𝑛 3. If n is large, the 𝑝 sampling distribution is approximately normal.

If a variable has a standard normal distribution, about 95% of the time the value of variable will be between and 1.96. Central Area = 0.95 Lower tail area = .025 Upper tail area = .025 -1.96 1.96

This is the margin of error for estimating a population proportion.
If n is large, the 𝑝 sampling distribution is approximately normal with mean p and standard error 𝜎 𝑝 = 𝑝(1−𝑝) 𝑛 . About 95% of the possible 𝑝 will fall within 𝑝(1−𝑝) 𝑛 of the population proportion p. For any normal distribution, about 95% of the observed values will be within 1.96 standard deviations of the mean. Central Area = 0.95 This is the margin of error for estimating a population proportion. Lower tail area = .025 Upper tail area = .025 p -1.96 𝜎 𝑝 1.96 𝜎 𝑝

Margin of Error for Estimating a Population Proportion p
Appropriate when the following conditions are met The sample is a random sample from the population of interest OR the sample is selected in a way that makes it reasonable to think the sample is representative of the population. The sample size is large enough. This condition is met when either both 𝑛 𝑝 ≥10 and 𝑛(1− 𝑝 )≥10 OR (equivalently) the sample includes at least 10 successes and at least 10 failures.

Margin of Error for Estimating a Population Proportion p Continued . . .
When these conditions are met margin of error= 𝑝 (1− 𝑝 𝑛 Interpretation of margin of error It would be unusual for the sample proportion to differ from the actual value of the population proportion by more than the margin of error. The formula given for the margin of error is actually the estimated margin of error, but it is common to refer to it without the “estimated”. Any time a margin of error is reported, it is an estimated margin of error. For 95% of all random samples, the estimation error will be less than the margin of error.

Based on a representative sample of 511 U. S
Based on a representative sample of 511 U.S. teenagers ages 12 to 17, International Communications Research estimated that the proportion of teens who support keeping the legal drinking age at 21 is 𝑝 =0.64 with a margin of error of 0.04. Let’s see how this margin of error was computed. Check conditions: Given that the sample was representative of the population The sample size is large enough because 𝑛 𝑝 = =327≥10 and 𝑛 1− 𝑝 = =184≥10

Legal Drinking Age Continued . . .
𝑝 =0.64 with a margin of error of 0.04 Compute margin of error 𝑚𝑎𝑟𝑔𝑖𝑛 𝑜𝑓 𝑒𝑟𝑟𝑜𝑟= (0.36) 511 =0.04 Interpretation An estimate of the proportion of U.S. teens who favor keeping the legal drinking age at 21 is It is unlikely that this estimate differs from the actual population proportion by more than 0.04.

A Large Sample Confidence Interval for a Population Proportion
Confidence Level

Developing a Confidence Interval
Notice that this line equals 𝑝(1−𝑝) 𝑛 . We will use this to create an interval of values to estimate p. Approximate sampling distribution of 𝑝 Suppose we get this 𝑝 . p Suppose we get this 𝑝 . Suppose we get this 𝑝 . This 𝑝 did not fall within 1.96 standard deviations of the value of p AND its interval does NOT “capture” p. Using this method of calculation, the confidence interval will not capture p 5% of the time. 𝑝 𝑝 This line represents 1.96 standard deviations above the mean. Notice that the length of each half of the interval equals 𝑝(1−𝑝) 𝑛 𝑝 This line represents 1.96 standard deviations below the mean. When n is large, a 95% confidence interval for p is 𝑝 − 𝑝 (1− 𝑝 ) 𝑛 , 𝑝 𝑝 (1− 𝑝 ) 𝑛 This 𝑝 fell within 1.96 standard deviations of the value of p AND its interval “captures” p. This 𝑝 fell within 1.96 standard deviations of the value of p AND its interval “captures” p.

Confidence Intervals A confidence interval (CI) for a population characteristic specifies an interval of plausible values for the characteristic. The interval is constructed in such a way so that the resulting interval will be successful in capturing the actual value of the population characteristic a specified percentage of time. The primary goal of a confidence interval is to estimate an unknown population characteristic.

Confidence level The confidence level associated with a confidence interval is the success rate of the method used to construct the interval. If this method was used to generate an interval estimate over and over again from different random samples, in the long run 95% of the resulting intervals would include the actual value of the characteristic being estimated. Our confidence is in the method – NOT in any one particular interval!

7 out of the 100 confidence intervals do not contain p.
The diagram to the right is % confidence intervals for p computed from 100 different random samples. 7 out of the 100 confidence intervals do not contain p. Why not? Note that the ones with asterisks do not capture p. If we were to compute 100 more confidence intervals for p from 100 different random samples, would we get the same results?

Other Confidence Levels
Suppose we wanted to create confidence intervals with a 90% confidence level Suppose we wanted to create confidence intervals with a 99% confidence level . . . Notice also that the larger the confidence level, the larger the critical value will be AND the wider the interval will be. Notice that these critical values differ for different confidence levels.

The Large-Sample Confidence Interval for p
The normal distribution is only an approximation of the sampling distribution of 𝑝 and the true confidence level may differ somewhat from the reported level. If 𝑛 𝑝 ≥10 and 𝑛(1− 𝑝 )≥10, the approximation is reasonable and the actual confidence level is usually quite close to the reported level. This is why it is important to verify this condition. Appropriate when the following conditions are met: Now let’s look at general formula. The sample is a random sample from the population of interest or the sample is selected in a way that makes it reasonable to think the sample is representative of the population. The sample size is large enough. This condition is met when either both 𝑛 𝑝 ≥10 and 𝑛 1− 𝑝 ≥10 or (equivalently) the sample includes at least 10 successes and at least 10 failures.

The Large-Sample Confidence Interval for p Continued . . .
The desired confidence level determines which z critical value is used. The three most common confidence levels use the following z critical values: Confidence Level z Critical Value 90% 95% 99% When these conditions are met, a confidence interval for the population proportion is This is a generic formula for a confidence interval: Statistic ± critical value (standard error of the statistic) Estimated standard error of 𝑝

The Large-Sample Confidence Interval for p Continued . . .
Interpretation of Confidence Interval You can be confident that the actual value of the population proportion is included in the computed interval. Interpretation of Confidence Level The confidence level specifies the approximate percentage of time that this method is expected to be successful in capturing the actual population proportion. In any given problem, this statement should be worded in context.

Recall from Chapter 7 . . . 5 Steps: Four Key Questions:
Q Estimate or hypothesis testing? S Sample data or experimental data? T One variable or two? Categorical or numerical? N How many samples or treatments? E (Estimate) – Explain what population characteristic you plan to estimate. M (Method) – Select a method using QSTN C (Check) – Verify that the conditions are met C (Calculate) – Perform the necessary calculations C (Communicate) – Interpret the confidence interval

Of 1100 drivers surveyed, 990 admitted to careless or aggressive driving during the previous 6 months. Assuming that it is reasonable to regard this sample of 1100 as representative of the population of drivers, compute a 90% confidence interval to estimate p, the proportion of all drivers who have engaged in careless or aggressive driving in the last 6 months. Step 1 (E): The proportion of drivers who have engaged in careless or aggressive driving during the last 6 months, p, will be estimated. Step 2 (M): Because the answers to the four key questions are Q: estimation, S: sample data, T: one categorical variable, N: one sample, a confidence interval for a population proportion will be considered.

Careless or Aggressive Driving Continued . . .
Step 3 (C): There are two conditions that need to be met for the confidence interval of this section to be appropriate. 1. You do not know how the sample was selected. In order to proceed, you MUST assume that the sample was representative of the population. 2. Sample size is large enough because 𝑛 𝑝 = =990≥10 and 𝑛 1− 𝑝 = =110≥10 Step 4 (C): Calculate the interval 0.9± (0.1) =(0.885, 0.915)

Careless or Aggressive Driving Continued . . .
Step 5 (C): Communicate results Interpret Confidence Interval: Assuming that the sample was representative of the population, you can be about 90% confident that the actual proportion of drivers who engaged in careless or aggressive driving in the past 6 months is somewhere between and Interpret Confidence level: The method used to construct this interval estimate is successful in capturing the actual value of the population proportion about 90% of the time.

Three Things that Affect the Width of a Confidence Interval
The higher the confidence level, the wider the interval. The larger the sample size, the narrower the interval. The closer 𝑝 is to 0.5, the wider the interval.

An Alternative to the Large-Sample z Interval
Even when the sample size conditions are met, sometimes the actual confidence level associated with the method may be noticeably different from the reported confidence level. One way to correct this is to use a modified sample proportion, 𝑝 𝑚𝑜𝑑 , the proportion of successes after adding two successes and two failures to the sample. 𝑝 𝑚𝑜𝑑 = 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑠𝑢𝑐𝑐𝑒𝑠𝑠𝑒𝑠+2 𝑛+4 Use this modified sample proportion in place of 𝑝 in the usual confidence interval formula.

Choosing a Sample Size to Achieve a Desired Margin of Error

The value of p may be estimated using prior information.
Choosing a Sample Size Using a 95% confidence interval, the sample size required to estimate a population proportion p with a margin of error M is 𝑀= 𝑝(1−𝑝) 𝑛 Before collecting any data, you might wish to determine a sample size that ensures a certain margin of error. If we solve this for n . . . 𝑛=𝑝(1−𝑝) 𝑀 2 If there is no prior knowledge available, then the conservative estimate for p is 0.5. The value of p may be estimated using prior information.

Why is the conservative estimate for p = 0.5?
The formula for the margin of error is 𝑀= 𝑝(1−𝑝) 𝑛 Since we are looking for the sample size that produces a certain margin of error, then we need to focus on the possible values of p(1 - p) 0.1(0.9) = 0.09 0.2(0.8) = 0.16 0.3(0.7) = 0.21 0.4(0.6) = 0.24 0.5(0.5) = 0.25 By using 0.5 for p, we are using the largest possible value for p(1 – p) in our calculations.

Always round the sample size up to the next whole number.
Researchers have found biochemical markers of cancers in the exhaled breath of cancer patients, but chemical analysis of breath specimens has not yet proven effective in diagnosing cancer. A study is to be performed to investigate whether a dog can be trained to identify the presence or absence of cancer by sniffing breath specimens. How many different breath specimens should be used if you want to estimate the long-run proportion of correct identifications for this dog with a margin of error of 0.10? Always round the sample size up to the next whole number. 𝑛=𝑝 1− 𝑝 𝑀 2 = =96.04 A sample of at least 97 breath specimens should be used.

Avoid These Common Mistakes

Avoid These Common Mistakes
If a 90% confidence interval for p, the proportion of students at a particular college who own a computer, is (0.56, 0.78), you might say “You can be 90% confident that between 56% and 78% of the students at this college own a computer.” Interpretation of interval You have used a method to produce this estimate that is successful in capturing the actual population proportion about 90% of the time. Interpretation of confidence level Don’t get these two statements confused!

Avoid These Common Mistakes
In order for an estimate to be useful, you must know something about its accuracy. You should beware of a single number estimate that is not accompanied by a margin of error or some other measure of accuracy.

Avoid These Common Mistakes
A confidence interval estimate that is wide indicates that you don’t have very precise information about the population characteristic being estimated. Don’t be fooled by a high confidence level. High confidence is not the same thing as saying you have precise information about the value of a population characteristic. The best strategy for decreasing the width of a confidence interval is to take a larger sample!

Avoid These Common Mistakes
The accuracy of an estimate depends on the sample size, not the population size. Notice that the margin of error involves the sample size n, and decreases as n increases. The size of the population, N, does need to be considered if sampling without replacement and the sample size is more than 10% of the population size. In this case, the margin of error is adjusted by multiplying it by a finite population correction factor 𝑵−𝒏 𝑵−𝟏

Avoid These Common Mistakes
CONDITIONS ARE IMPORTANT! If conditions are met, the large sample confidence interval provides a method for using sample data to estimate the population proportion with confidence, and the confidence level is a good approximation of the success rate for the method.

Avoid These Common Mistakes
When reading published reports, don’t fall into the trap of thinking confidence interval every time you see a ± in an expression. In addition to confidence intervals it is common to see both estimate ± margin of error and estimate ± standard error reported.