1. Chapter 9 Estimating ABILITY with Confidence Intervals Objectives Students will be able to: 1)Construct confidence intervals to estimate a proportion or a mean 2)Construct confidence intervals to estimate a difference between two proportions or a difference between two means 3)Interpret confidence intervals in the context of the data 4)Calculate the margin of error for a confidence interval 5)Use technology to calculate confidence intervals

2. In the 2013 NFL regular season, quarterback Matt Ryan completed 439 out of 651 pass attempts, for a completion percentage of 67.4%. Would you be confident in making a claim that in the 2013 NFL season, Matt Ryan had an ABILITY to complete a pass of exactly 67.4%? Why or why not? Discuss using previous concepts learned in this course. Would you be more or less confident if you made the claim that Ryan’s ABILITY to complete a pass fell between two values, say between 55% and 76%?

3. In this chapter, we’re going to look at how we can use an athlete’s PERFORMANCES to estimate their ABILITY by creating a interval of values that their ABILITY will be between. Some examples: – In 2010, Josh Hamilton’s ABILITY to get a hit was somewhere between 0.317 and 0.401. – NFL teams have the ABILITY to score somewhere between 2.1 and 4.5 more points at home than on the road.

4. The Idea of a Confidence Interval Remember that the law of large numbers says it is impossible to know an athlete’s ABILITY exactly unless we could observe an infinite number of PERFORMANCES in the same context. Instead of claiming to know an athlete’s exact ABILITY, we can provide an interval of values that their ABILITY is between.

5. The interval of plausible values for an athlete’s ABILITY or an interval of plausible values for the difference in an athlete’s ABILITY in two different contexts is known as a confidence interval. We use an interval of plausible values rather than a single value to increase our chances of arriving at the correct estimate of an athlete’s ABILITY.

6. Obviously we would be pretty confident in this interval. However, it doesn’t really tell us anything about the weather. We don’t know if it will be hot or cold.

7. Similarly, we wouldn’t want to create a confidence interval saying something like LeBron’s ABILITY to make a three-pointer is between 0% and 100%. This really doesn’t tell us much about what LeBron can do on a basketball court. Later on we will learn about how to calculate a confidence interval. Right now, let’s concentrate on what information a confidence interval provides.

8. Interpreting Confidence Intervals A confidence interval is constructed so that we know how much confidence we should have in the interval. All of the intervals we construct in this course will utilize a 95% confidence level. Meaning, if we were to calculate intervals for lots and lots of athletes using our methods, about 95% of the intervals will succeed in containing the ABILITY of the athlete for whom the interval was calculated.

9. In 2010, Josh Hamilton had a batting average of 0.359 (186 hits in 518 at-bats). Since his average is based on only 518 at-bats (not an infinite amount), it is very unlikely that his ABILITY to get a hit was 0.359. We would probably have close to 0% confidence that his ABILITY to get a hit would be exactly 0.359 if Hamilton had millions and millions of at-bats under the same conditions.

10. We can calculate a 95% confidence interval of Hamilton’s ABILITY to get a hit. Using his 2010 PERFORMANCES, the interval is 0.317 to 0.401. This means that in millions and millions of at- bats under the same conditions, we would expect his batting average to end up being between 0.317 and 0.401.

11. In short, we can say that we are 95% confident that the interval of plausible values from 0.317 to 0.401 contains Hamilton’s ABILITY to get a hit in 2010. The generic statement you can use to interpret a confidence interval for an athlete’s ABILITY is: We are 95% confident that the interval of plausible values from to includes ‘s ABILITY to.

12. We can also use confidence intervals to estimate the difference in an athlete’s ABILITY in two different contexts. Example: In 2010, Hamilton hit 0.271 when facing lefties, as opposed to 0.401 when facing righties. He PERFORMED 0.130 batting average points better when facing right- handed pitchers. Again, since this is based off of 518 total at- bats, it’s unlikely that this is the exact difference in his ABILITY.

13. A 95% confidence interval for his difference in ABILITY is from 0.043 to 0.217. Interpretation: We are 95% confident that the interval of plausible values from 0.043 to 0.217 contains the true difference in Hamilton’s ABILITY to get a hit against right-handed pitchers and his ABILITY to get a hit against left-handed pitchers. Generic statement: We are 95% confident that the interval of plausible values from to includes the difference in ‘s ABILITY to in context 1 and context 2.

14. Using Confidence Intervals to Make Decisions Do Josh Hamilton’s PERFORMANCES in 2010 provide convincing evidence that he has a greater ABILITY to get a hit against right- handed pitchers than against left-handed pitchers? What would our hypotheses be for this question?

15. Remember, his average against lefties was.271 and his average against righties was.401. The test-statistic will be the difference in batting averages (0.130). The p-value for this test is approximately 0. What does that tell us? – Reject the null, and we have convincing evidence that Hamilton was a better hitter against right-handed pitchers.

16. We can also use confidence intervals to address the hypotheses. The null hypothesis says that Hamilton has the same ABILITY to get a hit vs righties and lefties. Therefore, if this null is correct, what should be the true difference in his ABILITY (righty – lefty)? 0. If there is no difference in his ABILITY, then when you take the difference, you should get 0.

17. If the alternative hypothesis is correct, then the true difference (righty – lefty) should be greater than 0. The confidence interval for Hamilton’s difference in ABILITY was between 0.043 and 0.217. This entire interval is positive. 0 is not a part of the interval. Every value in the interval suggests that his ABILITY to get a hit was higher against righties than lefties.

18. The hypothesis test and the confidence interval gave us the same conclusion. However, the confidence interval gives us more information. It tells us just how better he was against righties (between.043 and.217 batting average points).

19. Was Hamilton a better hitter at home than on the road? His home PERFORMANCE was.390. His road PERFORMANCE was.327. A 95% confidence interval for the true difference in his ABILITY to get a hit at home and his ABILITY to get a hit on the road is -0.021 to.063. This interval includes the value 0, so it is possible there is no difference in his ABILITY.

20. The Structure of Confidence Intervals Confidence intervals contain two components: – 1) A single-value estimate (a single number that represents our best guess for an athlete’s ABILITY) – 2) A margin of error (value that is added and subtracted from the single-value estimate) A confidence interval is:

21. A 95% confidence interval for LeBron James’s ABILITY to make a three-point shot in the 2007- 2008 regular season is: This means that the interval goes from 0.266 to 0.364. Interpretation: We are 95% confident that the interval of plausible values from 0.266 to 0.364 contains LeBron’s ABILITY to make a three-point shot in the 2007-2008 regular season.

23. The single-value estimate of 0.315 is LeBron’s observed three-point shooting percentage in the 2007-2008 regular season (his PERFORMANCE during the season). His observed PERFORMANCE is certainly our best guess for his true ABILITY. However, it’s likely incorrect due to RANDOM CHANCE being involved. To compensate for RANDOM CHANCE, we include the margin of error.

24. Keep in mind we are making a 95% confidence interval. Let’s think about a Normal distribution for a minute. What do we know about 95% of the data in a Normal distribution? – 95% of the data is within two standard deviations of the mean. Therefore, to calculate the margin of error, we need to estimate the standard deviation, and multiply that value by 2.

25. For our purposes, we’ll use a formula to estimate the standard deviation. However, the formula for standard deviation changes based on the quantity we are trying to estimate. – For example, the formula to estimate the standard deviation for LeBron’s ABILITY to make a three- pointer is different from the formula for estimating the difference in ABILITY to make a three-point shot when playing at home and when playing on the road.

26. Calculating a Confidence Interval for a Proportion Let’s say we want to estimate LeBron’s ABILITY to make a three-point shot. We would have to try and estimate the proportion of three-point shots that he would make if he could keep shooting three-pointers indefinitely under the same conditions as in the 2007-2008 regular season.

27. Notation and Formula

29. In the 2007-2008 regular season, James made 113 out of 359 three-point shots. Therefore, we now know our variables.

31. From the previous slide, we can see our confidence interval goes from 0.266 to 0.364. Thus, we are 95% confident that the interval of plausible values from 0.266 to 0.364 contains LeBron’s ABILITY to make a three- pointer during the 2007-2008 season.

32. Keep in mind that this formula will only work when we are estimating ABILITY with a single proportion (think categorical variables: Ch 2). It will not work for estimating ABILITY that is measured by a mean or even a difference in proportions. Also, for the formula you must use the proportion (decimal) equivalent for the PERFORMANCE; not the percent equivalent. Note: there must be at least 15 successes and 15 failures to use this interval. Since this is so much fun, let’s try some more!

33. In the first two games of the 2009-2010 regular season, Kobe Bryant had made 17 of 45 shot attempts. Calculate a 95% confidence interval for Kobe’s ABILITY to make a shot in the 2009-2010 regular season.

34. We are 95% confident that the interval of plausible values from 0.233 to 0.523 contains Kobe’s ABILITY to make a shot during the 2009-2010 regular season. For this interval we only used Kobe’s PERFORMANCES for two games. What do you think would happen to the width of the interval if we used Kobe’s PERFORMANCES from the entire season? Would the interval get wider or narrower?

35. For the entire season, Kobe made 716 of 1569 shot attempts. Calculate a new 95% confidence interval.

36. When using n=45, our interval went from 0.233 to 0.523. When using n=1569, our interval went from 0.431 to 0.481. The margin of error will be smaller when the interval is calculated using a larger number of observations. Increasing sample size decreases variability, resulting in a more precise interval.

37. Calculating a Confidence Interval for a Mean In the previous section, we used categorical data to create a confidence interval. We can also use numerical data to create confidence intervals for a player’s ABILITY. One of the most common numerical measures of ABILITY in basketball is scoring average, or mean points per game.

38. Notation and Formula

40. Keep in mind that just as with calculating a 95% confidence interval for a proportion, we want to have a large enough sample size in order for our “95% confidence” to be accurate. Generally speaking, a sample size of at least 30 is recommended, especially for a distribution that is not Normal.

41. Let’s create a confidence interval for LeBron’s ABILITY to score points in 2007-2008 regular season. During the regular season, he scored 2250 points in 75 games. That’s an average of 30.0 points per game. This is our best estimate at his ABILITY. His observed standard deviation was 8.04 points. We now have all the information we need.

42. We are 95% confident that the interval of plausible values from 28.14 points per game to 31.86 points per game contains LeBron James’s ABILITY to score points in the 2007- 2008 regular season.

43. Let’s try another. Here are the rushing totals (in yards) for each game of the 1985-1986 NFL season for running back Walter Payton, of the Chicago Bears. 1203962663132112118 1921071321021211115381 Calculate a 95% confidence interval for Payton’s rushing ABILITY in the 1985-1986 regular season. We need to calculate our mean and standard deviation.

44. 1203962663132112118 1921071321021211115381 Create a list to calculate the mean and st. dev.

45. We are 95% confident that the interval of plausible values from 74.6 to 119.2 yards contains Payton’s rushing ABILITY in the 1985- 1986 regular season.

46. Confidence Intervals for Difference of Two Proportions We will create a confidence interval for a difference in two proportions when 1) we are using categorical data and 2) we are interested in comparing an athlete’s ABILITY in two different contexts (examples: home vs road; day vs night; grass vs turf).

48. 95% Confidence Interval Formula Note: As with confidence intervals for a single proportion, this formula will only work if we have at least 15 successes and 15 failures in each setting.

49. In football, does “icing the kicker” really work? From 2000 to 2009, kickers in the NFL made 377 of 488 field goal attempts (77.3%) without a timeout being called before the attempt (without being iced). This compares to kickers making 157 of 197 field goal attempts (79.7%) after being iced. Based on these numbers, it looks like icing the kicker might actually be a bad strategy.

50. Let’s construct a 95% confidence interval for the true difference in the ABILITY of kickers to make a field goal when they are iced and when they are not. Let’s first determine our values. Instead of using “A” and “B”, I’ll use “I” for iced and “N” for not iced.

52. We are 95% confident that the interval of plausible values from -0.045 to 0.093 includes the true difference in the ABILITY of kickers to make a field goal when iced and their ABILITY to make a field goal when not iced. The negative value would indicate that kickers have a lower ABILITY when iced. So this interval means the true success rate for iced kickers could be lower by up to 0.045 or higher by up to 0.093. You could have reversed the order of subtraction when constructing the interval. If you did, the interval would have went from -0.093 to 0.045, but the interpretation would be the same.

53. Let’s try creating another interval. In the 2009 regular season, first baseman and left-handed hitter Ryan Howard of the Philadelphia Phillies had 126 hits in 394 at- bats when facing a right-handed pitcher and only 46 hits in 222 at-bats when facing a left- handed pitcher. Calculate a 95% confidence interval for the difference in Howard’s ABILITY to get a hit against a right-handed pitcher and his ABILITY to get a hit against a left-handed pitcher.

54. Let’s determine our values. Remember, Howard has 126 hits in 394 at-bats when facing a right-handed pitcher and only 46 hits in 222 at-bats when facing a left-handed pitcher.

56. We are 95% confident that the interval of plausible values from 0.041 to 0.185 contains the true difference in Howard’s ABILITY to get a hit against right-handed pitchers and his ABILITY to get a hit against left-handed pitchers.

57. Confidence Intervals for the Difference of Two Means We will create a confidence interval for the difference in two means when 1) we are using numerical data and 2) we are interested in comparing an athlete’s ABILITY in two different contexts (examples: home vs road; day vs night; grass vs turf). The difference with confidence intervals for two proportions is that they deal with categorical data.

59. 95% Confidence Interval Formula Note: We need both sample sizes to be large enough for the 95% to be accurate. Samples are considered large if they each have 30 or more observations.

60. In the modern NFL, the passing game rules. But was this always the case? Let’s comparing using data from 2009 and 1979. In 2009, the mean passing PERFORMANCE of the 32 NFL teams was 218.5 yards, with a standard deviation of 44.1 yards. In 1979, the mean passing PERFORMANCE of the 28 NFL teams was 180.4 yards, with a standard deviation of 35.7 yards.

62. We are 95% confident that the interval of plausible values from 17.5 to 58.7 contains the true difference in passing ABILITY for NFL teams in 2009 and 1979. Because all of the plausible values are greater than 0, we have convincing evidence that teams in 2009 have a greater ABILITY to pass than did the teams in 1979.

63. Let’s try another. Here are the points allowed by the New England Patriots in their 2009 regular season games at home and on the road: Home: 24102101714107 Away: 162073538221034 Calculate and interpret a 95% confidence interval for the difference in the Patriots’ ABILITY to play defense at home and their ABILITY to play defense on the road.

64. Let’s get our numbers. Again, here is the distribution: Home: 24102101714107 Away: 162073538221034

66. We are 95% confident that the interval of plausible values from -19.869 to 0.119 includes the true difference in the Patriots’ ABILITY to play defense at home and their ABILITY to play defense on the road.

67. Using Technology to Calculate Confidence Intervals The TI-84 calculator can calculate confidence intervals for us. Let’s look at how we can do this. Note: Confidence intervals calculated with technology will be slightly different from confidence intervals calculated by hand due to technology being more precise.

68. Confidence Interval for a Proportion Let’s use Josh Hamilton’s numbers in 2010 for our example: – 186 hits in 518 at-bats 1)Press STAT, scroll to TESTS, choose A: 1-PropZInt 2)Enter the number of successful PERFORMANCES for “x”, the total number of attempts for “n”, and the desired confidence level for “C-level”. 3)Press calculate

69. Confidence Interval for Mean Let’s use Walter Payton’s numbers from a previous example. We have to enter the data into a list. 1203962663132112118 1921071321021211115381 1)Press STAT, scroll to TESTS, choose 8: Tinterval. 2)Inpt: Data, select the list, freq: 1, C-Level:.95 (if you have the mean and st. dev., choose Stats instead of Data). Then press calculate.

70. Confidence Interval for a Difference in Proportions Hamilton vs righties: 141 hits in 352 at-bats Hamilton vs lefties: 45 hits in 166 at-bats 1)Press STAT, scroll to TESTS, choose B: 2-PropZInt 2)Enter the first context data for x1 and n1, and the second context data for x2 and n2. 3)Press calculate.

71. Confidence Interval for a Difference in Means 1)Enter data sets into two lists. 2) Press STAT, scroll to TESTS, choose 0: 2-SampTInt 3) Choose Data, select the lists, make sure both Freq are 1, choose “No” for pooled data. 4) Press Calculate