Presentation is loading. Please wait.

Presentation is loading. Please wait.

1/71 Statistics Tests of Goodness of Fit and Independence.

Similar presentations


Presentation on theme: "1/71 Statistics Tests of Goodness of Fit and Independence."— Presentation transcript:

1 1/71 Statistics Tests of Goodness of Fit and Independence

2 2/71 Contents STATISTICS in PRACTICE Goodness of Fit Test: A Multinomial Population Test of Independence Goodness of Fit Test: Poisson and Normal Distributions

3 3/71 STATISTICS in PRACTICE United Way of Greater Rochester is a nonprofit organization dedicated to improving the quality of life for people. Because of enormous volunteer involvement, United Way of Greater Rochester is able to hold its operating costs at just eight cents of every dollar raised.

4 4/71 STATISTICS in PRACTICE One of statistical tests was to determine whether perceptions of administrative expenses were independent of occupation. In this chapter, you will learn how a statistical test of independence.

5 5/71 Hypothesis (Goodness of Fit) Test for Proportions of a Multinomial Population Consider the case that each element of a population is assigned to one and only one of several classes or categories. Such a population is a multinomial population( 多項母體 ). We want to test if the population follows a multinominal distribution with specified probabilities for each of the k categories.

6 6/71 Hypothesis Test for Proportions of a Multinomial Population-- Procedures 1.Set up the null and alternative hypotheses. 2.Select a random sample and record the observed frequency, f i, for each of the k categories. 3.Assuming H 0 is true, compute the expected frequency, e i, in each category by multiplying the category probability by the sample size.

7 7/71 4. Compute the value of the test statistic. f i = observed frequency for category i e i = expected frequency for category i k = number of categories where: Hypothesis Test for Proportions of a Multinomial Population-- Procedures Note: The test statistic has a chi-square distribution with (k – 1) df provided that the expected frequencies are 5 or more for all categories.

8 8/71 where  is the significance level and there are k - 1 degrees of freedom p-value approach : Critical value approach: Reject H 0 if p -value <  5. Rejection rule: Reject H 0 if Hypothesis Test for Proportions of a Multinomial Population-- Procedures

9 9/71 Hypothesis (Goodness of Fit) Test for Proportions of a Multinomial Population Example: The market share study being conducted by Scott Marketing Research. Over the past year market shares stabilized at 30% for company A, 50% for company B, and 20% for company C. Recently company C developed a “new and improved” product to replace its current entry in the market. Company C retained Scott Marketing Research to determine whether the new product will alter market shares.

10 10/71 Hypothesis (Goodness of Fit) Test for Proportions of a Multinomial Population Scott Marketing Research conduct a sample survey and compute the proportion preferring each company’s product. A hypothesis test will then be conducted to see whether the new product caused a change in market shares. The null and alternative hypotheses are

11 11/71 Hypothesis (Goodness of Fit) Test for Proportions of a Multinomial Population Perform a goodness of fit test that will determine whether the sample of 200 customer purchase preferences is consistent with the null hypothesis. Data

12 12/71 Hypothesis (Goodness of Fit) Test for Proportions of a Multinomial Population Expected: the expected frequency for each category is found by multiplying the sample size of 200 by the hypothesized proportion for the category.

13 13/71 Hypothesis (Goodness of Fit) Test for Proportions of a Multinomial Population Computation of the Chi-square Test Statistic for The Scott Marketing Research Market Share Study

14 14/71 Hypothesis (Goodness of Fit) Test for Proportions of a Multinomial Population p-Value Approach The test statistic χ 2 = 7.34 and 5.991 < 7.34 < 7.378. Thus, the corresponding upper tail area or p-value must be between.05 and.025. with p-value <.05, we reject H 0. Minitab or Excel can be used to show χ 2 = 7.34 provides a p-value =.0255.

15 15/71 Hypothesis (Goodness of Fit) Test for Proportions of a Multinomial Population Critical Value Approach With α =.05 and 2 degrees of freedom, the critical value for the test statistic is = 5.991. The upper tail rejection rule becomes Reject H 0 if χ 2 > 5.991 With 7.34 > 5.991, we reject H 0. Comparisons of the observed and expected frequencies for the other two companies indicate that company C’s gain in market share will hurt company A more than company B.

16 16/71 Hypothesis (Goodness of Fit) Test for Proportions of a Multinomial Population Note: The chi-square test is an approximate test and the test result may not be valid when the expected value for a category is less than 5. If one or more categories have expected values less than 5, you can combine them with adjacent categories to achieve the minimum required expected value.

17 17/71 Multinomial Distribution Goodness of Fit Test Example: Finger Lakes Homes (A) Finger Lakes Homes manufactures four models of prefabricated homes, a two-story colonial, a log cabin, a split-level, and an A-frame. To help in production planning, management would like to determine if previous customer purchases indicate that there is a preference in the style selected.

18 18/71 Split- A- Split- A- Model Colonial Log Level Frame # Sold 30 20 35 15 The number of homes sold of each model for 100 sales over the past two years is shown below. Multinomial Distribution Goodness of Fit Test Example: Finger Lakes Homes (A)

19 19/71 Hypotheses Multinomial Distribution Goodness of Fit Test where: p C = population proportion that purchase a colonial p L = population proportion that purchase a log cabin p S = population proportion that purchase a split-level p A = population proportion that purchase an A-frame H 0 : p C = p L = p S = p A =.25 H a : The population proportions are not p C =.25, p L =.25, p S =.25, and p A =.25 p C =.25, p L =.25, p S =.25, and p A =.25

20 20/71 Rejection Rule χ2χ2 χ2χ2 7.815 Do Not Reject H 0 Reject H 0 With  =.05 and k - 1 = 4 - 1 = 3 k - 1 = 4 - 1 = 3 degrees of freedom degrees of freedom if p-value 7.815. Reject H 0 if p-value 7.815. Multinomial Distribution Goodness of Fit Test

21 21/71 Expected Frequencies Test Statistic Multinomial Distribution Goodness of Fit Test e 1 =.25(100) = 25 e 2 =.25(100) = 25 e 3 =.25(100) = 25 e 4 =.25(100) = 25 e 3 =.25(100) = 25 e 4 =.25(100) = 25 = 1 + 1 + 4 + 4 = 10

22 22/71 Multinomial Distribution Goodness of Fit Test Conclusion Using the p-Value Approach The p-value < . We can reject the null hypothesis. Because χ 2 = 10 is between 9.348 and 11.345, the area in the upper tail of the distribution is between.025 and.01. Area in Upper Tail.10.05.025.01.005  2 Value (df = 3) 6.251 7.815 9.348 11.345 12.838

23 23/71 Conclusion Using the Critical Value Approach Multinomial Distribution Goodness of Fit Test We reject, at the.05 level of significance, the assumption that there is no home style preference. χ 2 = 10 > 7.815

24 24/71 Test of Independence: Contingency Tables( 列聯表) Another important application of the chi- square distribution involves using sample data to test for the independence of two variables. Contingency table is a table that lists all possible combinations of the two variables.

25 25/71 Test of Independence: Contingency Tables Example: A test of independence addresses the question of whether the beer preference (light, regular, or dark) is independent of the gender of the beer drinker (male, female). If the independence assumption is valid, we argue that the fraction of drinking light beer, regular beer and dark beer must be applicable to both male and female beer drinker.

26 26/71 Test of Independence: Contingency Tables 1.Set up the null and alternative hypotheses. 2.Select a random sample and record the observed frequency, f ij, for each cell of the contingency table. 3. Compute the expected frequency, e ij, for each cell.

27 27/71 5. Determine the rejection rule. Reject H 0 if p -value <  or. 4. Compute the test statistic. where  is the significance level and, with n rows and m columns, there are ( n - 1)( m - 1) degrees of freedom. Test of Independence: Contingency Tables

28 28/71 Test of Independence: Contingency Tables Example: A test of independence addresses the question of whether the beer preference (light, regular, or dark) is independent of the gender of the beer drinker (male, female). The hypotheses for this test of independence are: H 0 : Beer preference is independent of the gender of the beer drinker H a : Beer preference is not independent of the gender of the beer drinker

29 29/71 Sample Results Expected Frequencies Test of Independence: Contingency Tables 1/3 7/151/5 1 80*1/3=26.67

30 30/71 Test of Independence: Contingency Tables

31 31/71 Computation of the Chi-square Test Statistic p-value =.0468. At the.05 level of significance, p-value < α=.05. We reject the null hypothesis Test of Independence: Contingency Tables

32 32/71 Each home sold by Finger Lakes Homes can be classified according to price and to style. Finger Lakes’manager would like to determine if the price of the home and the style of the home are independent variables. Example: Finger Lakes Homes (B) Test of Independence: Contingency Tables

33 33/71 The number of homes sold for each model and price for the past two years is shown below. For convenience, the price of the home is listed as either $99,000 or less or more than $99,000. Price Colonial Log Split-Level A-Frame Price Colonial Log Split-Level A-Frame > $99,000 12 14 16 3 < $99,000 18 6 19 12 Example: Finger Lakes Homes (B) Test of Independence: Contingency Tables

34 34/71 Hypotheses H 0 : Price of the home is independent of the style of the home that is purchased style of the home that is purchased H a : Price of the home is not independent of the style of the home that is purchased style of the home that is purchased Test of Independence: Contingency Tables

35 35/71 Expected Frequencies Price Colonial Log Split-Level A-Frame Total Price Colonial Log Split-Level A-Frame Total < $99K > $99K Total Total 30 20 35 15 100 12 14 16 3 45 18 6 19 12 55 Test of Independence: Contingency Tables

36 36/71 Contingency Table (Independence) Test Rejection Rule Reject H 0 if p-value 7.815 Test Statistic With α =.05 and (2 - 1)(4 - 1) = 3 d.f., =7.815 =.1364 + 2.2727 +... + 2.0833 = 9.149

37 37/71 Conclusion Using the p-Value Approach The p-valu e < . We can reject the null hypothesis. Because χ 2 = 9.145 is between 7.815 and 9.348, the area in the upper tail of the distribution is between.05 and.025. Area in Upper Tail.10.05.025.01.005  2 Value (df = 3) 6.251 7.815 9.348 11.345 12.838 Contingency Table (Independence) Test

38 38/71 Conclusion Using the Critical Value Approach We reject, at the.05 level of significance, We reject, at the.05 level of significance, the assumption that the price of the home is independent of the style of home that is purchased. χ 2 = 9.145 > 7.815 Contingency Table (Independence) Test

39 39/71 Goodness of Fit Test: Poisson Distribution In general, the goodness of fit test can be used with any hypothesized probability distribution. Here we will demonstrate the cases of Poisson distribution and Normal distribution.

40 40/71 Goodness of Fit Test: Poisson Distribution 1. Set up the null and alternative hypotheses. H 0 : Population has a Poisson probability distribution H a : Population does not have a Poisson distribution 2. Select a random sample and a. Record the observed frequency f i for each value of the Poisson random variable. b. Compute the mean number of occurrences .

41 41/71 Goodness of Fit Test: Poisson Distribution 3. Compute the expected frequency of occurrences e i for each value of the Poisson random variable. 4. Compute the value of the test statistic. f i = observed frequency for category i e i = expected frequency for category i k = number of categories where:

42 42/71 where  is the significance level and there are k - 2 degrees of freedom p-value approach: Critical value approach: Reject H 0 if p -value <  5. Rejection rule: Reject H 0 if Goodness of Fit Test: Poisson Distribution

43 43/71 Goodness of Fit Test: Poisson Distribution—Example Consider the arrival of customers at Dubek’s Food Market in Tallahassee, Florida. A statistical test conducted to see whether an assumption of a Poisson distribution for arrivals is reasonable.

44 44/71 Goodness of Fit Test: Poisson Distribution—Example Hypotheses are H 0 : The number of customers entering the store during 5-minute intervals has a Poisson probability distribution H a : The number of customers entering the store during 5-minute intervals does not have a Poisson distribution

45 45/71 Goodness of Fit Test: Poisson Distribution—Example The Poisson probability function, where --μ represents the expected number of customers arriving per 5-minute period, --x is the random variable indicating the number of customers arriving during a 5-minute period, and --f (x) is the probability that x customers will arrive in a 5-minute interval.

46 46/71 Goodness of Fit Test: Poisson Distribution—Example Sample Data μ known, an estimate of μ is 640/128 = 5 customers

47 47/71 Goodness of Fit Test: Poisson Distribution—Example Expected frequency

48 48/71 Goodness of Fit Test: Poisson Distribution—Example Computation of the Chi-square Test Statistic p-value =.1403. With p-value > α =.05, we cannot reject H 0.

49 49/71 Example: Troy Parking Garage In studying the need for an additional entrance to a city parking garage, a consultant has recommended an analysis approach that is applicable only in situations where the number of cars entering during a specified time period follows a Poisson distribution. Goodness of Fit Test: Poisson Distribution

50 50/71 A random sample of 100 one-minute time intervals resulted in the customer arrivals listed below. A statistical test must be conducted to see if the assumption of a Poisson distribution is reasonable. Goodness of Fit Test: Poisson Distribution # Arrivals 0 1 2 3 4 5 6 7 8 9 10 11 12 Frequency 0 1 4 10 14 20 12 12 9 8 6 3 1

51 51/71 Hypotheses Goodness of Fit Test: Poisson Distribution H a : Number of cars entering the garage during a one-minute interval is not Poisson distributed H 0 : Number of cars entering the garage during a one-minute interval is Poisson distributed

52 52/71 Estimate of Poisson Probability Function Goodness of Fit Test: Poisson Distribution  otal Arrivals = 0(0) + 1(1) + 2(4) +... + 12(1) = 600 Hence, Estimate of  = 600/100 = 6 Total Time Periods = 100

53 53/71 Expected Frequencies Goodness of Fit Test: Poisson Distribution x f ( x ) nf ( x ) 0123456 13.77 13.77 10.33 10.33 6.88 6.88 4.13 4.13 2.25 2.25 2.01 2.01100.00.1377.1377.1033.1033.0688.0688.0413.0413.0225.0225.0201.02011.0000 7 8 9 10 10 11 11 12+ 12+Total.0025.0149.0446.0892.1339.1606.1606.25.25 1.49 1.49 4.46 4.46 8.92 8.9213.3916.0616.06 x f ( x ) nf ( x )

54 54/71 Observed and Expected Frequencies Goodness of Fit Test: Poisson Distribution i f i e i f i - e i i f i e i f i - e i -1.20 1.08 1.08 0.61 0.61 3.94 3.94-4.06-1.77-1.33 1.12 1.12 1.61 1.61 6.20 6.20 8.92 8.9213.3916.0616.0613.7710.33 6.88 6.88 8.39 8.39 51014201212 9 810 0 or 1 or 2 3 4 5 6 7 8 9 10 or more

55 55/71 Test Statistic Goodness of Fit Test: Poisson Distribution Reject H 0 if p-value 14.067. Rejection Rule With  =.05 and k - p - 1 = 9 - 1 - 1 = 7 d.f. (where k = number of categories and p = number of population parameters estimated),

56 56/71 Conclusion Using the p-Value Approach The p-value > . We cannot reject the null hypothesis. There is no reason to doubt the assumption of a Poisson distribution. Because χ 2 = 3.268 is between 2.833 and 12.017 in the Chi-Square Distribution Table, the area in the upper tail of the distribution is between.90 and.10. Area in Upper Tail.90.10.05.025.01  2 Value (df = 7) 2.833 12.017 14.067 16.013 18.475 Goodness of Fit Test: Poisson Distribution

57 57/71 Goodness of Fit Test: Normal Distribution 1. Set up the null and alternative hypotheses. 3. Compute the expected frequency, e i, for each interval. 2. Select a random sample and a. Compute the mean and standard deviation. b. Define intervals of values so that the expected frequency is at least 5 for each interval. c. For each interval record the observed frequencies

58 58/71 4. Compute the value of the test statistic. Goodness of Fit Test: Normal Distribution 5. Reject H 0 if (where  is the significance level and there are k - 3 degrees of freedom).

59 59/71 Goodness of Fit Test: Normal Distribution--Example Chemline Employee Aptitude Scores To test the null hypothesis that the population of test scores has a normal distribution. Sample Data

60 60/71 Goodness of Fit Test: Normal Distribution—Example Estimates of μ and are = 68.42, s = 10.41. Hypotheses H 0 : The population of test scores has a normal distribution with mean 68.42 and standard deviation 10.41. H a : The population of test scores does not have a normal distribution with mean 68.42 and standard deviation 10.41 

61 61/71 Goodness of Fit Test: Normal Distribution—Example Expected Frequency Normal Distribution with 10 Equal- Probability Intervals (The Chemiline Example) Note: 55.10 = 68.42 - 1.28(10.41)

62 62/71 Goodness of Fit Test: Normal Distribution—Example

63 63/71 Goodness of Fit Test: Normal Distribution—Example Computation of the Chi-square Test Statistic p-value =.4084 >α =.10. Cannot reject H 0.

64 64/71 Normal Distribution Goodness of Fit Test Example: IQ Computers IQIQ IQ Computers (one better than HP?) manufactures and sells a general purpose microcomputer. As part of a study to evaluate sales personnel, management wants to determine, at a.05 significance level, if the annual sales volume (number of units sold by a salesperson) follows a normal probability distribution.

65 65/71 A simple random sample of 30 of the salespeople was taken and their numbers of units sold are below. Normal Distribution Goodness of Fit Test Example: IQ Computers (mean = 71, standard deviation = 18.54) 33 43 44 45 52 52 56 58 63 64 64 65 66 68 70 72 73 73 74 75 83 84 85 86 91 92 94 98 102 105 IQIQ

66 66/71 Hypotheses Normal Distribution Goodness of Fit Test H a : The population of number of units sold does not have a normal distribution with mean 71 and standard deviation 18.54. H 0 : The population of number of units sold has a normal distribution with mean 71 and standard deviation 18.54.

67 67/71 Interval Definition Normal Distribution Goodness of Fit Test To satisfy the requirement of an expected frequency of at least 5 in each interval we will divide the normal distribution into 30/5 = 6 equal probability intervals.

68 68/71 Interval Definition Areas = 1.00/6 =.1667 Areas = 1.00/6 =.1667 71 53.02 71 .43(18.54) = 63.03 78.97 88.98 = 71 +.97(18.54) Normal Distribution Goodness of Fit Test

69 69/71 Observed and Expected Frequencies Normal Distribution Goodness of Fit Test 1-2 1 0 1 5 5 5 5 5 530 6 3 6 5 4 630 Less than 53.02 53.02 to 63.03 53.02 to 63.03 63.03 to 71.00 63.03 to 71.00 71.00 to 78.97 71.00 to 78.97 78.97 to 88.98 78.97 to 88.98 More than 88.98 i f i e i f i - e i i f i e i f i - e iTotal

70 70/71 Test Statistic Reject H 0 if p-value 7.815. Rejection Rule Normal Distribution Goodness of Fit Test With  =.05 and k - p - 1 = 6 - 2 - 1 = 3 d.f. (where k = number of categories and p = number of population parameters estimated),

71 71/71 Normal Distribution Goodness of Fit Test Conclusion Using the p-Value Approach Because χ 2 = 1.600 is between.584 and 6.251 in the Chi- Square Distribution Table, the area in the upper tail of the distribution is between.90 and.10. The p-value > . We cannot reject the null hypothesis. There is little evidence to support rejecting the assumption the population is normally distributed with  = 71 and  = 18.54. Area in Upper Tail.90.10.05.025.01  2 Value (df = 3).584 6.251 7.815 9.348 11.345


Download ppt "1/71 Statistics Tests of Goodness of Fit and Independence."

Similar presentations


Ads by Google