Presentation on theme: "Visual EDF Software to Check the Normality Assumption Dr. Maria E. Calzada Dr. Stephen M. Scariano Loyola University New Orleans"— Presentation transcript:
Visual EDF Software to Check the Normality Assumption Dr. Maria E. Calzada Dr. Stephen M. Scariano Loyola University New Orleans Calzada@loyno.edu http://www.loyno.edu/~calzada
Problem 7.11 of Moore’s the Basic Practice of Statistics reads (paraphrased): Our subjects are 11 people diagnosed as being dependent on caffeine. Each subject was barred from coffee, colas, and other substances containing caffeine. Instead they took capsules containing their normal caffeine intake. During a different time period, they took placebo capsules… Table 7.3 contains data on two of several tests given to the subjects. “Depression” is the score of the Beck Depression inventory. Higher scores show more symptoms of depression. “Beats” is the beats per minute the subject achieved when asked to press a button 200 times as quickly as possible. We are interested in whether being deprived of caffeine affects these outcomes.
Does this matched pairs study give evidence that being deprived of caffeine raises depression scores? Check that the differences are not strikingly nonnormal. Now check the differences in beats per minute with and without caffeine. You should hesitate to use the t procedures on these data. Why?
Histogram of the difference in depression scores, as given by SPSS. Are these data normal?
Histogram of the difference in Beats score. Are these data normal?
Normal probability plot for difference in depression data
Normal probability plot for difference in beats data
While slight departures from normality are usually inconsequential, substantive departures from normality can seriously impair the validity of statistical procedures framed under the “Normality Assumption.” The problem is: How can we help our students distinguish between “slight departures” and “substantive departures” from normality.
EDF TESTS FOR NORMALITY We have written a Visual Basic Program that implements the Lilliefors test for normality and the Anderson-Darling Test for normality. We like the visual aspects of the Lilliefors test. We like the power of the Anderson-Darling Test.
Lilliefors Test We compute the distances between the data’s Empirical Distribution Function and the Cumulative Standard Normal Distribution. If these distances are “not too large” we do not have evidence to reject the “Normality Assumption.” Upper- percentiles for the largest distance have been tabulated using Monte-Carlo Simulations.
Conclusions The Anderson-Darling and Lilliefors tests are important tools that should be routinely used alongside probability plots to check the normality assumption. The stand-alone desktop program enhances the craft of exploratory data analysis. Program is available for downloading at http://www.loyno.edu/~calzada http://www.loyno.edu/~calzada
Some References David S. Moore. The Basic Practice of Statistics, Second Edition. Freeman, 2000. H. Lilliefors(1969). “On the Kolmogorov- Smirnov Test for Normality with Mean and Variance Unknown.” Journal of the American Statistical Association 64, pp. 387-389. M. A. Stephens (1974). “EDF Statistics for Goodness of Fit and Some Comparisons.” Journal of the American Statistical Association 69, pp. 730-737.