1. Stat 112 Notes 23

2. Quiz 4 Info 4 double sided sheets of notes Covers interactions, models with categorical variables and interactions, one way analysis of variance and two way analysis of variance. I will e-mail Homework 6 solutions tonight. I will post solutions to practice quiz problems tonight. Office hours: usual office hours today, after class; extra office hours, Wed., 8:45-9:45. Cristina will hold office hours, Wed. 2-3.

3. Analysis of Variance Terminology Analysis of variance is generally concerned with comparing the means of different groups and is a special case of regression in which all the explanatory variables are categorical variables. The criterion (criteria) by which we classify the groups in analysis of variance is called a factor. In one-way analysis of variance, we have one factor. The possible values of the factor are levels. Milgram’s study: Factor is experimental condition with levels remote, voice-feedback, proximity and touch- proximity. Two-way analysis of variance: Groups are classified by two factors.

4. Two-way Analysis of Variance Examples Milgram’s study: In thinking about the Obedience to Authority study, many people have thought that women would react differently than men. Two-way analysis of variance setup in which the two factors are experimental condition (levels remote, voice-feedback, proximity, touch-proximity) and sex (levels male, female). Package Design Experiment: Several new types of cereal packages were designed. Two colors and two styles of lettering were considering. Each combination of lettering/color was used to produce a package, and each of these combinations was test marketed in 12 comparable stores and sales in the stores were recorded.. Two-way analysis of variance in which two factors are color (levels red, green) and lettering (levels block, script). Goal of two-way analysis of variance: Find out how the mean response in a group depends on the levels of both factors and find the best combination.

5. Two-way Analysis of Variance The mean of the group with the ith level of factor 1 and the jth level of factor 2 is denoted, e.g., in package-design experiment, the four group means are As with one-way analysis of variance, two-way analysis of variance can be seen as a a special case of multiple regression. For two-way analysis of variance, we have two categorical explanatory variables for the two factors and also include an interaction between the factors.

6. Two-way ANOVA in JMP Use Analyze, Fit Model with a categorical variable for the first factor, a categorical variable for the second factor and an interaction variable that crosses the first factor and the second factor. The LS Means Plots (which show how the means of the groups vary as the levels of the factor vary) are produced by going to the output in JMP for each variable that is to the right of the main output, clicking the red triangle next to each variable (for package design, the vairables are Color, TypeStyle, Typestyle*Color) and clicking LS Means Plot.

7. Estimated Mean for Red Block group = 144.92+9.83-11.17+4.5 = 148.08 Estimated Mean for Red Script group = 144.92+9.83+11.17-4.5= 161.42

8. The LS Means Plots show how the means of the groups vary as the levels of the factors vary. For the top plot for color, green refers to the mean of the two green groups (green block and green script) and red refers to the mean of the two red groups (red block and red script). Similarly for the second plot for TypeStyle, block refers to the mean of the two block groups (red block and green block). The third plot for TypeStyle*Color shows the mean of all four groups.

9. Interaction in Two-Way ANOVA Interaction between two factors: The impact of one factor on the response depends on the level of the other factor. For package design experiment, there would be an interaction between color and typestyle if the impact of color on sales depended on the level of typestyle. Formally, there is an interaction if LS Means Plot suggests there is not much interaction. Impact of changing color from red to green on mean sales is about the same when the typestyle is block as when the typestyle is script.

10. Effect Test for Interaction A formal test of the null hypothesis that there is no interaction, for all levels i,j,i’,j’ of factors 1 and 2, versus the alternative hypothesis that there is an interaction is given by the Effect Test for the interaction variable (here Typestyle*Color). p-value for Effect Test = 0.4191. No evidence of an interaction.

11. Implications of No Interaction When there is no interaction, the two factors can be looked in isolation, one at a time. When there is no interaction, best group is determined by finding best level of factor 1 and best level of factor 2 separately. For package design experiment, suppose there are two separate groups: one with an expertise in lettering and the other with expertise in coloring. If there is no interaction, groups can work independently to decide best letter and color. If there is an interaction, groups need to get together to decide on best combination of letter and color.

12. Model when There is No Interaction When there is no evidence of an interaction, we can drop the interaction term from the model for parsimony and more accurate estimates: Mean for red block group = 144.92+9.83-11.17=143.58 Mean for red script group = 144.92+9.83+11.17=165.92

13. Tests for Main Effects When There is No Interaction Effect test for color: Tests null hypothesis that group mean does not depend on color versus alternative that group mean is different for at least two levels of color. p-value =0.0804, moderate but not strong evidence that group mean depends on color. Effect test for TypeStyle: Tests null hypothesis that group mean does not depend on TypeStyle versus alternative that group mean is different for at least two levels of TypeStyle. p-value = 0.0481, evidence that group mean depends on TypeStyle. These are called tests for “main effects.” These tests only make sense when there is no interaction.

14. Example with an Interaction Should the clerical employees of a large insurance company be switched to a four-day week, allowed to use flextime schedules or kept to the usual 9-to-5 workday? The data set flextime.JMP contains percentage efficiency gains over a four week trial period for employees grouped by two factors: Department (Claims, Data Processing, Investment) and Condition (Flextime, Four-day week, Regular Hours).

15. Which schedule is best appears to differ by department. Four day is best for investment employees, but worst for data processing employees.

16. Which Combinations Works Best? For which pairs of groups is there strong evidence that the groups have different means – is there strong evidence that one combination works best? Click the Red Triangle next to the interaction (Department*Condition), above the interaction’s leverage plot. Then click LSMeans Tukey HSD. This compares the different groups pairwise, adjusting for multiple comparisons.

18. Checking Assumptions As with one-way ANOVA, two-way ANOVA is a special case of multiple regression and relies on the assumptions: –Linearity: Automatically satisfied –Constant variance: Spread within groups is the same for all groups. –Normality: Distribution within each group is normal. To check assumptions, combine two factors into one factor (Combination) and check assumptions as in one-way ANOVA.

19. Checking Assumptions Check for constant variance: (Largest standard deviation of group/Smallest standard deviation of group) =(44.85/33.51) <2. Constant variance OK. Check for normality: Look at normal quantile plots for each combination (not shown). For all normal quantile plots, the points fall within the 95% confidence bands. Normality assumption OK.

20. Two way Analysis of Variance: Steps in Analysis 1.Check assumptions (constant variance, normality, independence). If constant variance is violated, try transformations. 2.Use the effect test (commonly called the F-test) to test whether there is an interaction. 3.If there is no interaction, use the main effect tests to test whether each factor has an effect. The different levels of a factor can be compared in a way that accounts for multiple comparisions by clicking on the red triangle next to the factor and clicking LS Means Tukey HSD. 4.If there is an interaction, use the interaction plot to visualize the interaction. To examine the differences between different combinations, click the red triangle next to the interaction and click LS Means Tukey HSD.