Factorial ANOVA 2-Way ANOVA, 3-Way ANOVA, etc.

Factorial ANOVA One-Way ANOVA = ANOVA with one IV with 1+ levels and one DV One-Way ANOVA = ANOVA with one IV with 1+ levels and one DV Factorial ANOVA = ANOVA with 2+ IV’s and one DV Factorial ANOVA = ANOVA with 2+ IV’s and one DV –Factorial ANOVA Notation: 2 x 3 x 4 ANOVA 2 x 3 x 4 ANOVA The number of numbers = the number of IV’s The number of numbers = the number of IV’s The numbers themselves = the number of levels in each IV The numbers themselves = the number of levels in each IV

Factorial ANOVA 2 x 3 x 4 ANOVA = an ANOVA with 3 IV’s, one of which has 2 levels, one of which has 3 levels, and the last of which has 4 levels 2 x 3 x 4 ANOVA = an ANOVA with 3 IV’s, one of which has 2 levels, one of which has 3 levels, and the last of which has 4 levels Why use a factorial ANOVA? Why not just use multiple one-way ANOVA’s? Why use a factorial ANOVA? Why not just use multiple one-way ANOVA’s? 1.Increased power – with the same sample size and effect size, a factorial ANOVA is more likely to result in the rejection of H o – aka with equal effect size and probability of rejecting H o if it is true (α), you can use fewer subjects (and time and money)

Factorial ANOVA Why use a factorial ANOVA? Why not just use multiple one-way ANOVA’s? Why use a factorial ANOVA? Why not just use multiple one-way ANOVA’s? 2.With 3 IV’s, you’d need to run 3 one-way ANOVA’s, which would inflate your α-level – However, this could be corrected with a Bonferroni Correction 3.The best reason is that a factorial ANOVA can detect interactions, something that multiple one-way ANOVA’s cannot do

Factorial ANOVA Interaction: Interaction: –when the effects of one independent variable differ according to levels of another independent variable –Ex. We are testing two IV’s, Gender (male and female) and Age (young, medium, and old) and their effect on performance If males performance differed as a function of age, i.e. males performed better or worse with age, but females performance was the same across ages, we would say that Age and Gender interact, or that we have an Age x Gender interaction If males performance differed as a function of age, i.e. males performed better or worse with age, but females performance was the same across ages, we would say that Age and Gender interact, or that we have an Age x Gender interaction

Factorial ANOVA Interaction: Interaction: –Presented graphically: Note how male’s performance changes as a function of age while females does not Note how male’s performance changes as a function of age while females does not Note also that the lines cross one another, this is the hallmark of an interaction, and why interactions are sometimes called cross- over or disordinal interactions Note also that the lines cross one another, this is the hallmark of an interaction, and why interactions are sometimes called cross- over or disordinal interactions

Factorial ANOVA Interactions: Interactions: –However, it is not necessary that the lines cross, only that the slopes differ from one another I.e. one line can be flat, and the other sloping upward, but not cross – this is still an interaction I.e. one line can be flat, and the other sloping upward, but not cross – this is still an interaction See Fig on p. 400 in the Howell book for more examples See Fig on p. 400 in the Howell book for more examples

Factorial ANOVA As opposed to interactions, we have what are called main effects: As opposed to interactions, we have what are called main effects: –the effect of an IV independent of any other IV’s This is what we were looking at with one-way ANOVA’s – if we have a significant main effect of our IV, then we can say that the mean of at least one of the groups/levels of that IV is different than at least one of the other groups/levels This is what we were looking at with one-way ANOVA’s – if we have a significant main effect of our IV, then we can say that the mean of at least one of the groups/levels of that IV is different than at least one of the other groups/levels

Factorial ANOVA Main Effects: Main Effects: –Presented Graphically: Note how the graph indicates that males performed higher than females equally for the young, medium, and old groups Note how the graph indicates that males performed higher than females equally for the young, medium, and old groups This indicates a main effect (men>women), but no interaction (this is equal across ages) This indicates a main effect (men>women), but no interaction (this is equal across ages)

Factorial ANOVA Interaction Main Effect Both Main Interaction Main Effect Both Main (No main effect) (No interaction) Effect & Inter.

Factorial ANOVA Finally, we also have simple effects: Finally, we also have simple effects: –the effect of one group/level of our IV at one group/level of another IV Using our example earlier of the effects of Gender (Men/Women) and Age (Young/Medium/Old) on Performance, to say that young women outperformed other groups would be to talk about a simple effect Using our example earlier of the effects of Gender (Men/Women) and Age (Young/Medium/Old) on Performance, to say that young women outperformed other groups would be to talk about a simple effect

Factorial ANOVA One more new issue: One more new issue: –Random vs. Fixed Factors (IV’s) Sadly, I’ve never read a paper that bothered to make this distinction, while it seriously effects the results you get Sadly, I’ve never read a paper that bothered to make this distinction, while it seriously effects the results you get Fixed IV: when levels of IV are selected theoretically Fixed IV: when levels of IV are selected theoretically –i.e. IV = Depression, Levels = Present vs. Absent; IV = Memory Condition, Levels = Counting, Rhyming, Imagery, etc. Random IV: when levels are randomly sampled Random IV: when levels are randomly sampled –i.e. IV = Treatment Duration, Levels = 6, 8, and 12 sessions

Factorial ANOVA Assumptions: Assumptions: 1.Normality 2.Homogeneity of Variance (Homoscedasticity) 3.Independence of Observations Same as one-way ANOVA Same as one-way ANOVA Just like ANOVA, robust to violations of Assumptions #1 & 2 (so long as cell sizes are roughly equal), but very sensitive to violations of Assumption #3 Just like ANOVA, robust to violations of Assumptions #1 & 2 (so long as cell sizes are roughly equal), but very sensitive to violations of Assumption #3

Factorial ANOVA Assumptions: Assumptions: –If Assumption #3 is violated, use a repeated- measures ANOVA –If Assumptions #1 and/or 2 are violated (and cell sizes are unequal), alternate procedures must be used Transform non-normal data Transform non-normal data Use Browne-Forsythe or Welch statistic Use Browne-Forsythe or Welch statistic

Factorial ANOVA Calculating a Factorial ANOVA: Calculating a Factorial ANOVA: –First, we have to divide our data into cells the data represented by our simple effects the data represented by our simple effects If we have a 2 x 3 ANOVA, as in our Age and Gender example, we have 3 x 2 = 6 cells If we have a 2 x 3 ANOVA, as in our Age and Gender example, we have 3 x 2 = 6 cells YoungMediumOld Male Cell #1 Cell #2 Cell #3 Female Cell #4 Cell #5 Cell #6

Factorial ANOVA Then we calculate means for all of these cells, and for our IV’s across cells Then we calculate means for all of these cells, and for our IV’s across cells –Mean #1 = Mean for Young Males only –Mean #2 = Mean for Medium Males only –Mean #3 = Mean for Old Males –Mean #4 = Mean for Young Females –Mean #5 = Mean for Medium Females –Mean #6 = Mean for Old Females –Mean #7 = Mean for all Young people (Male and Female) –Mean #8 = Mean for all Medium people (Male and Female) –Mean #9 = Mean for all Old people (Male and Female) –Mean #10 = Mean for all Males (Young, Medium, and Old) –Mean #11 = Mean for all Females (Young, Medium, and Old) YoungMediumOld Male Mean #1 Mean #2 Mean #3 Mean #10 Female Mean #4 Mean #5 Mean #6 Mean #11 Mean #7 Mean #8 Mean #9

Factorial ANOVA We then calculate the Grand Mean ( ) We then calculate the Grand Mean ( ) –This remains (ΣX)/N, or all of our observations added together, divided by the number of observations We can also calculate SS total, which is also calculated the same as in a one-way ANOVA We can also calculate SS total, which is also calculated the same as in a one-way ANOVA

Factorial ANOVA Next we want to calculate our SS terms for our IV’s Next we want to calculate our SS terms for our IV’s Same as SS treat in one-way ANOVA, but with one small addition Same as SS treat in one-way ANOVA, but with one small addition –SS IV = nxΣ( - ) 2 n = number of subjects per group/level of our IV n = number of subjects per group/level of our IV x = number of groups/levels in the other IV x = number of groups/levels in the other IV

Factorial ANOVA –SS IV = nxΣ( - ) 2 1. Subtract the grand mean from each of our levels means For SS gender, this would involve subtracting the mean for males from the grand mean, and the mean for females from the grand meanFor SS gender, this would involve subtracting the mean for males from the grand mean, and the mean for females from the grand mean Note: The number of values should equal the number of levels of your IVNote: The number of values should equal the number of levels of your IV 2. Square all of these values 3. Add all of these values up 4. Multiply this number by the number of subjects in each cell x the number of levels of the other IV 5. Repeat for any IV’s Using the previous example, we would have both SS gender and SS ageUsing the previous example, we would have both SS gender and SS age

Factorial ANOVA Next we want to calculate SS cells, which has a formula similar to SS IV Next we want to calculate SS cells, which has a formula similar to SS IV –SS cells = 1. Subtract the grand mean from each of our cell means Note: The number of values should equal the number of cellsNote: The number of values should equal the number of cells 2. Square all of these values 3. Add all of these values up 4. Multiply this number by the number of subjects in each cell

Factorial ANOVA A brief note on SS cells A brief note on SS cells –Represents variability in individual cell means –Cell means differ for 4 reaons: 1. Error 2. Effects of IV#1 (Gender) 3. Effects of IV#2 (Age) 4. Effects of interaction(s)

Factorial ANOVA ̶We’ve already accounted for variability due to error (SS error ), so subtracting the variability due to Gender (SS gender ) and Age (SS age ) from SS cells leaves us with the effects of our interaction (SS int ) –SS int = SS cells – SS IV1 – SS IV2 – etc… Going back to our previous example, Going back to our previous example, SS int = SS cells – SS gender – SS age –SS error = SS total – SS cells

Factorial ANOVA Similar to a one-way ANOVA, factorial ANOVA uses df to obtain MS Similar to a one-way ANOVA, factorial ANOVA uses df to obtain MS –df total = N – 1 –df IV = k – 1 Using the previous example, df age = 3 (Young/Medium/Old) – 1 = 2 and df gender = 2 (Male/Female) – 1 = 1 Using the previous example, df age = 3 (Young/Medium/Old) – 1 = 2 and df gender = 2 (Male/Female) – 1 = 1 –df int = df IV1 x df IV2 x etc… Again, using the previous example, df int = 2 x 1 = 2 Again, using the previous example, df int = 2 x 1 = 2 –df error = df total – df int - df IV1 – df IV2 – etc…

Factorial ANOVA Factorial ANOVA provides you with F- statistics for all main effects and interactions Factorial ANOVA provides you with F- statistics for all main effects and interactions –Therefore, we need to calculate MS for all of our IV’s (our main effects) and the interaction –MS IV = SS IV /df IV We would do this for each of our IV’s We would do this for each of our IV’s –MS int = SS int /df int –MS error = SS error /df error

Factorial ANOVA We then divide each of our MS’s by MS error to obtain our F - statistics We then divide each of our MS’s by MS error to obtain our F - statistics Finally, we compare this with our critical F to determine if we accept or reject H o Finally, we compare this with our critical F to determine if we accept or reject H o –All of our main effects and our interaction have their own critical F’s –Just as in the one-way ANOVA, use table E.3 or E.4 depending on your alpha level (.05 or.01) –Just as in the one-way ANOVA, “df numerator” = the df for the term in question (the IV’s or their interaction) and “df denominator” = df error

Factorial ANOVA Just like in a one-way ANOVA, a significant F in factorial ANOVA doesn’t tell you which groups/levels of your IV’s are different Just like in a one-way ANOVA, a significant F in factorial ANOVA doesn’t tell you which groups/levels of your IV’s are different –There are several possible ways to determine where differences lie

Factorial ANOVA Multiple Comparison Techniques in Factorial ANOVA: Multiple Comparison Techniques in Factorial ANOVA: 1.Several one-way ANOVA’s (as many as there are IV’s) with their corresponding multiple comparison techniques – Probably the most common method – A priori/post hoc techniques the same as one-way ANOVA 2.Analysis of Simple Effects – Calculate MS for each cell/simple effect, obtain an F for each one and determine its associated p-value

Factorial ANOVA Multiple Comparison Techniques in Factorial ANOVA: Multiple Comparison Techniques in Factorial ANOVA: –In addition, interactions must be decomposed to determine what they mean A significant interaction between two variables means that one IV’s value changes as a function of the other, but gives no specific information A significant interaction between two variables means that one IV’s value changes as a function of the other, but gives no specific information The most simple and common method of interpreting interactions is to look at a graph The most simple and common method of interpreting interactions is to look at a graph

Interpreting Interactions: Interpreting Interactions: –In the example above, you can see that for Males, as age increases, Performance increases, whereas for Females there is no relation between Age and Performance –To interpret an interaction, we graph the DV on the y-axis, place one IV on the x-axis, and define the lines by the other IV You may have to try switching the IV’s if you don’t get a nice interaction pattern the first time

Factorial ANOVA Effect Size in Factorial ANOVA: Effect Size in Factorial ANOVA: –η 2 (eta squared) = SS IV /SS total (for any of the IV’s) or SS int /SS total (for the interaction) Tells you the percent of variability in the DV accounted for by the IV/interaction Tells you the percent of variability in the DV accounted for by the IV/interaction Like the one-way ANOVA, very easily computed and commonly used, but also very biased – don’t ever use it Like the one-way ANOVA, very easily computed and commonly used, but also very biased – don’t ever use it

Factorial ANOVA Effect Size in Factorial ANOVA: Effect Size in Factorial ANOVA: –ω 2 (omega squared) = or or Also provides an estimate of the percent of variability in the DV accounted for by the IV/interaction, but is not biased Also provides an estimate of the percent of variability in the DV accounted for by the IV/interaction, but is not biased

Factorial ANOVA Effect Size in Factorial ANOVA: Effect Size in Factorial ANOVA: –Cohen’s d = The two means can be between two IV’s, or between two groups/levels within an IV, depending on what you want to estimate The two means can be between two IV’s, or between two groups/levels within an IV, depending on what you want to estimate Reminder: Cohen’s conventions for d – small =.3, medium =.5, large =.8 Reminder: Cohen’s conventions for d – small =.3, medium =.5, large =.8

Factorial ANOVA Example #1: Example #1: –The previous example used data from Eysenck’s (1974) study of the effects of age and various conditions on memory performance. Another aspect of this study manipulated depth of processing more directly by placing the participants into conditions that directly elicited High or Low levels of processing. Age was maintained as a variable and was subdivided into Young and Old groups. The data is as follows:

Factorial ANOVA Young/Low: Young/Low: Young/High: Young/High: Old/Low: Old/Low: Old/High: Old/High: What are the IV’s and the DV’s, and the number of levels of each? 2. What are the number of cells? 3. What are the various df’s?

Factorial ANOVA IV = Age (2 levels) and Condition (2 levels) IV = Age (2 levels) and Condition (2 levels) 2 x 2 ANOVA = 4 cells 2 x 2 ANOVA = 4 cells d age =.70 d age =.70 d condition = 1.82 d condition = 1.82 d int =.80 d int =.80

Factorial ANOVA Decomposing the interaction: Decomposing the interaction: