Other Ways of Thinking About Interactions Ways of Describing Interactions other than “Simple Effects” Interactions as “other kinds of” cell mean difference.

Slides:



Advertisements
Similar presentations
Statistics for the Social Sciences
Advertisements

Kxk BG Factorial Designs expanding the 2x2 design reasons for larger designs statistical analysis of kxk BG factorial designs using LSD for kxk factorial.
Factorial Hypotheses Some review & practice Identifying main effect and interaction RH: Explicit factorial RH: “Blending” interaction and main effect RH:
3-way Factorial Designs Expanding factorial designs Effects in a 3-way design Causal Interpretations of 3-way factorial effects Defining a 3-way interaction.
Analysis of variance (ANOVA)-the General Linear Model (GLM)
Analytic Comparisons & Trend Analyses Analytic Comparisons –Simple comparisons –Complex comparisons –Trend Analyses Errors & Confusions when interpreting.
Intro to Factorial ANOVA
The Two Factor ANOVA © 2010 Pearson Prentice Hall. All rights reserved.
Multiple Group X² Designs & Follow-up Analyses X² for multiple condition designs Pairwise comparisons & RH Testing Alpha inflation Effect sizes for k-group.
Factorial Designs: Research Hypotheses & Describing Results Research Hypotheses of Factorial Designs Inspecting tables to describe factorial data patterns.
Multiple Group X² Designs & Follow-up Analyses X² for multiple condition designs Pairwise comparisons & RH Testing Alpha inflation Effect sizes for k-group.
ANCOVA Workings of ANOVA & ANCOVA ANCOVA, Semi-Partial correlations, statistical control Using model plotting to think about ANCOVA & Statistical control.
Analyses of K-Group Designs : Analytic Comparisons & Trend Analyses Analytic Comparisons –Simple comparisons –Complex comparisons –Trend Analyses Errors.
Describing Factorial Effects Kinds of means & kinds of effects Inspecting tables to describe factorial data patterns Inspecting line graphs to describe.
Understanding Statistics in Research
Statistical Analysis of Factorial Designs z Review of Interactions z Kinds of Factorial Designs z Causal Interpretability of Factorial Designs z The F-tests.
Multivariate Analyses & Programmatic Research Re-introduction to Programmatic research Factorial designs  “It Depends” Examples of Factorial Designs Selecting.
3-way Factorial Designs Expanding factorial designs Effects in a 3-way design Defining a 3-way interaction BG & WG comparisons Experimental & Non-experimental.
Multivariate Analyses & Programmatic Research Re-introduction to Multivariate research Re-introduction to Programmatic research Factorial designs  “It.
Introduction to Multivariate Research & Factorial Designs
Chapter 10 - Part 1 Factorial Experiments.
2x2 ANOVA BG & MG Models Kinds of Factorial Designs ANOVA for BG, MG & WG designs Causal Interpretation of Factorial Results.
Some Details about Bivariate Stats Tests Conceptualizing the four stats tests Conceptualizing NHST, critical values and p-values NHST and Testing RH: Distinguishing.
Review of Factorial Designs 5 terms necessary to understand factorial designs 5 patterns of factorial results for a 2x2 factorial designs Descriptive &
The Two-way ANOVA We have learned how to test for the effects of independent variables considered one at a time. However, much of human behavior is determined.
K-group ANOVA & Pairwise Comparisons ANOVA for multiple condition designs Pairwise comparisons and RH Testing Alpha inflation & Correction LSD & HSD procedures.
Multiple-Group Research Designs Limitations of 2-group designs “Kinds” of Treatment & Control conditions Kinds of Causal Hypotheses k-group ANOVA & Pairwise.
Using Statistics in Research Psych 231: Research Methods in Psychology.
2x2 BG Factorial Designs Definition and advantage of factorial research designs 5 terms necessary to understand factorial designs 5 patterns of factorial.
Intro to Parametric Statistics, Assumptions & Degrees of Freedom Some terms we will need Normal Distributions Degrees of freedom Z-values of individual.
Analysis of Factorial Designs Statistical Analysis of 2x2 Designs Statistical Analysis of kxk Designs.
Psy B07 Chapter 1Slide 1 ANALYSIS OF VARIANCE. Psy B07 Chapter 1Slide 2 t-test refresher  In chapter 7 we talked about analyses that could be conducted.
ANOVA Chapter 12.
Chapter 14Prepared by Samantha Gaies, M.A.1 Chapter 14: Two-Way ANOVA Let’s begin by reviewing one-way ANOVA. Try this example… Does motivation level affect.
Tuesday, September 10, 2013 Introduction to hypothesis testing.
One-Factor Experiments Andy Wang CIS 5930 Computer Systems Performance Analysis.
Stats Lunch: Day 7 One-Way ANOVA. Basic Steps of Calculating an ANOVA M = 3 M = 6 M = 10 Remember, there are 2 ways to estimate pop. variance in ANOVA:
Describing Factorial Effects Kinds of means & kinds of effects Inspecting tables to describe factorial data patterns Inspecting line graphs to describe.
Reintroduction to Factorial Designs (re-)Introduction to factorial designs 5 patterns of factorial results Understanding main effects Research Hypotheses.
Intro to Factorial Designs The importance of “conditional” & non-additive effects The structure, variables and effects of a factorial design 5 terms necessary.
ANOVA complex design. What is in a results section??? LOOK at the example in your textbook. You need to have subheading. You need to have figures and.
+ The Practice of Statistics, 4 th edition – For AP* STARNES, YATES, MOORE Chapter 4: Designing Studies Section 4.2 Experiments.
Chapter 10: Analyzing Experimental Data Inferential statistics are used to determine whether the independent variable had an effect on the dependent variance.
Regression Models w/ 2 Categorical Variables Sources of data for this model Variations of this model Definition and advantage of factorial research designs.
Intermediate Applied Statistics STAT 460 Lecture 17, 11/10/2004 Instructor: Aleksandra (Seša) Slavković TA: Wang Yu
Basic Analysis of Factorial Designs The F-tests of a Factorial ANOVA Using LSD to describe the pattern of an interaction.
Factorial Designs: Programmatic Research, RH: Testing & Causal Inference Applications of Factorial designs in Programmatic Research Research Hypotheses.
Chapter 21: More About Tests
Chapter 13 Repeated-Measures and Two-Factor Analysis of Variance
Two-Way (Independent) ANOVA. PSYC 6130A, PROF. J. ELDER 2 Two-Way ANOVA “Two-Way” means groups are defined by 2 independent variables. These IVs are typically.
Hypothesis test flow chart frequency data Measurement scale number of variables 1 basic χ 2 test (19.5) Table I χ 2 test for independence (19.9) Table.
Kxkxk 3-way Factorial Designs kxkxk 3-way designs, effects & causality 3-way interactions describing effects and checking if they are. “descriptive” or.
Chapter 1 Section 1.5 Matrix Operations. Matrices A matrix (despite the glamour of the movie) is a collection of numbers arranged in a rectangle or an.
+ Experiments Observational Study versus Experiment In contrast to observational studies, experiments don’t just observe individuals or ask them questions.
MultiModality Registration Using Hilbert-Schmidt Estimators By: Srinivas Peddi Computer Integrated Surgery II April 6 th, 2001.
3-way Designs defining 2-way & 3-way interactions all the effects conditional and unconditional effects orthogonality, collinearity & the like kxkxk kxkxq.
Statistics (cont.) Psych 231: Research Methods in Psychology.
Effect Sizes & Power Analyses for k-group Designs Effect Size Estimates for k-group ANOVA designs Power Analysis for k-group ANOVA designs Effect Size.
Copyright © Cengage Learning. All rights reserved. Normal Curves and Sampling Distributions 6.
Dependent-Samples t-Test
Comparing Three or More Means
6 Normal Curves and Sampling Distributions
Interactions & Simple Effects finding the differences
Chapter 4: Designing Studies
Chapter 4: Designing Studies
Statistical Reasoning December 8, 2015 Chapter 6.2
Factorial ANOVA 2 or More IVs.
One-Factor Experiments
Chapter 4: Designing Studies
Presentation transcript:

Other Ways of Thinking About Interactions Ways of Describing Interactions other than “Simple Effects” Interactions as “other kinds of” cell mean difference patterns Interactions as “non-additive combinations” of IV effects augmenting vs. interfering interactions Describing “interactions” vs. “data patterns” isolating the interaction effect

Generally folks define, identify, and describe interactions in terms of “different differences” or “different simple effects,” as we have done so far… Task Presentation Paper Computer Task Difficulty Easy 90 = 90 one simple effect “null” Hard 40 < 70 one simple effect However, that’s not the only way to define, indentify or describe interactions…

Sometimes our hypotheses aren’t about patterns of simple effects, but … are about other kinds of mean difference patterns… The IVs are “Training Modality” and “Testing Modality” leading to this 2x2 factorial design… VV Training Modality Visual Touch VT TT TV Testing Modality Touch Visual Among these conditions, 2 are “intramodal” (VV & TT) & 2 are “cross-modal” (VT & TV). RH:s for the study were… RH1: VV > TT  hypothesized dif among intramodal conditions RH2: VT > TV  hypothesized dif among cross-modal conditions Neither of which corresponds to a “simple effect” !! REM! LSDmmd can be used to compare among any of the cells!

At the time, using LSDmmd hadn’t “caught on” yet, and since neither RH: corresponds to a SE, folks would use separate t-tests to compare each cell pair – leading several to make Type II errors because of the lowered power… VV Training Modality Visual Touch VT TT TV Testing Modality Cross Intra In this case there is an “organizational” solution… Just re-label the IVs… “Training Modality”  Vision vs. Touch & “Testing Modality”  Intramodal vs. Cross-modal then… The “significant interaction that isn’t anywhere” we’ve discussed! RH1: VV > TT  SE of Training Modality for Intramodal tests RH2: VT > TV  SE of Training Modality for Cross-modal tests

Performance 99.6% Training Modality Visual Touch 26.2 % Testing Modality Touch Visual 25.6 % 24.8 % … which can be directly & completely tested using the 6 pairwise comparisons among the 4 conditions. VV VT TV TT Another Example – same research area… This was the common design for studying intra- and cross-modal memory with the usual RH: VV > VT = TV = TT After several studies, someone noticed that these conditions define a factorial…

99.6% Training Modality Visual Touch 26.2 % Testing Modality Touch Visual 25.6 % 24.8 % There was an interaction! There was a (misleading) main effect of Training Modality. There was a (misleading) main effect of Testing Modality. However interesting and informative was the idea from the significant interaction, that “performance is the joint effect of Training and Testing Modalities” – none of these “effect tests” give a direct test of the RH: The set of pairwise comparisons gives the most direct RH test!!! Notice how the very large VV cell mean “drives” both main effects (while ensuring they will each be misleading) as well as driving the interaction!?!

Here’s yet another way of thinking about interactions… we’ll need an example!! Brownies – great things… worthy of serious theory & research!!! The usual brownie is made with 4 blocks of chocolate and 2 cups of sugar. Replicated research tells us that the average rating of brownies made with this recipe is about 3 on a 10- point scale. My theory? People don’t really like brownies! What they really like is fudge! So, goes my theory, making brownies more “fudge-like” will make them better liked. How to make them more fudge-like, you ask? Add more sugar & more chocolate!!!

So, we made up several batches of brownies and asked people to taste a standardized amount of brownie after rinsing their mouth with water, eating an unsalted saltine cracker and rinsing their mouth a second time. We used the same 10-point rating scale; 1 = this is the worst plain brownie I’ve ever had, 10=this is the best plain brownie I’ve ever had. Our first study: 2-cups of sugar 4-cups of sugar 35 So, far so good!

Our second study: 4 blocks of choc blocks of choc. What????Oh – yeah! Unsweetened chocolate… Then the argument started.. One side: We have partial support for the theory – adding sugar helps, but adding chocolate hurts!!! Other side: We have not tested the theory!!! What was our theory? Add more sugar & more chocolate!!! We need a better design!

4 blocks of choc blocks of choc. 2-cups of sugar 4-cups of sugar 5 What do we expect for the 4-cup & 8-block brownies? standard brownie + sugar effect + chocolate effect expected additive effect of choc & sugar expected score for 4&8 brownies

4 blocks of choc blocks of choc. 2-cups of sugar 4-cups of sugar 5 How do we account for this ? 9 There is a non-additive joint effect of chocolate and sugar!!!! The joint effect of adding chocolate and sugar is not predictable as the sum of the effects of adding each!!! Said differently, there is an interaction of chocolate and sugar that emerges when they are added simultaneously. The effect of adding both simultaneously is 6 … not 4???

This leads to the distinction between two “kinds” of interactions… “Augmenting” Interaction 10 # practices ~FB FB The combined effect is greater than would be expected as the additive effect! “Interfering” Interaction 10 ~Aud Aud ~Rew Rew The combined effect is less than would be expected as the additive effect! Practice effect = 5 Feedback effect = 10 Expected additive effect = 15 Joint effect = 35 “Augmenting” Interaction 45 Reward effect = 10 Audience effect = 15 Expected additive effect = 25 Joint effect = 5 “Interfering” Interaction

“Describing a pattern of data that includes an interaction” vs. “Describing the Interaction in a pattern of data” Paper Computer Task Presentation The pattern of data shown the figure demonstrate that while Task Presentation has no effect for Easy tasks, for Hard tasks, those using Computer did better than when using Paper. This is “a description of a pattern of data that includes an interaction” Technically, it would be wrong to say that “The interaction shown in the figure demonstrates that while Task Presentation has no effect for Easy tasks, for Hard tasks, those using Computer did better than when using Paper. In order to “describe the interaction effect” we have to isolate the “interaction effect” from the main effects… Easy Hard

The process, called “mean polishing,” involves residulaizing the data for the main effects, leaving the interaction effect… Presentation Paper Comp means row effect Easy Hard means  grand mean col effect Correcting for row effects (subtract +/- 15) Presentation Paper Comp Easy Hard Correcting for column effects (subtract +/- 5) Presentation Paper Comp Easy Hard 70 80

Correcting for Grand Mean (subtract 75) Presentation Paper Comp Easy 5 -5 Hard Paper Computer Task Presentation Easy Hard The proper description of “the interaction effect” is The interaction shown in the figure demonstrates that for Easy tasks those using Paper performed better than those using Computer, however, for Hard tasks, those using Computer performed better than those using Paper. Hard Easy Hard

Looked at in this way, interactions differ in only 2 ways… Which group has “increase” and which had “decrease” Easy Hard vs. Easy Hard The “strength” of the interaction effect… Easy Hard Easy Hard Easy Hard Easy Hard Easy Hard Easy Hard Easy Hard Easy Hard Easy Hard null small medium large