Single-Variable, Correlated-Groups Designs

Slides:



Advertisements
Similar presentations
Copyright © Allyn & Bacon (2010) Correlated-Groups and Single-Subject Designs Graziano and Raulin Research Methods: Chapter 11 This multimedia product.
Advertisements

Chapter 9 Choosing the Right Research Design Chapter 9.
Copyright © Allyn & Bacon (2007) Single-Variable, Independent-Groups Designs Graziano and Raulin Research Methods: Chapter 10 This multimedia product and.
Slides to accompany Weathington, Cunningham & Pittenger (2010), Chapter 14: Correlated Groups Designs 1.
Copyright © Allyn & Bacon (2007) Controls to Reduce Threats to Validity Graziano and Raulin Research Methods: Chapter 9 This multimedia product and its.
Selection of Research Participants: Sampling Procedures
CHAPTER 8 EXPERIMENTAL DESIGN.
Using Between-Subjects and Within-Subjects Experimental Designs
Causal Comparative Research: Purpose
© 2001 Dr. Laura Snodgrass, Ph.D.1 Basic Experimental Design Common Problems Assigning Participants to Groups Single variable experiments –bivalent –multivalent.
Chapter 4 Hypothesis Testing, Power, and Control: A Review of the Basics.
Research Methods in Psychology
Matched Pairs, Within-Subjects, and Mixed Designs
Chapter 8 Experimental Design: Dependent Groups and Mixed Groups Designs.
Design Experimental Control. Experimental control allows causal inference (IV caused observed change in DV) Experiment has internal validity when it fulfills.
Single-Factor Experimental Designs
Chapter 8 Causal-Comparative Research Gay, Mills, and Airasian
Experimental Design: One-Way Correlated Samples Design
ANOVA. Independent ANOVA Scores vary – why? Total variability can be divided up into 2 parts 1) Between treatments 2) Within treatments.
Selecting and Recruiting Subjects One Independent Variable: Two Group Designs Two Independent Groups Two Matched Groups Multiple Groups.
Experimental Design. Threats to Internal Validity 1.No Control Group Known as a “one-shot case study” XOXO (IV)(DV)
@ 2012 Wadsworth, Cengage Learning Chapter 10 Extending the Logic of Experimentation: Within-Subjects and Matched-Subjects 2012 Wadsworth,
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
Chapter 11.  The general plan for carrying out a study where the independent variable is changed  Determines the internal validity  Should provide.
Experimental Design Research Methods.
ANOVA Overview of Major Designs. Between or Within Subjects Between-subjects (completely randomized) designs –Subjects are nested within treatment conditions.
LECTURE 11 Chapter 11 Repeated Measures / Within Subs Design 1.Control error variance = individual diff. No diff. due to sampling error! 2. Fewer subjects.
BHS Methods in Behavioral Sciences I May 9, 2003 Chapter 6 and 7 (Ray) Control: The Keystone of the Experimental Method.
PS Research Methods I with Kimberly Maring Unit 9 – Experimental Research Chapter 6 of our text: Zechmeister, J. S., Zechmeister, E. B., & Shaughnessy,
8 Experimental Research Design.
Experiments: Part 2.
Chapter 11: The Nuts and Bolts of one-factor experiments.
Chapter 8 Experiments.
METHODS IN BEHAVIORAL RESEARCH
Research Methods: Concepts and Connections First Edition
Experimental Research Designs
Experimental Design-Chapter 8
Between-Subjects, within-subjects, and factorial Experimental Designs
i) Two way ANOVA without replication
Hypothesis Testing, Validity, and Threats to Validity
CS-411 : Digital Education & Learning Analytics
Controls to Reduce Threats to Validity
Single-Variable, Independent-Groups Designs
7 How to Decide Which Variables to Manipulate and Measure Marziyeh Rezaee.
Matched T-Test Cohen Chapter 11 For EDUC/PSY 6600.
Research methods Lesson 2.
Psychology 3450W: Experimental Psychology
2 independent Groups Graziano & Raulin (1997).
Designing an Experiment
Section 5.2 Designing Experiments
Control error variance = individual diff.
Practical Investigations
Research Methods Experiments IV & DV
How science works Investigating the difference between two conditions
Chapter 8 Experimental Design.
Two experiments PPs are divided into two groups. Each PP is timed completing a jigsaw puzzle. In one group, the PPs complete the puzzle on their own.
Practical Investigations
Scientific Method Steps
Chapter 13 Group Differences
Correlated-Groups and Single-Subject Designs
Experiments We wish to conduct an experiment to see the effect of alcohol (explanatory variable) on reaction time (response variable).
Repeated Measures Balancing Practice Effects with an Incomplete Design
Introduction to Between-Subjects Experiments
CHAPTER 8 EXPERIMENTAL DESIGN © 2012 The McGraw-Hill Companies, Inc.
Experiments with More Than Two Groups
Principles of Experimental Design
Principles of Experimental Design
Graziano and Raulin Research Methods: Chapter 12
Much of the meaning of terms depends on context.
Research Methods Experiments IV & DV
Presentation transcript:

Single-Variable, Correlated-Groups Designs Graziano and Raulin Research Methods: Chapter 11 Graziano & Raulin (2000) Graziano & Raulin (1997)

Correlated-Groups Designs Introduces a correlation between groups in the way groups are formed Within-subjects design: Same participants in each group Matched-groups design Groups formed by matched random assignment More sensitive than independent-groups designs Graziano & Raulin (2000)

Within-Subjects Designs All participants are exposed to all experimental conditions Need to control for sequence effects Sequence effects result from the experience with one condition affecting the performance in subsequent conditions Controlled by varying the order of presentation (such as with counterbalancing) Graziano & Raulin (2000)

Statistical Analysis Appropriate Statistical Analyses Correlated t-test (for 2 groups only) Repeated measures ANOVA Order data so that each line represents one participant and each row represents one condition Note that the columns represent conditions, NOT the order of testing Graziano & Raulin (2000)

Within-Subjects Strengths More sensitive to small group differences because the variability due to individual differences is statistically eliminated Fewer participants are needed because each participant appears in each condition Instructions may take less time because participants were already instructed on the task in previous conditions Graziano & Raulin (2000)

Within-Subjects Weaknesses Because participants experience all conditions, they may figure out the hypothesis (potential subject effects) Major issue is sequence effects Practice and carry-over effects Controlled by varying the order of presentation Counterbalancing Random order of presentation Latin square design Graziano & Raulin (2000)

Matched-Subjects Designs Introduces correlation by matching the participants in each group with participants from the other groups Should match on “relevant” variables Variables that affect the dependent variable Variables that show considerable natural variation in the population sampled Graziano & Raulin (2000)

Matching Participants Match participants in sets, where the size of the set is equal to the number of conditions Matching gets more difficult as: The number of matching variables increases Matching is done on continuous variables The number of conditions increase Once sets are matched, you randomly assign the participants in the set to the conditions Graziano & Raulin (2000)

Statistical Analysis Analyze as if it were a within-subjects study Data from matched participants are organized as if the data came from a single participant Tell the program that the number of participants was equal to the actual number of participants divided by the number of conditions e.g., for 40 participants and 4 conditions, tell the program that you had 10 participants and 4 conditions in a within-subjects design Graziano & Raulin (2000)

Strengths and Weaknesses Increased sensitivity to small differences between groups,but without the sequence effects of within-subjects designs Weaknesses Extra work of matching participants Participants without appropriate matches cannot be used in the study Graziano & Raulin (2000)

Single-Subject Designs Single-subject designs are extensions of within-subjects designs One participant is tested under all conditions A variation on time-series designs, with repeated measurement of the dependent variable Highly refined single-subject designs exist These designs covered in Chapter 13 Graziano & Raulin (2000)

Summary Can introduce a correlation in two ways Within-subjects designs Matched-subjects designs These designs are more sensitive to small differences between groups The costs for the greater sensitivity are: Sequence effects (within-subjects design) Matching difficulties (matched-subjects design) Graziano & Raulin (2000)