2What is an Experiment?Campbell & Stanley stressed random assignment to experimental treatments.I stress manipulation of the independent variable.Quasi-Experiments: C&S’s term for research wherethere is a manipulated IVbut not random assignment to groups
3Random SelectionRefers to the selection of data points from a population into a random sample.This selection procedure will be random if each possible sample of size N is equally likely to be sampled.Random samples should be representative of the population.Our inferential statistics assume random sampling.
4Note. The tabled values are probabilities. Y is random, X is not.In Y, each time a single score is sampled, all scores in the population are equally likely to be sampled.
5Random AssignmentRefers to the assignment of subjects to treatment conditions.Allows us to consider the populations (subjects who will get special treatment and those who will not) as equivalent prior to treatment.The samples will likely differ a little.
6Two Basic Randomized Designs Randomized Pretest-Posttest Control Group DesignR O X OR O ORandomized Posttest Only Control Group DesignR X OR O
7Noise Reducing Designs These designs reduce noise (error variance) and thus increase power.
8Randomized Blocks Designs Matched pairs, randomized blocks, split-plot.Repeated measures or within-subjects.Variance due to the blocking variable is removed from error variance.
9Analysis of Covariance Change a noise-producing extraneous variable into a covariate that is included in the statistical model.Must be able to measure the covariate.Variance due to covariate is removed from the error variance.Can have more than one covariate.
10Factorial ANOVAConvert a categorical extraneous variable to an ANOVA factor.Variance due to that factor will be removed from the error term.2 x 2 Factorial DesignR X11 OR X12 OR X21 OR X22 O
11Other Randomized Designs Solomon Four Group Design Controls threats to internal and external validity as well as the posttest only control group design.But has greater power.And greater costNeed more dataMore complex analysisR O X OR O OR X OR O
12Solomon Four Group Design ANOVA Arrange all four groups’ posttest scores into a 2 x 2 ANOVA.Pretested or Not x Experimental Treatment or Not.Significant Interaction – Testing x Treatment threat to External ValidityMain effect of pretesting.Main effect of treatment
13Treatment effect but no testing or Testing x Treatment interaction Pretest means in parentheses
14Treatment and testing effects but no Testing x Treatment interaction
15Treatment and testing effects and a Testing x Treatment interaction
16Solomon Four Group Design Pretest-Posttest Analysis To gain power, analyze the pretest-posttest portion of the design withANCOV, using pretest scores as covariateMixed factorial ANOVAplanned comparisons using tcontrol versus treatment change scores (independent t)pre versus post for control group (correlated t)pre versus post for treatment group (correlated t)
17Randomized Switching- Replications Design R O X O OR O O X OAttempt to control social threats to internal validity.Both groups get the special effect, one early, one later.May still be social effects with respect to who gets it first.
18Switching Replications Temporary Treatment Effect Group 1 got the treatment first.Treatment is anxiety-reducing drugDV = measure of anxiety reported by patient
19Switching Replications Persistent Treatment Effect Treatment is psychotherapyDV = measure of anxiety reported by patientA third posttest could show the effect does not last indefinitely.
20Switching Replications Continuing Treatment Effect Treatment = cognitive psychotherapyAnxiety continues to decline beyond the first post-treatment observation, as patients get better at employing the cognitive technique.