Presentation on theme: "General Linear Model Introduction to ANOVA. Questions (1) What does it mean to pick parameter estimates by least squares? Why are least squares estimates."— Presentation transcript:
General Linear Model Introduction to ANOVA
Questions (1) What does it mean to pick parameter estimates by least squares? Why are least squares estimates desirable, that is, in what sense are they good from an estimation or decision standpoint? What is a treatment effect in ANOVA? (write the equation and explain the terms) What is a fixed-effects model?
Questions (2) What is error in a fixed-effects ANOVA model? Describe in words the partitioning of variance in a one-way ANOVA.
Linear models Line Y = a+bX or Y =mX+b Or y=a 0 x 0 +a 1 x 1 +…+a n x n +e X can take on values or just indicate group membership (0,1) ANOVA model if group membership Regression model if X takes on scale values X and Y are variables; a and b are coefficients to be estimated.
ANOVA models PeopleX0X1X2X3Compositon - effects 11100Y1=a0+a1+e Y2=a0+a1+e Y3=a0+a2+e Y4=a0+a2+e Y5=a0+a3+e5 Shows group membership – IVs in ANOVA
Effects & Least Squares (1) Linear model applies to everyone. How to pick the best weights? Minimize the errors. Make the error variance small. Find the least squared error. Suppose we pick for each cell the value of the mean as the weight a j. Then the errors within each cell will be deviations from the cell mean. The average of the errors (deviations) within cells will be zero, and the variance of the deviations will be minimum.
Population Effects Make it Greek. Sample Population effect of treatment j= If there is no effect of a treatment, If there is no effect, then Absence of treatment effects is equivalent to equality of all population means. ANOVA is used to test for differences in means. Population
Fixed vs. Random Effects Fixed: Treatments in the study are the only ones of interest. –Computer tutor vs. control. 4 types of psychotherapy. 3 antidepressant drugs. Treatment is fixed in that it is whole and presented to all. Random: Treatments selected to represent larger population of treatments. –Presentation order on Rorschach. Representative drug dosages, therapies, or antidepressant drugs. Schools as stimuli. Random in that treatment is sampled from a population of treatments.
Fixed Effects Model Cell 1Cell 2Cell = = = = = = = = =37 = 39.3 =47.3 =36.7 Population model: 3 treatments: pop data: Sample (Observed) Data
Fixed Effects Model (2) The graph shows the terms in the equation. There are three cells or levels in this study. The IV effect and error for the highest scoring cell is shown.
Review What does it mean to pick parameter estimates by least squares? What is a treatment effect in ANOVA? (write the equation and explain the terms) What is a fixed-effects model? Describe a fixed-effects study. Describe a Random-effects study.
Partition of the Sum of Squares (SS) Bottom Line: SS total = SS within + SS between We are interested in variance, but can often work with SS because N cancels out. Deviation of a score from the grand mean: Deviation made of two parts: Deviation = treatment+error Total variance = treatment variance+error variance
SS 2 Add the squared deviations over people and treatment groups. With a little algebra, we can show : SS total = SS within cells + SS between cells. SS total = SS error + SS treatment. Variance is additive. We break the total variance into components or analyze the variance, hence ANOVA
Numerical Example Cell Total28424 Total = within + between
Review What is error in a fixed-effects ANOVA model? What is a treatment effect in fixed- effects ANOVA? Describe in words the partitioning of variance in a one-way ANOVA.