PSYC 3030 Review Session April 19, 2004. Housekeeping Exam: –April 26, 2004 (Monday) –RN 203 –Use pencil, bring calculator & eraser –Make use of your.

Slides:



Advertisements
Similar presentations
Topic 12: Multiple Linear Regression
Advertisements

Topic 32: Two-Way Mixed Effects Model. Outline Two-way mixed models Three-way mixed models.
Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture #19 Analysis of Designs with Random Factor Levels.
1 Chapter 4 Experiments with Blocking Factors The Randomized Complete Block Design Nuisance factor: a design factor that probably has an effect.
Chapter 4 Randomized Blocks, Latin Squares, and Related Designs
Analysis of Variance Compares means to determine if the population distributions are not similar Uses means and confidence intervals much like a t-test.
EPI 809/Spring Probability Distribution of Random Error.
Simple Linear Regression and Correlation
Creating Graphs on Saturn GOPTIONS DEVICE = png HTITLE=2 HTEXT=1.5 GSFMODE = replace; PROC REG DATA=agebp; MODEL sbp = age; PLOT sbp*age; RUN; This will.
Some Terms Y =  o +  1 X Regression of Y on X Regress Y on X X called independent variable or predictor variable or covariate or factor Which factors.
Multiple regression analysis
ANOVA notes NR 245 Austin Troy
HIERARCHICAL LINEAR MODELS USED WITH NESTED DESIGNS IN EDUCATION, PSYCHOLOGY USES RANDOM FACTORS EXPECTED MEAN SQUARE THEORY COMBINES INFORMATION ACROSS.
1 Multifactor ANOVA. 2 What We Will Learn Two-factor ANOVA K ij =1 Two-factor ANOVA K ij =1 –Interaction –Tukey’s with multiple comparisons –Concept of.
Chapter 11 Analysis of Variance
Statistics for Business and Economics
ANalysis Of VAriance (ANOVA) Comparing > 2 means Frequently applied to experimental data Why not do multiple t-tests? If you want to test H 0 : m 1 = m.
Statistics for Managers Using Microsoft® Excel 5th Edition
This Week Continue with linear regression Begin multiple regression –Le 8.2 –C & S 9:A-E Handout: Class examples and assignment 3.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 10-1 Chapter 10 Analysis of Variance Statistics for Managers Using Microsoft.
Chap 10-1 Analysis of Variance. Chap 10-2 Overview Analysis of Variance (ANOVA) F-test Tukey- Kramer test One-Way ANOVA Two-Way ANOVA Interaction Effects.
Topic 28: Unequal Replication in Two-Way ANOVA. Outline Two-way ANOVA with unequal numbers of observations in the cells –Data and model –Regression approach.
1 Experimental Statistics - week 7 Chapter 15: Factorial Models (15.5) Chapter 17: Random Effects Models.
© 2002 Prentice-Hall, Inc.Chap 14-1 Introduction to Multiple Regression Model.
 Combines linear regression and ANOVA  Can be used to compare g treatments, after controlling for quantitative factor believed to be related to response.
Today: Quizz 8 Friday: GLM review Monday: Exam 2.
1 Experimental Statistics - week 4 Chapter 8: 1-factor ANOVA models Using SAS.
OPIM 303-Lecture #8 Jose M. Cruz Assistant Professor.
1 Experimental Statistics - week 10 Chapter 11: Linear Regression and Correlation.
23-1 Analysis of Covariance (Chapter 16) A procedure for comparing treatment means that incorporates information on a quantitative explanatory variable,
12a - 1 © 2000 Prentice-Hall, Inc. Statistics Multiple Regression and Model Building Chapter 12 part I.
1 Experimental Statistics - week 10 Chapter 11: Linear Regression and Correlation Note: Homework Due Thursday.
Regression For the purposes of this class: –Does Y depend on X? –Does a change in X cause a change in Y? –Can Y be predicted from X? Y= mX + b Predicted.
Testing Multiple Means and the Analysis of Variance (§8.1, 8.2, 8.6) Situations where comparing more than two means is important. The approach to testing.
GENERAL LINEAR MODELS Oneway ANOVA, GLM Univariate (n-way ANOVA, ANCOVA)
Chapter 11 Linear Regression Straight Lines, Least-Squares and More Chapter 11A Can you pick out the straight lines and find the least-square?
6-1 Introduction To Empirical Models Based on the scatter diagram, it is probably reasonable to assume that the mean of the random variable Y is.
The Completely Randomized Design (§8.3)
March 28, 30 Return exam Analyses of covariance 2-way ANOVA Analyses of binary outcomes.
Chapter 13 Multiple Regression
Lecture 9-1 Analysis of Variance
1 Experimental Statistics - week 14 Multiple Regression – miscellaneous topics.
Topic 25: Inference for Two-Way ANOVA. Outline Two-way ANOVA –Data, models, parameter estimates ANOVA table, EMS Analytical strategies Regression approach.
Analysis of Covariance Combines linear regression and ANOVA Can be used to compare g treatments, after controlling for quantitative factor believed to.
Topic 26: Analysis of Covariance. Outline One-way analysis of covariance –Data –Model –Inference –Diagnostics and rememdies Multifactor analysis of covariance.
Multiple Regression. Simple Regression in detail Y i = β o + β 1 x i + ε i Where Y => Dependent variable X => Independent variable β o => Model parameter.
1 Experimental Statistics - week 9 Chapter 17: Models with Random Effects Chapter 18: Repeated Measures.
Topic 24: Two-Way ANOVA. Outline Two-way ANOVA –Data –Cell means model –Parameter estimates –Factor effects model.
1 Experimental Statistics Spring week 6 Chapter 15: Factorial Models (15.5)
Experimental Statistics - week 3
Topic 20: Single Factor Analysis of Variance. Outline Analysis of Variance –One set of treatments (i.e., single factor) Cell means model Factor effects.
Chapter 4 Analysis of Variance
1 Statistics 262: Intermediate Biostatistics Regression Models for longitudinal data: Mixed Models.
1 Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 9 Review.
Experimental Statistics - week 9
ANOVA Overview of Major Designs. Between or Within Subjects Between-subjects (completely randomized) designs –Subjects are nested within treatment conditions.
Topic 27: Strategies of Analysis. Outline Strategy for analysis of two-way studies –Interaction is not significant –Interaction is significant What if.
1 Experimental Statistics - week 8 Chapter 17: Mixed Models Chapter 18: Repeated Measures.
1 Experimental Statistics - week 12 Chapter 11: Linear Regression and Correlation Chapter 12: Multiple Regression.
Factorial BG ANOVA Psy 420 Ainsworth. Topics in Factorial Designs Factorial? Crossing and Nesting Assumptions Analysis Traditional and Regression Approaches.
1 Experimental Statistics - week 11 Chapter 11: Linear Regression and Correlation.
Education 793 Class Notes ANCOVA Presentation 11.
Chapter 11 Analysis of Variance
Two-Way Analysis of Variance Chapter 11.
Factorial Experiments
Comparing Three or More Means
Chapter 11 Analysis of Variance
Experimental Statistics - week 8
STATISTICS INFORMED DECISIONS USING DATA
Presentation transcript:

PSYC 3030 Review Session April 19, 2004

Housekeeping Exam: –April 26, 2004 (Monday) –RN 203 –Use pencil, bring calculator & eraser –Make use of your cheat sheet After the exam: –Blueberry Hill –Have a drink!

Outline 2-way ANOVA: theories and interpretations 3-way ANOVA: Interactions in graphs ANCOVA Repeated measures ANOVA

2-way ANOVA: Data Group/ Agegrp Mono Biling

2-way ANOVA: Computations When doing tests, use MS, not SS. Computations: –SS A = [A] – [Y] –SS B = [B] – [Y] –SS AB = [AB] – [A] – [B] + [Y] –SS Error = [ABS] – [AB] –SS Total = [ABS] – [Y]

2-way ANOVA: Unequal N’s Type I SS additive, but not used in test and generally ignored with unequal N’s Type III SS not additive, but used in tests (e.g., when you test for interaction) Additive means whether the SS for each factor adds to the Model SS. In this case, Type I SS will add up to equal the model SS, but not Type III SS.

2-way ANOVA: SAS output Sum of Source DF Squares Mean Square F Value Pr > F Model <.0001 Error Corrected Total R-Square Coeff Var Root MSE rt Mean Source DF Type III SS Mean Square F Value Pr > F group <.0001 agegrp <.0001 group*agegrp You can do a max of 3 contrasts here.

2-way ANOVA: Test State your hypotheses Find the F-obs Find the F-crit (remember to put dfs) Decision rule Comparison Statistical conclusion Research conclusion

Contrast DF Contrast SS Mean Square F Value Pr > F c c Contrast for Group*Agegrp

2-way ANOVA: Regression Setting up the model: Y ij = μ · + τ 1 X ij1 + ….+ τ r-1 X ij(r-1) + ε ijk Y ij = X β + ε ijk

2-way ANOVA: Regression NWK p. 834  full model Y ijk = μ.. + effect that you are interested in + ε ijk  reduced model Determine the composition of SS in ANOVA in regards to SS in Regression e.g., SS agegrp = SS agegrp-lin + SS agegrp-quad + SS agegrp-cubic

2-way ANOVA: Regression Find SS for full and reduced models Make use of Type III SS in the ANOVA SAS output  SS in the reduced model SS in regression could be combined to become SS in ANOVA

2-way ANOVA: Tests Effects Lack of fit: –SSE in ANOVA = SSPE –SSE in Reg = SSPE + SSLF –  SSLF = SSE(Reg) – SSE(ANOVA) –In regression models, SSLF = SSE – SSPE –SSE can be found in the full model, SSPE is the error terms that are beyond the degree that you are testing. –E.g., if you are testing the linear term and a df = 3 for a factor, the quadratic and the cubic terms will be the error terms

2-way ANOVA: contrast Number of levels in the other factor Sample size in each cell

2-way ANOVA: 1-way ANOVA How are the SS’s relating to each other? In 1-way ANOVA, the SS may or may not include SS from other factors. Hint: Use df to determine the composition of SS in 1-way and 2-way ANOVAs.

3-way ANOVA: Mixed or Random Error terms A, B fixed A fixed B random A, B random AMSEMSAB BMSE MSAB ABMSE

3-way ANOVA: graphs Examine graphs to look for significant effects Understand what information you can get from each plot When plots are comparing side-by- side, what is the product of overlaying one on the other?

C = 1

C = 2

Compare c = 1, 2 side by side

Average c = 1, 2

ANCOVA: Assumptions Random assignment to treatment Same regression slopes Covariate & treatment independent Covariate values fixed Linearity Normality Homogeneity of variance

ANCOVA: Data The MEANS Procedure N LANGUAGE Obs Variable Mean Std Dev TOTENON eppvtstd TOTENON eppvtstd

ANCOVA: before adjustment Sum of Source DF Squares Mean Square F Value Pr > F Model Error Corrected Total R-Square Coeff Var Root MSE TOTENON Mean Source DF Type III SS Mean Square F Value Pr > F LANGUAGE

ANCOVA: example

ANCOVA: after adjustment Sum of Source DF Squares Mean Square F Value Pr > F Model <.0001 Error Corrected Total R-Square Coeff Var Root MSE TOTENON Mean Source DF Type I SS Mean Square F Value Pr > F LANGUAGE eppvtstd <.0001 Source DF Type III SS Mean Square F Value Pr > F LANGUAGE eppvtstd <.0001

ANCOVA: after adjustment Standard Parameter Estimate Error t Value Pr > |t| Intercept B LANGUAGE B LANGUAGE B... eppvtstd <.0001 NOTE: The X'X matrix has been found to be singular, and a generalized inverse was used to solve the normal equations. Terms whose estimates are followed by the letter 'B' are not uniquely estimable. Least Squares Means TOTENON Standard LANGUAGE LSMEAN Error Pr > |t| < <.0001

ANCOVA: Find the adjusted means

ANCOVA: Regression & more Set up the regression model Test parallel slopes in ANOVA and regression Compare 1-way ANOVA and 1-way ANCOVA results  Where did the error go? What’s the advantage of running ANCOVA vs. ANOVA?

Repeated measure: Statistical Assumptions Different error terms for B/W subj and W/in subj factor(s) Compound symmetry  homogeneity of variance If violated: p-values biased downwards (actual α > nominal α) Solution: Geiser-Greenhouse, Huyhn- Feldt estimation methods

Repeated measure: Designs Objective: Control for individual differences Carry-over effect might override actual treatment effect  counterbalance order of treatment Sample designs: Completely randomized btw Ss design, completely w/in Ss design, Mixed design.

Repeated measure: Data Are all the nonwords the same? The four group literacy study: –B/w subj. effect: GROUP –W/in subj. effect: TYPE of nonwords

Repeated measure: Errors Total variation Between Subjects Within Subjects GROUP Ss w/in groups TYPE TYPE x GROUP TYPE x Ss w/in groups B/w Ss error term W/in Ss error term

Profile plot …

Repeated measure: B/w subj. The GLM Procedure Repeated Measures Analysis of Variance Tests of Hypotheses for Between Subjects Effects Source DF Type III SS Mean Square F Value Pr > F LANGUAGE Error B/w Ss error term

Repeated measure: W/in subj The GLM Procedure Repeated Measures Analysis of Variance Univariate Tests of Hypotheses for Within Subject Effects Source DF Type III SS Mean Square F Value Pr > F type <.0001 type*LANGUAGE Error(type) W/in Ss error term