Survey of Major Correlational Models/Questions Still the first & most important is picking the correct model… Simple correlation questions simple correlation.

Slides:



Advertisements
Similar presentations
MANOVA (and DISCRIMINANT ANALYSIS) Alan Garnham, Spring 2005
Advertisements

Inferential Statistics and t - tests
Transformations & Data Cleaning
Canonical Correlation simple correlation -- y 1 = x 1 multiple correlation -- y 1 = x 1 x 2 x 3 canonical correlation -- y 1 y 2 y 3 = x 1 x 2 x 3 The.
Automated Regression Modeling Descriptive vs. Predictive Regression Models Four common automated modeling procedures Forward Modeling Backward Modeling.
Research Hypotheses and Multiple Regression: 2 Comparing model performance across populations Comparing model performance across criteria.
Survey of Major Correlational Models/Questions simple correlation questions obtaining and comparing bivariate correlations statistical control questions.
ANCOVA Workings of ANOVA & ANCOVA ANCOVA, Semi-Partial correlations, statistical control Using model plotting to think about ANCOVA & Statistical control.
Factorial Hypotheses Some review & practice Identifying main effect and interaction RH: Explicit factorial RH: “Blending” interaction and main effect RH:
Factorial Designs: Research Hypotheses & Describing Results Research Hypotheses of Factorial Designs Inspecting tables to describe factorial data patterns.
Statistical Control Regression & research designs Statistical Control is about –underlying causation –under-specification –measurement validity –“Correcting”
Regression Models w/ k-group & Quant Variables Sources of data for this model Variations of this model Main effects version of the model –Interpreting.
ANCOVA Workings of ANOVA & ANCOVA ANCOVA, Semi-Partial correlations, statistical control Using model plotting to think about ANCOVA & Statistical control.
Introduction to Path Analysis Reminders about some important regression stuff Boxes & Arrows – multivariate models beyond MR Ways to “think about” path.
Multiple Regression Models Advantages of multiple regression Important preliminary analyses Parts of a multiple regression model & interpretation Differences.
Multiple Regression Models: Some Details & Surprises Review of raw & standardized models Differences between r, b & β Bivariate & Multivariate patterns.
Survey of Major Correlational Models/Questions Still the first & most important is picking the correct model… Simple correlation questions simple correlation.
Introduction the General Linear Model (GLM) l what “model,” “linear” & “general” mean l bivariate, univariate & multivariate GLModels l kinds of variables.
Simple Regression correlation vs. prediction research prediction and relationship strength interpreting regression formulas –quantitative vs. binary predictor.
Introduction to Path Analysis & Mediation Analyses Review of Multivariate research & an Additional model Structure of Regression Models & Path Models Direct.
Multivariate Analyses & Programmatic Research Re-introduction to Programmatic research Factorial designs  “It Depends” Examples of Factorial Designs Selecting.
Multivariate Analyses & Programmatic Research Re-introduction to Multivariate research Re-introduction to Programmatic research Factorial designs  “It.
Introduction to Multivariate Research & Factorial Designs
Simple Correlation Scatterplots & r Interpreting r Outcomes vs. RH:
Introduction to Path Analysis Ways to “think about” path analysis Path coefficients A bit about direct and indirect effects What path analysis can and.
2x2 ANOVA BG & MG Models Kinds of Factorial Designs ANOVA for BG, MG & WG designs Causal Interpretation of Factorial Results.
Prelude to Research Designs Review of a few things Demonstrations vs. Comparisons Experimental & Non-Experimental Designs “IVs” and “DVs” Between Group.
Multivariate Analyses & Programmatic Research Re-introduction to Multivariate research Re-introduction to Programmatic research Factorial designs  “It.
Some Details about Bivariate Stats Tests Conceptualizing the four stats tests Conceptualizing NHST, critical values and p-values NHST and Testing RH: Distinguishing.
Bivariate & Multivariate Regression correlation vs. prediction research prediction and relationship strength interpreting regression formulas process of.
Review of Factorial Designs 5 terms necessary to understand factorial designs 5 patterns of factorial results for a 2x2 factorial designs Descriptive &
Design Conditions & Variables Limitations of 2-group designs “Kinds” of Treatment & Control conditions Kinds of Causal Hypotheses Explicating Design Variables.
Simple Correlation RH: correlation questions/hypotheses and related statistical analyses –simple correlation –differences between correlations in a group.
Correlational Designs
2x2 BG Factorial Designs Definition and advantage of factorial research designs 5 terms necessary to understand factorial designs 5 patterns of factorial.
An Introduction to Classification Classification vs. Prediction Classification & ANOVA Classification Cutoffs, Errors, etc. Multivariate Classification.
Pearson’s r Scatterplots for 2 Quantitative Variables Research and Null Hypotheses for r Casual Interpretation of Correlation Results (& why/why not) Computational.
Experimental Group Designs
Moderation & Mediation
L 1 Chapter 12 Correlational Designs EDUC 640 Dr. William M. Bauer.
Extension to Multiple Regression. Simple regression With simple regression, we have a single predictor and outcome, and in general things are straightforward.
Statistical Control Statistical Control is about –underlying causation –under-specification –measurement validity –“Correcting” the bivariate relationship.
Multiple Linear Regression. Purpose To analyze the relationship between a single dependent variable and several independent variables.
Intro to Factorial Designs The importance of “conditional” & non-additive effects The structure, variables and effects of a factorial design 5 terms necessary.
ANOVA and Linear Regression ScWk 242 – Week 13 Slides.
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 12 Correlational Designs.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Regression Models w/ 2 Quant Variables Sources of data for this model Variations of this model Main effects version of the model –Interpreting the regression.
Basic Analysis of Factorial Designs The F-tests of a Factorial ANOVA Using LSD to describe the pattern of an interaction.
Regression Models w/ 2-group & Quant Variables Sources of data for this model Variations of this model Main effects version of the model –Interpreting.
Factorial Designs: Programmatic Research, RH: Testing & Causal Inference Applications of Factorial designs in Programmatic Research Research Hypotheses.
UNDERSTANDING DESCRIPTION AND CORRELATION. CORRELATION COEFFICIENTS: DESCRIBING THE STRENGTH OF RELATIONSHIPS Pearson r Correlation Coefficient Strength.
Simple Correlation Scatterplots & r –scatterplots for continuous - binary relationships –H0: & RH: –Non-linearity Interpreting r Outcomes vs. RH: –Supporting.
CORRELATIONS: PART II. Overview  Interpreting Correlations: p-values  Challenges in Observational Research  Correlations reduced by poor psychometrics.
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 12 Correlational Designs.
3-way Designs defining 2-way & 3-way interactions all the effects conditional and unconditional effects orthogonality, collinearity & the like kxkxk kxkxq.
ANCOVA Workings of ANOVA & ANCOVA ANCOVA, partial correlations & multiple regression Using model plotting to think about ANCOVA & Statistical control Homogeneity.
General Linear Model What is the General Linear Model?? A bit of history & our goals Kinds of variables & effects It’s all about the model (not the data)!!
Choosing and using your statistic. Steps of hypothesis testing 1. Establish the null hypothesis, H 0. 2.Establish the alternate hypothesis: H 1. 3.Decide.
Programmatic Research
Multiple Regression.
Hypothesis Testing.
Data, Univariate Statistics & Statistical Inference
Class 6 Hepp et al -15 Cha 13 Quant Descriptive Designs.
Multiple Regression.
Applied Statistical Analysis
کارگاه حجم نمونه با نرم افزار G*Power
Prediction/Regression
Prediction/Regression
Presentation transcript:

Survey of Major Correlational Models/Questions Still the first & most important is picking the correct model… Simple correlation questions simple correlation comparing a correlation across populations comparing correlated correlations Statistical control questions partial correlation multiple partial correlation semi-partial (part) correlation multiple semi-partial correlation Multiple regression questions multiple correlation comparing nested multiple regression models comparing non-nested multiple regression models comparing multiple regression models across populations comparing multiple regression models across criterion variables Path and Mediation Models

Picking the right statistical model… Started out simple … What kinds of variables ??? 2 quant  correlation 2 qual  X 2  ANOVA Got more interesting with larger ANOVA designs… What kinds of variables ? What kind of design – How many IVs? BG, MG or WG ? What kind of RH: -- main, simple or interaction effect? Now.. Different models, different “keys,” but same importance: the analysis must give the most direct test of RH: possible… if you pick the wrong model the analyses are worthless!!!

Survey of Major Correlational Models/Questions simple correlation questions obtaining and comparing bivariate correlations statistical control questions what “would be” the bivariate correlation is all participants had the same score on some “control variable”? multiple correlation questions obtaining and comparing models with multiple predictors

Simple Correlation questions (old friends) r y,x1 simple correlation of y and x1 r y,x1 vs. r y,x2 comparing “correlated” correlations within a population/group (uses Hotelling’s t-test or Steiger’s Z-test) r y,x1 vs. r y,x1 comparing the same bivariate correlation in 2 populations/grps (uses Fisher’s Z-test) Examples… Is there a relationship between # therapy sessions and symptomatic improvement? Is # therapy sessions a better predictor of symptomatic improvement than initial level of depression? Is # therapy sessions a better predictor of symptomatic improvement for adults than for adolescents? r imp,#ses r imp,#ses vs. r imp,init r imp,#ses for adults vs r imp,#ses for adolescents.

Does amount of practice predict performance better for novices that for experiences individuals? Does amount of practice predict level of performance? Does amount of practice predict performance better then prior experience? Same r, dif populations r perf,pract for novices vs. r perf,pract for experienced Use Fisher’s Z-test Simple r -- r perf,pract Compare r’s in the same pop r perf,pract vs. r perf,exp Hotelling’s t-test & Steiger’s Z-test Which type is each of the following? Use the notation & tell test used for each type of comparison

Statistical Control questions partial correlation questions -- is the relationship BOTH variables have with some 3rd variable(s) “producing” the bivariate relationship between them? r y,x1.x2 partial correlation of y & x1 controlling both for x2 (control var listed to right of “.” ) r y,x1.x2,x3 multiple partial correlation of y & x1 controlling both for x2 and x3 semi-partial (part) questions -- is the relationship JUST ONE of the variables have with some 3rd variable(s) “producing” the bivariate relationship between them? r y,(x1.x2) semi-partial correlation of y & x1, controlling the latter for x2 “( )” around variable being controlled and control variable r y,(x1.x2,x3) multiple semi-partial correlation of y & x1, controlling latterfor x2 & x3 “( )” around variable being controlled and control variables

Examples … Are # sessions and symptomatic improvement correlated after controlling symptomatic improvement for initial depression. Are # sessions and symptomatic improvement correlated after controlling both for initial depression? Are # sessions and symptomatic improvement correlated after controlling both for initial depression and age? Are # sessions and symptomatic improvement correlated after controlling symptomatic improvement for initial depression and age. Partial correlation r #ses,imp.init Multiple partial r #ses,imp.init,age Semi-partial r #ses (imp.init) Multiple semi-partial r #ses,(imp.init,age)

Does practice predict performance after controlling both for prior experience? Does practice predict performance after controlling performance for prior experience and age? Does practice predict performance after controlling performance for age? Does practice predict performance after controlling both for prior experience and age? partial r perf,prac.exp multiple semi-partial r prac(perf.exp,age) semi-partial r prac(perf.age) multiple partial r perf,prac.exp,age Which type is each of the following?

Multiple Regression questions R y.x1,x2,x3,x4 ² multiple correlation with y as the criterion and x1, x2, x3 and x4 as predictors predictors to right of “.” R y.x1,x2,x3,x4 ² vs. R y.x1,x2, ² comparing nested models (uses R 2 change F-test) R y.x1,x2 ² vs. R y.x3,x4 ² comparing non-nested models (uses Hotelling’s t-test or Steiger’s Z-test) R y.x1,x2,x3,x4 ² vs. R y.x1,x2,x3,x4 ² comparing the same multiple regression model in two different populations (uses Fisher’s Z-test & H’s t or Steiger’s Z-test) R y.x1,x2,x3,x4 ² vs. R z.x1,x2,x3,x4 ² comparing the same multiple regression model with two different criterion, in the same population ( Hotelling’s t-test & Steiger’s Z-test )

Examples… Symptomatic improvement is predicted from a combination of # sessions, initial depression and age. Symptomatic improvement is predicted from a combination of # sessions, initial depression and age and prediction is improved by adding # of prior therapists. Symptomatic improvement is predicted better from a combination of # sessions, initial depression and age than from # sessions & # of prior therapists. Symptomatic improvement is predicted from a combination of # sessions, initial depression and age better for adults than for adolescents. A combination of # sessions, initial depression and age predicts symptomatic improvement better than it predicts treatment satisfaction. R imp.#ses,init,age 2 vs. R imp.#ses,init,age,#ther 2 R imp.#ses,init,age 2 R imp.#ses,init,age 2 vs. R imp.#ses,#ther 2 R imp.#ses,init,age 2 for adults vs. for adolescents R imp.#ses,init,age 2 vs. R tsat.#ses,init,age 2

Do practice, prior skill and motivation predict performance? Do practice, prior skill and motivation predict performance on a speeded task as well as they they predict performance on an accuracy task? Do practice, prior skill and motivation predict performance as well as do prior skill and motivation? Do practice, prior skill and motivation predict performance as well as do practice, motivation and age? Do practice, prior skill and motivation predict performance as well for amateurs as for professionals? single model R perf.prac,skill 2 single model for 2 criterion H & S R speed.prac,skill 2 vs. R acc.prac,skill 2 nested model comparisons R 2 -  F-test R perf.prac,skill,mot 2 vs. R perf.prior,mot 2 non-nested models H & S R perf.prac,skill,mot 2 vs. R perf.prac,mot,age 2 R 2 for 2 populations F’s Z-test - S R perf.prac,skill,mot 2 Which type is each of the following? Use the notation & tell the test used for each model comparison

Path Analysis One way to “think about” path analysis is as an improvement to multiple regression. In addition to asking how the various predictors related to the criterion, path analysis asks how the predictors related to each other on the “temporal/causal path” “Structure” of a MR model – with hypotheses about which predictors will contribute A proposed structure for the colinearity among the predictors and how they relate to the criterion – with hypotheses about which paths will contribute Crit earliermore recent distal causeproximal cause

TQ EP r =.40 β=.0 ST β=.4 β=.3 Mediation Analysis Mediation analyses can be thought of as a variety of path analysis that focusses on understanding whether the apparent effect of one variable upon another, based on their temporal precedence pattern and simple correlation, represents a direct effect or one that is mediated by an indirect effect involving another variable. Here the purpose of the analysis is to consider the r=.4 of Teaching Quality and Exam Performance, when one includes the potential intermediate variable Study Time. If β TQ =.00  complete mediation If.00 < β TQ < r TQ  partial mediation If β TQ = r TQ  no mediation

Path analyses usually refer to examination and hypothesis testing about “direct effects” and “indirect effects”. Mediation analyses usually refer to “intermediate variables”. Examples… Motivation to succeed has both direct and indirect effects in a model of classroom learning. However, teaching quality does not have direct effects, but does have indirect effects through exam study time. Exam study time is an important intermediate variable when considering the relationship between teaching quality and classroom performance. Path Analysis Mediation Analysis

Which is each of the following? How good an employee’s manager is will be an important intermediate variable when considering the relationship between prior sales experience and sales success. Prior sales experience will have both direct and indirect effects upon sales success. Number of therapeutic sessions Therapeutic engagement will have indirect effects upon therapeutic outcome through therapeutic engagement, but will not have direct effects. You have to consider therapeutic engagement as an intermediate variable between number of sessions and therapeutic outcome. Path Analysis Mediation Analysis Path Analysis Mediation Analysis