1 Multilevel Mediation Overview -Mediation -Multilevel data as a nuisance and an opportunity -Mediation in Multilevel Models -http://www.public.asu.edu/~davidpm/

Slides:



Advertisements
Similar presentations
Lecture 2 The Science of Psychology
Advertisements

Multilevel Models with Latent Variables Daniel J. Bauer Department of Psychology University of North Carolina 9/13/04 SAMSI Workshop.
To go further: intra- versus interindividual variability.
{ Multilevel Modeling using Stata Andrew Hicks CCPR Statistics and Methods Core Workshop based on the book: Multilevel and Longitudinal Modeling Using.
Hierarchical Linear Modeling: An Introduction & Applications in Organizational Research Michael C. Rodriguez.
A Conceptual Introduction to Multilevel Models as Structural Equations
By Zach Andersen Jon Durrant Jayson Talakai
Statistical Analysis Overview I Session 2 Peg Burchinal Frank Porter Graham Child Development Institute, University of North Carolina-Chapel Hill.
Correlation and regression
Deviant Behaviour Amongst Adolescent Youth An analysis using the Theory of Planned Behaviour Grace Skrzypiec October 2005.
Analyzing diary data: Multilevel approach Asko Tolvanen & Kaisa Aunola Methodology Center for Human Science& Department of Psychology University of Jyväskylä.
Psychology 202b Advanced Psychological Statistics, II February 1, 2011.
Multiple Linear Regression Model
Correlation and Autocorrelation
 Confounders are usually controlled with the “standard” response regression model.  The standard model includes confounders as covariates in the response.
Longitudinal Experiments Larry V. Hedges Northwestern University Prepared for the IES Summer Research Training Institute July 28, 2010.
Experimental Design, Statistical Analysis CSCI 4800/6800 University of Georgia Spring 2007 Eileen Kraemer.
1 Introduction to Statistical Mediation David P. MacKinnon Arizona State University Center for AIDS Prevention Studies, UCSF, June 12-13, 2007 Brown, Cheong,
1 Special Topic: Logistic Regression for Binary outcomes The dependent variable is often binary such as whether a person litters or not, used a condom.
1 Multiple Mediator Models  Most behaviors are affected by multiple mediators.  Straightforward extension of the single mediator case but interpretation.
Clustered or Multilevel Data
1 Design Approaches to Causal Inference Statistical mediation analysis answers the following question, “How does a researcher use measures of the hypothetical.
Analysis of Individual Variables Descriptive – –Measures of Central Tendency Mean – Average score of distribution (1 st moment) Median – Middle score (50.
Simple Linear Regression Analysis
Analysis of Clustered and Longitudinal Data
Introduction to Multilevel Modeling Using SPSS
Multilevel Modeling: Other Topics
An Introduction to HLM and SEM
Multilevel Modeling 1.Overview 2.Application #1: Growth Modeling Break 3.Application # 2: Individuals Nested Within Groups 4.Questions?
Copyright 2004, D. P. MacKinnon 1 Methods to study Treatment Mechanisms of Action David P. MacKinnon NIDA Mechanisms Conference February 26 and 27, 2004.
Sampling and Nested Data in Practice- Based Research Stephen Zyzanski, PhD Department of Family Medicine Case Western Reserve University School of Medicine.
A Random Coefficient Model Example: Observations Nested Within Individuals Academy of Management, 2010 Montreal, Canada Jeffrey B. Vancouver Ohio University.
Copyright 2003, D. P. MacKinnon 1 Mediator and Moderator Methods David P. MacKinnon Arizona State University AABT November 22, 2003 PAlternative Methods.
Hierarchical Linear Modeling (HLM): A Conceptual Introduction Jessaca Spybrook Educational Leadership, Research, and Technology.
Introduction Multilevel Analysis
Are outcome expectancies the possible targets of smoking prevention? The roles of smoking outcome expectancies in adolescent smoking Urbán Róbert PhD Eötvös.
The Common Shock Model for Correlations Between Lines of Insurance
Multilevel Data in Outcomes Research Types of multilevel data common in outcomes research Random versus fixed effects Statistical Model Choices “Shrinkage.
Various topics Petter Mostad Overview Epidemiology Study types / data types Econometrics Time series data More about sampling –Estimation.
Introduction to Multilevel Modeling Stephen R. Porter Associate Professor Dept. of Educational Leadership and Policy Studies Iowa State University Lagomarcino.
All Hands Meeting 2005 The Family of Reliability Coefficients Gregory G. Brown VASDHS/UCSD.
Statistical Models for the Analysis of Single-Case Intervention Data Introduction to:  Regression Models  Multilevel Models.
1 G Lect 14M Review of topics covered in course Mediation/Moderation Statistical power for interactions What topics were not covered? G Multiple.
CORRELATION: Correlation analysis Correlation analysis is used to measure the strength of association (linear relationship) between two quantitative variables.
Regression Analysis Part C Confidence Intervals and Hypothesis Testing
Multilevel Modeling: Other Topics David A. Kenny January 7, 2014.
Basics of Mediation David A. Kenny. 2 Interest in Mediation Mentions of “mediation” or “mediator” in psychology abstracts: –1980: 36 –1990: 122 –2000:
1.) *Experiment* 2.) Quasi-Experiment 3.) Correlation 4.) Naturalistic Observation 5.) Case Study 6.) Survey Research.
Data Analysis in Practice- Based Research Stephen Zyzanski, PhD Department of Family Medicine Case Western Reserve University School of Medicine October.
Assessing the Total Effect of Time-Varying Predictors in Prevention Research Bethany Bray April 7, 2003 University of Michigan, Dearborn.
Review I A student researcher obtains a random sample of UMD students and finds that 55% report using an illegally obtained stimulant to study in the past.
© (2015, 2012, 2008) by Pearson Education, Inc. All Rights Reserved Chapter 11: Correlational Designs Educational Research: Planning, Conducting, and Evaluating.
T tests comparing two means t tests comparing two means.
Sharon Wolf NYU Abu Dhabi Additional Insights Summer Training Institute June 15,
Sampling and Nested Data in Practice-Based Research Stephen Zyzanski, PhD Department of Family Medicine Case Western Reserve University School of Medicine.
Chapter 5 Multilevel Models
Reliability performance on language tests is also affected by factors other than communicative language ability. (1) test method facets They are systematic.
Intro to Psychology Statistics Supplement. Descriptive Statistics: used to describe different aspects of numerical data; used only to describe the sample.
4 basic analytical tasks in statistics: 1)Comparing scores across groups  look for differences in means 2)Cross-tabulating categoric variables  look.
Assumptions of Multiple Regression 1. Form of Relationship: –linear vs nonlinear –Main effects vs interaction effects 2. All relevant variables present.
Chapter 22 Inferential Data Analysis: Part 2 PowerPoint presentation developed by: Jennifer L. Bellamy & Sarah E. Bledsoe.
Expected Return and Risk. Explain how expected return and risk for securities are determined. Explain how expected return and risk for portfolios are.
Chapter 9 Introduction to the t Statistic
CJT 765: Structural Equation Modeling
Lecture 4 - Model Selection
From GLM to HLM Working with Continuous Outcomes
Special Topic: Longitudinal Mediation Analysis
An Introductory Tutorial
Created by Erin Hodgess, Houston, Texas
Type I and Type II Errors
Presentation transcript:

1 Multilevel Mediation Overview -Mediation -Multilevel data as a nuisance and an opportunity -Mediation in Multilevel Models - -Research Funded by National Institute on Drug Abuse and Prevention Science Methodology Group

2 Mediation Statements If norms become less tolerant about smoking then smoking will decrease. If at-risk children are taught in classrooms with appropriate management, they will have more educational success. If parents learn effective discipline, the negative effects of divorce will be reduced. If parental monitoring is increased then adolescents will be less likely to use drugs.

3 Mediator A variable that is intermediate in the causal process relating an independent to a dependent variable. Antecedent to Mediating to Consequent (James & Brett, 1984) Initial to Mediator to Outcome (Kenny, Kashy & Bolger, 1998) Program to surrogate endpoint to ultimate endpoint (Prentice, 1989) Independent to Mediating to Dependent used in this presentation.

4 Single Mediator Model MEDIATOR M INDEPENDENT VARIABLE XY DEPENDENT VARIABLE ab c’

5 Relation of X to Y MEDIATOR M INDEPENDENT VARIABLE XY DEPENDENT VARIABLE c 1.The independent variable is related to the dependent variable: Y = i 1 + c X +  

6 Relation of X to M MEDIATOR M INDEPENDENT VARIABLE XY DEPENDENT VARIABLE 2. The independent variable is related to the potential mediator: M = i 2 + a X +   a

7 Relation of X and M to Y MEDIATOR M INDEPENDENT VARIABLE XY DEPENDENT VARIABLE a 3. The mediator is related to the dependent variable controlling for exposure to the independent variable: Y = i 3 + c’ X + b M +   b c’

8 Mediated Effect Measures Mediated effect=ab Standard error= Mediated effect=ab=c-c’ (MacKinnon et al., 1995) Direct effect= c’ Total effect= ab+c’=c Test for significant mediation: z’=Compare to empirical distribution of the mediated effect abab

9 Mediation Assumptions I  For each method of estimating the mediated effect based on Equations 2 and 3 (ab) or Equations 1 and 3 (c – c’):  Predictor variables are uncorrelated with the error in each equation.  Errors are uncorrelated across equations.  Predictor variables in one equation are uncorrelated with the error in other equations.  Correctly specified model.  Independent Observations: Violations are the subject of this presentation

10 Importance of Mediation in Prevention and Treatment Research Mediation is important because it provides information about how a program works or fails to work. Practical implications include reduced cost and more effective interventions. Mediation analysis is an ideal way to test theory. A theory based approach focuses on the processes underlying programs. Action theory corresponds to how the program will affect mediators. Conceptual Theory focuses on how the mediators are related to the dependent variables (Chen, 1990, Lipsey, 1993).

11 Grouping/Clustering Variables in Prevention Research Schools, Clinics, Classrooms, Therapy Groups Families, Siblings, Dyads Cities, Counties, Courts, Zipcodes, Countries Also observations from Individuals observations from different times.

12 Clustering and Independent Observations Observations in groups may lead to dependency among respondents in the same group. The dependency could be due to communication among persons in the same group, similar backgrounds, or similar response biases. Violation of independent observations an assumption of many statistical analyses.

13 Intraclass Correlation (ICC) ICC provides a measure of extent to which observations in a group tend to respond in the same way compared to other groups. ICC ranges from 1 to –1/(k-1) where k is the number of subjects in each group. ICC =τ oo / (τ oo + σ 2 ) where τ oo is variance among groups and σ 2 is the variance among individuals. Many different ICCs depending on additional predictors in the model.

14 Example ICC values.01 number of cigarettes smoked (Murray et al., 1994) and clustering by schools..02 for physical activity among girls (Murray et al., 2004)..001 to.12 for mediators of social norms, attitudes, knowledge for football players in high schools (Krull & MacKinnon, 1999).

15 Why is a nonzero ICC a problem? Increases Type I error rates if it is ignored (Barcikowski, 1981). Actual sample size is smaller than observed sample size because of violation of independence (Hox, 2002). Effective sample size is N effective = n total /[(1+n cluster -1)ICC], where n total is the total sample size and n cluster is the number of persons in each cluster.

16 Multilevel Mediation Examples  Residential instability reduced collective efficacy which increased violence (neighborhoods, Sampson et al., 1997)  Anabolic prevention program affects norms regarding healthy behavior which reduced intentions to use steroids (high school football teams, Krull & MacKinnon, 1999; 2001).  Alcohol prevention program affected norms which reduced alcohol use, (schools, Komro et al., 2001)

17 Symposium Multilevel Mediation Examples  Stressors to coping to distress. Cluster is observations within individuals ( Dan Feaster et al., )  Stress to communication to marital quality. Cluster is dyads of husband/wife (Getachew Dagne et al.,).  Longitudinal relations between stress and depression. Cluster is observations within individuals (George Howe et al.).

18 Model for the X to Y relation Individual, Level 1: Y ij = β 0j + e ij Group, Level 2: β 0j = γ 00 + c j X j + u 0j  i th individual in the j th group. The group level intercept, β 0j, is the dependent variable in the Level 2 equation. Note that c j is at the group level because assignment is at the group level for this example. It is possible to have individual c i, and/or group level c j coefficients.

19 Model for Y Predicted by X and M Individual, Level 1 : Y ij = β 0j + b i M ij + e ij Group, Level 2: β 0j = γ 00 + c’ j X j + u 0j  The b i parameter is at the individual level because the mediator is assumed to work through individuals and the c’ j parameter is at the group level because of assignment by group. Other analyses may have b and c’ coefficients at different or all levels. Note the slopes, b j, may be the dependent variable in another equation so slopes are a random coefficient that differs across groups.

20 Model for the X to M relation Individual, Level 1 : M ij = β 0j + e ij Group, Level 2: β 0j = γ 00 + a j X j + u 0j  X predicts the dependent variable M. The a j parameter is estimated at the group level because assignment to conditions is at the group level for this example. Again it is possible to have individual, a i, and/or group level, a j coefficients.

21 Multilevel Mediation Opportunities  Example with X at the group level and M and Y at the individual level is common.  There are many other opportunities. Slopes may be random coefficients that differ across groups. The slope relating M to Y may differ across groups. If X codes assignment then the X to M relation is not random. But if X differs across individuals, then the X to M and M to Y slopes may both be random.

22 Multilevel mediation effects at for two-level models Level of X, M, and Y can be used to describe different types of multilevel models. Assume X, M, and Y are all measured at the individual level. 1  1  1; X, M, and Y measured at the individual level. 2  1  1; X at level 2, M and Y at the individual level. 2  2  1; X and M at level 2, Y at the individual level. 2  2  2; X, M, and Y level 2. Models with more than two levels.

23 The ab and c-c’ estimators The ab and c-c’ estimators of the mediated effect, algebraically equivalent in single-level models, are not exactly equivalent in the multilevel models (Krull & MacKinnon, 1999). This is because the weighting matrix used to estimate the model properly in the multilevel equations is typically not identical for each of the three equations. The non-equivalence between ab and c-c’, however, is typically small and tends to vanish at larger sample sizes (Krull & MacKinnon, 1999).

24 The ab standard error estimators The standard error of the mediated effect is calculated using the same formulas described above, except that the estimates and standard errors of a and b may come from equations at different levels of analysis and if both coefficients are random they may require the covariance between a and b.

25 What if a and b coefficients represent random effects? The random coefficients a and b may be correlated so the covariance between a and b must be included in the standard error (Kenny, Bolger, & Korchmaros, 2003). ab random =ab + covariance(ab) Var(ab random ) = a 2 s b 2 +b 2 s a 2 + s a 2 s b 2 + 2abs b s a r ab + s a 2 s b 2 r ab 2 r ab is the correlation between the a and b random coefficients.

26 When will a and b coefficients represent random effects? Three variable longitudinal growth model where the relation of X to Y varies across individuals and the relation of M to Y varies across individuals. Kenny et al. (2003) describe an example with daily measures of stressors, coping, and mood. The stressor to coping and coping to mood relations were random, i.e., varied across individuals.

27 But how do you get the correlation between a and b when they are random? Kenny et al. (2003) used a data driven approach where the values for a and b in each cluster were correlated. Bauer et al. (2006) use a method so that all coefficients are estimated simultaneously so that the covariance between a and b is given. New version of Mplus will estimate the correlation/covariance between random coefficients such as a and b.

28 Summary and Future Directions Two views of multilevel data: (1) a nuisance in the statistical analysis and (2) an opportunity to investigate effects at different levels. New Mplus version allows for estimation of models for random a and b effects. Bauer et al., (2006) describe a SAS approach to finding this covariance. Can have very complicated models with many levels and potential mediation across and between levels.