 Graduate symposium deadline Friday  CSBS student conference April 25 (deadline April 10)  Thesis defenses  Outline due on Friday.

Slides:



Advertisements
Similar presentations
PhD Research Seminar Series: Valid Research Designs
Advertisements

Making Inferences about Causality In general, children who watch violent television programs tend to behave more aggressively toward their peers and siblings.
Copyright © Allyn & Bacon (2007) Single-Variable, Independent-Groups Designs Graziano and Raulin Research Methods: Chapter 10 This multimedia product and.
Field and Quasi-experiments
Validity of Quantitative Research Conclusions. Internal Validity External Validity Issues of Cause and Effect Issues of Generalizability Validity of Quantitative.
Lecture 09: Internal Validity and Experiments. Outline Causal Relations Internal Validity Threats to Internal Validity Video Games and Violence Designs.
Experimental Research Designs
INFERENTIAL STATISTICS. Descriptive statistics is used simply to describe what's going on in the data. Inferential statistics helps us reach conclusions.
Chapter 9 Group-Level Research Designs. CHARACTERISTICS OF “IDEAL” EXPERIMENTS Controlling the Time Order of Variables Manipulating the Independent Variable.
Experimental Control & Design Psych 231: Research Methods in Psychology.
Group-Level Research Designs
Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Educational Research by John W. Creswell. Copyright © 2002 by Pearson Education. All rights reserved. Slide 1 Chapter 11 Experimental and Quasi-experimental.
© 2001 Dr. Laura Snodgrass, Ph.D.1 Basic Experimental Design Common Problems Assigning Participants to Groups Single variable experiments –bivalent –multivalent.
2x2 BG Factorial Designs Definition and advantage of factorial research designs 5 terms necessary to understand factorial designs 5 patterns of factorial.
Chapter 9 Experimental Research Gay, Mills, and Airasian
L1 Chapter 11 Experimental and Quasi- experimental Designs Dr. Bill Bauer.
SW388R7 Data Analysis & Computers II Slide 1 Multiple Regression – Basic Relationships Purpose of multiple regression Different types of multiple regression.
Efficacy of Exercise in Reducing Depressive Symptoms.
Experimental Design The Gold Standard?.
Statistical Analyses & Threats to Validity
Copyright © 2008 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved. John W. Creswell Educational Research: Planning,
Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
Chapter 11 Experimental Designs
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 11 Experimental Designs.
Design Experimental Control. Experimental control allows causal inference (IV caused observed change in DV) Experiment has internal validity when it fulfills.
Between- Subjects Design Chapter 8. Review Two types of Ex research Two basic research designs are used to obtain the groups of scores that are compared.
INTRO TO EXPERIMENTAL RESEARCH, continued Lawrence R. Gordon Psychology Research Methods I.
Group Quantitative Designs First, let us consider how one chooses a design. There is no easy formula for choice of design. The choice of a design should.
Correlational Research Chapter Fifteen Bring Schraw et al.
Psychology 301 Chapters & Differences Between Two Means Introduction to Analysis of Variance Multiple Comparisons.
Experimental Designs. Experiments are conducted to identify how independent variables influence some change in a dependent variable.
SW388R6 Data Analysis and Computers I Slide 1 Multiple Regression Key Points about Multiple Regression Sample Homework Problem Solving the Problem with.
Mixed-Design ANOVA 5 Nov 2010 CPSY501 Dr. Sean Ho Trinity Western University Please download: treatment5.sav.
ITEC6310 Research Methods in Information Technology Instructor: Prof. Z. Yang Course Website: c6310.htm Office:
Adjusted from slides attributed to Andrew Ainsworth
Introduction section of article
Quantitative Research SPED 500 Dr. Sandra Beyda Designs that maximize objectivity by using numbers, statistics, structure, and experimenter control Modes.
Internal Validity. All about whether the research design (and data analysis) warrants the conclusions. Concerned with: – Causal relationships – Various.
One-Way Analysis of Covariance (ANCOVA)
Chapter 10 Experimental Research Gay, Mills, and Airasian 10th Edition
Chapter 8 – Lecture 6. Hypothesis Question Initial Idea (0ften Vague) Initial ObservationsSearch Existing Lit. Statement of the problem Operational definition.
Research Design. Time of Data Collection Longitudinal Longitudinal –Panel study –Trend study –Cohort study Cross-sectional Cross-sectional.
Chapter 11.  The general plan for carrying out a study where the independent variable is changed  Determines the internal validity  Should provide.
Chapter 8: Between Subjects Designs
Chapter Eight: Quantitative Methods
Experimental Research Design Causality & Validity Threats to Validity –Construct (particular to experiments) –Internal –External – already discussed.
NURS 306, Nursing Research Lisa Broughton, MSN, RN, CCRN RESEARCH STATISTICS.
Chapter 11 REGRESSION Multiple Regression  Uses  Explanation  Prediction.
Can you hear me now? Keeping threats to validity from muffling assessment messages Maureen Donohue-Smith, Ph.D., RN Elmira College.
Mediation: Assumptions David A. Kenny davidakenny.net.
Mediation. 1.Definition 2. Testing mediation using multiple regression Baron, R. M., & Kenny, D. A. (1986). The moderator-mediator variable distinction.
Experimental Research Designs. Experimental Design Advantages  Best establishes cause-and-effect relationships Disadvantages  Artificiality of experiments.
8 Experimental Research Design.
Experimental and Quasi-Experimental Research
Experimental Research Designs
Between- Subjects Design
Experimental Design.
Moderation, Mediation, and Other Issues in Regression
Single-Variable, Independent-Groups Designs
Statistical Analyses & Threats to Validity
12 Inferential Analysis.
Chapter Eight: Quantitative Methods
2 independent Groups Graziano & Raulin (1997).
Introduction to Design
12 Inferential Analysis.
Quasi-Experimental Designs
Group Experimental Design
Chapter 11 EDPR 7521 Dr. Kakali Bhattacharya
Presentation transcript:

 Graduate symposium deadline Friday  CSBS student conference April 25 (deadline April 10)  Thesis defenses  Outline due on Friday

 What is internal validity? How can it be increased?  What are the relationships between internal, external, and construct validity?  What is needed to establish causality?

 History  Maturation  Testing  Instrumentation  Mortality  Regression to the mean  What are each of these (examples) and how can they be decreased/controlled?

 Why does it happen?  When will it happen more?  How can you estimate it?

 Selection  Selection-history  Selection-maturation  Selection-testing  Selection-instrumentation  Selection-mortality  Selection-regression  What are each of these (examples) and how can they be decreased/controlled?

 Diffusion of treatment  Compensatory rivalry  Resentful demoralization  Compensatory equalization of treatment  What are each of these (examples) and how can they be decreased/controlled?

 X O  R O X O R O O N O X O N O O N O

 vs. random selection  What is the strongest design in terms of internal validity threats?  Why would you want to add a pretest? Or not?  Are there times that you wouldn’t want to randomly assign?

 Independent vs. dependent variables  Within vs. between-participants designs: advantages?  What are control variables?  What can you do to reduce confounds in research?

 What are they and why do we care?  What are levels vs. variables?  What kind of FD is this? How many main effects are possible? How many interactions? How many groups? How many people at n=10?  IVs: Presence of an audience, difficulty of task (easy, medium, or hard). DV = nervousness  IVs: Gender, Drug vs. CBT vs. control, previous experience with treatment (yes or no). DV=reduction in symptoms

 People who were alone helped more often than those who were with a confederate. Seminary students also helped more often than business students.  Men and women helped equally overall, but men were more likely to help women than to help men.

 Null results  Main effect  Interaction  Block design  Covariate  Solomon 4-group  Switching design  ANOVA vs. ANCOVA vs. regression

 If a factorial design is good, is a bigger one better?  When would you want to include a variable as an IV vs. a covariate vs. something you match on vs. a control variable?  How do you decide which variables to include?

 What is a moderator?  How is a moderator different from a/an  IV?  DV?  Confound?  Mediator?  Covariate?  How can you design a study to test a moderator (various ways)?

 What is a mediator?  How is a mediator different from a/an  IV?  DV?  Confound?  Moderator?  Covariate?  How can you design a study to test a mediator (various ways)?

 A study finds that convicted criminals are more likely than noncriminals to score low (negatively) on the Attitudes toward Women Scale. Further research shows, however, that this is only true for violent criminals. There is no relationship between nonviolent criminal activity and negative attitudes toward women. Identify the mediator or moderator.  2. A researcher finds that by increasing self-focus in children, she can decrease their likelihood of cheating on a test. By decreasing cheating, in turn, she finds that academic self-efficacy increases. Identify the mediator or moderator.  3. Dr. Laylor finds a relationship between physical attractiveness and self- confidence. He later determines that the primary cause of this relationship is the positive feedback physically attractive people receive from others. Identify the mediator or moderator.  4. Boys who are popular with the same-sex tend to also be popular with the opposite-sex, whereas girls who are popular with the same-sex tend to be less popular with the opposite-sex. Identify the mediator or moderator.  5. Identify and explain at least two potential mediators and two potential moderators for the following relationship: School size and academic achievement.

 Table 1—why do some areas of psychology use more mediators than others?

 Case 1: Cat IV, Cat Mod:  2 x 2 ANOVA  Case 2: Cont IV, Cat Mod:  Could do correlations sep and compare BUT  Better to do regression and compare unstandardized Betas  Or SEM software

 Case 3: Cat IV, Cont Mod:  Figure out how level of moderator affects IV-DV relationship  If linear, do hierarchical regression, showing that XZ adds to the effects of X and Z on Y  Case 4: Both Cont:  Use Case 2 if step function or  Use Case 3 if linear, quadratic  How do you know which one is the moderator vs. IV?

 Causal steps (Baron & Kenny)  IV related to M M = i + aX + e  IV related to DV Y = i + c1X + e  M and IV related to DV Y = i + c2X + bM + e  C1 greater than C2 (look at size and sig)  Limitations:  Not good for multilevel, probit, logistic, survival  Need to test for whether C1 > C2 (Sobel test)  Low power esp when IV and DV aren’t related  Overestimates effect of IV on DV if error in M

 Used to test whether C1 > C2  Good for sample sizes of 50+ with 1 M  Or for >1 M

 Use multiple measures of M and use SEM  Distribution of the product  PRODCLIN  Better Type I error rates, higher power  Computer-intensive methods  Aka resampling  Fewer assumptions

 Residuals are independent in equations 2 and 3  No XM interaction in equation 3  Direction is correct (DV doesn’t cause M)  Measurement is perfect, esp. in M  No unmeasured variables that cause X, Y, or M  IV related to M M = i + aX + e  IV related to DV Y = i + c1X + e  M and IV related to DV Y = i + c2X + bM + e

 Complete vs. partial mediation  Use hierarchical regression  Test C2 significance  Inconsistent mediation  Multilevel mediation  Can increase T1 error if you ignore  Categorical DV mediation  Use logistic or probit regression  Multiple mediators

 Longitudinal mediation  Moderated mediation  Mediated moderation  Mediated baseline by treatment moderation

 How do you know which variable is the mediator?  How can a moderator lead you to a mediator?  How can a mediator lead you to a moderator?  Can a variable be both a mediator and a moderator at the same time?  Are there variables that are always going to be one or the other?  Does a mediator have to be correlational?  Remember that one study does not a mediator/moderator make

 Think of sections as headings in your thesis  Keep headings parallel  Always have at least 2 in each group  Think about the best logical order for things, and keep the order consistent throughout the paper

 Quasi-experiments  2 book chapters plus other chapter