1. Introduction to Validity

2. What is Validity? l The best available approximation to the truth or falsity of a given inference, proposition, or conclusion l A set of standards by which research can be judged

3. The Causal Context Theory Observation

4. Theory Observation Causeconstruct

5. Theory Observation Causeconstruct

6. Theory Observation CauseconstructEffectconstruct cause-effect construct

7. The Causal Context Theory Observation CauseconstructEffectconstruct What you think cause-effect construct

8. The Causal Context Theory Observation CauseconstructEffectconstruct Program What you think In this study Cause-Effect Construct Operationalize

9. The Causal Context Theory Observation CauseconstructEffectconstruct ProgramObservations What you think In this study Cause-effect Construct Operationalize Operationalize

10. The Causal Context Theory Observation CauseconstructEffectconstruct ProgramObservations What you do What you see What you think In this study Cause-effect Construct Operationalize Operationalize

11. The Causal Context Theory Observation CauseconstructEffectconstruct ProgramObservations What you do What you see What you think What you test In this study Cause-effect Construct Program-outcome Relationship Operationalize Operationalize

12. Conclusion Validity l What you did and what you saw? l Your program and your observations? Observation ProgramObservations What you do What you see Is there a relationship between... In this study Program-outcome Relationship

13. Internal Validity What you did and what you saw?What you did and what you saw? Your program and your observations?Your program and your observations? Observation ProgramObservations What you do What you see Is the relationship causal between... Alternativecause Alternativecause Alternativecause Alternativecause In this study Program-outcome Relationship

14. Construct Validity Theory Observation CauseconstructEffectconstruct ProgramObservations What you do What you see What you think Cause-effect Construct Program-outcome Relationship Can we generalize to the constructs?

15. External Validity Theory CauseconstructEffectconstruct What you think Cause-effect Construct Observation ProgramObservations What You Do What You See program-outcome relationship Observation ProgramObservations What You Do What you see program-outcome relationship Observation ProgramObservations What You Do What You See program-outcome relationship Observation ProgramObservations What You Do What You See program-outcome relationship Can we generalize to other persons, places, times?

16. The Validity Questions Are Cumulative...

17. In this study Is there a relationship between the cause and effect?

18. The Validity Questions Are Cumulative... Conclusion Is there a relationship between the cause and effect? Is the relationship causal? In this study

19. The Validity Questions Are Cumulative... In theory Is there a relationship between the cause and effect? Is the relationship causal? Can we generalize to the constructs? Conclusion Internal

20. The Validity Questions Are Cumulative... Construc t Is there a relationship between the cause and effect? Is the relationship causal? Can we generalize to the constructs? Can we generalize to other persons, places, times? In theory Conclusion Internal

21. The Validity Questions are cumulative... Is there a relationship between the cause and effect? Is the relationship causal? Can we generalize to the constructs? Can we generalize to other persons, places, times? External Validity Conclusion Internal Construct

22. Threats to Validity You Want to Make an Inference... l There is a relationship between the cause and effect. l The relationship is causal. l You can generalize to the constructs. l You can generalize to other persons, places, and times.

23. Threats to Validity l There is a relationship, but you don’t see it. l There is no relationship, but you do see one. How could you be wrong in the inference? Conclusion Validity

24. Threats to Validity l There is a causal relationship, but you don’t see it. l There is no causal relationship, but you do see one. How could you be wrong in the inference? Internal Validity

25. Threats to Validity l You can generalize to constructs, but you conclude you can’t. l You can’t generalize to constructs, but you conclude you can. How could you be wrong in the inference? Construct Validity

26. Threats to Validity l You can generalize to other contexts, but you conclude you can’t l You can’t generalize to contexts, but you conclude you can How could you be wrong in the inference? External Validity

27. Threats to Validity l How you can be wrong in making your inference l Specific factors that can bias or distort your conclusions l A list of common threats to the quality of your study l A “checklist” you can use in planning your study