1. Chapter 4 – Research Methods in Clinical Psych Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

2. Everyday Experience and Observation Everyday Experience and Observation Professional Experience and Observation Professional Experience and Observation Addressing Applied Problems and Needs Addressing Applied Problems and Needs Previous Research Previous Research Theory Theory Ways of Generating Research Hypotheses Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

3. Correlation – the variables are associated in some way Correlation – the variables are associated in some way Moderation – one variable influences the direction or size of another Moderation – one variable influences the direction or size of another Mediation - one variable explains the relationship between two others Mediation - one variable explains the relationship between two others Relationships Between Variables Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

4. Institutional approval Institutional approval Informed consent Informed consent Inducements for participation Inducements for participation Deception in research Deception in research Debriefing Debriefing Humane care for animals Humane care for animals Reporting results Reporting results Ethics in Research (some principles) Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

5. Internal validity – controlling for biases Internal validity – controlling for biases External validity – how representative and applicable the study is External validity – how representative and applicable the study is Statistical conclusion validity – whether the study was designed in a way to adequately test hypotheses through statistical methods Statistical conclusion validity – whether the study was designed in a way to adequately test hypotheses through statistical methods Statistical versus clinical significance Statistical versus clinical significance –Effect size Important Concepts to Clinical Research Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

6. Case Study – detailed description of a case, which can allow for a great deal of hypothesis generating Case Study – detailed description of a case, which can allow for a great deal of hypothesis generating –Down side: many threats to internal validity making it difficult to generalize Single case designs A-B (two measures of symptoms pre and post treatment Single case designs A-B (two measures of symptoms pre and post treatment –A-B (designs with a number of clients) –A-B-A (designs with one person at different time points) Clinical Research Designs Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

7. Correlational designs – association of variables (most common) Correlational designs – association of variables (most common) –Note even DSM group v control is a correlational design –‘Median splits’ on a particular variable –Factor analysis – the underlying structure of a variable –Mediator v Moderator designs –Structural equation modeling Clinical Research Designs Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

8. Quasi-experimental designs – comparing groups when random assignment is not available or ethical Quasi-experimental designs – comparing groups when random assignment is not available or ethical Experimental Designs (the ‘gold standard’ in clinical research) – random assignment and experimental manipulation Experimental Designs (the ‘gold standard’ in clinical research) – random assignment and experimental manipulation –Randomized controlled trials (RCT) Clinical Research Designs Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

9. Meta-analysis – summarizing several similar studies through a statistical analysis Meta-analysis – summarizing several similar studies through a statistical analysis –Effect size – a statistical measure of how strong the experimental effect is (i.e., statistical significance does not say how strong the effect is, only that it is unlikely to have randomly occurred) Clinical Research Designs Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

10. Importance of selecting a representative sample (age, gender, SES, ethnicity, etc.) Importance of selecting a representative sample (age, gender, SES, ethnicity, etc.) Sampling strategy – how participants are chosen/recruited Sampling strategy – how participants are chosen/recruited –Probability sampling – requesting participants from say, every 10 th person in a neighborhood –Non-probability sampling – recruiting through a method that will reach as many people as possible Selecting the Participants Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

11. Setting the sample size – making sure there are enough participants to detect differences in groups Setting the sample size – making sure there are enough participants to detect differences in groups –Low power –Sufficient sample size –Statistical significance –Clinical significance Selecting the Participants Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

12. Self-Report Measures – participant report. Self-Report Measures – participant report. Informant-Report Measures – report by someone who knows the participant Informant-Report Measures – report by someone who knows the participant Rater Evaluations – research assistant rates the participant Rater Evaluations – research assistant rates the participant Performance Measures – how a participant does on a task (e.g., reaction time or behavioral measure) Performance Measures – how a participant does on a task (e.g., reaction time or behavioral measure) Selecting the Measures Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

13. Projective Measures – participant responses to ambiguous stimuli, which may reflect the internal state of the participant Projective Measures – participant responses to ambiguous stimuli, which may reflect the internal state of the participant Observation of Behavior - coding systems used to summarize complicated behavior Observation of Behavior - coding systems used to summarize complicated behavior Psychophysiological Measures – a range of measures reflecting biological markers (e.g., heart rate, blood pressure, neural activity) Psychophysiological Measures – a range of measures reflecting biological markers (e.g., heart rate, blood pressure, neural activity) Archival Data – Data stored for some other purpose used for research (e.g., police records, health care utilization records, and academic records) Archival Data – Data stored for some other purpose used for research (e.g., police records, health care utilization records, and academic records) Selecting the Measures Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

14. Reliability Internal Consistency: How homogeneous the test items are Internal Consistency: How homogeneous the test items are Test-Retest Reliability: How stabile over time scores on a measure are Test-Retest Reliability: How stabile over time scores on a measure are Inter-Rater Reliability: The consistency of scores on a measure across different raters or observers. Inter-Rater Reliability: The consistency of scores on a measure across different raters or observers.Validity Content Validity: How fully and accurately the measure represents the construct being assessed Content Validity: How fully and accurately the measure represents the construct being assessed Face Validity: How much the measure overtly appears to be measuring the construct of interest. Face Validity: How much the measure overtly appears to be measuring the construct of interest. Psychometric Properties of the Measures Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

15. Validity (cont.) Criterion Validity: The association of a measure with a related criterion Criterion Validity: The association of a measure with a related criterion Concurrent Validity: The association of a measure with other relevant data measured at the same point in time. Concurrent Validity: The association of a measure with other relevant data measured at the same point in time. –Predictive Validity: The association of a measure with other relevant data measured at some future point in time. Psychometric Properties of the Measures Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

16. Validity (cont.) Convergent Validity: The association between a measure and either other measures of the same construct or conceptually related constructs Convergent Validity: The association between a measure and either other measures of the same construct or conceptually related constructs Discriminant Validity: The association between measures that, conceptually, should not be related Discriminant Validity: The association between measures that, conceptually, should not be related Incremental Validity: The extent to which a measure adds to the prediction of a criterion beyond what can be predicted with other measurement data Incremental Validity: The extent to which a measure adds to the prediction of a criterion beyond what can be predicted with other measurement data Psychometric Properties of the Measures Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.