Assessing Change in Clinical Practice Richard Bost, Ph.D., ABPP Frances Wen, Ph.D. Michael Basso, Ph.D.

Slides:

Advertisements

Similar presentations

An Introduction to Clinical Neuropsychology New Hanover Regional Medical Center March 6, 2003 Antonio E. Puente Department of Psychology, UNCW Private.

Advertisements

Lecture 3 Validity of screening and diagnostic tests

ASSESSING RESPONSIVENESS OF HEALTH MEASUREMENTS. Link validity & reliability testing to purpose of the measure Some examples: In a diagnostic instrument,

Assessment of Reliable Change: Methods and Assumptions Michael Basso, Ph.D. Associate Professor and Director of Clinical Training Department of Psychology—University.

Understanding Cutoffs, Norms, Trajectories, and everything else that freaks you out: A Primer for Dummies G.S. (Jeb) Brown, Ph.D. Center for Clinical Informatics.

LINEAR REGRESSION: Evaluating Regression Models Overview Assumptions for Linear Regression Evaluating a Regression Model.

LINEAR REGRESSION: Evaluating Regression Models. Overview Assumptions for Linear Regression Evaluating a Regression Model.

1 General look at testing Taking a step backwards.

Chapter 9 For Explaining Psychological Statistics, 4th ed. by B. Cohen 1 What is a Perfect Positive Linear Correlation? –It occurs when everyone has the.

COGNITIVE APPROACHES TO SUICIDE Center for Disease Control and Prevention February 6, 2004 Aaron T. Beck, M.D. Gregory K. Brown, Ph.D. University of Pennsylvania.

Measurement Concepts & Interpretation. Scores on tests can be interpreted: By comparing a client to a peer in the norm group to determine how different.

Beck’s Depression Inventory BDI-II

1 8/14/2015 Evaluating the Significance of Health-Related Quality of Life Change in Individual Patients Ron Hays October 8, 2004 UCLA GIM/HSR.

1 Health-Related Quality of Life Ron D. Hays, Ph.D. - UCLA Department of Medicine: Division of General Internal Medicine.

LOINC for Patient-Reported and Clinician-Administered Psychological Tests Saul Rosenberg, PhD Clinical LOINC Meeting January 28, 2011 Tucson, AZ.

Behavioral Health Issues and Pediatric Hospitalizations Stephen R. Gillaspy, PhD 11/05/09 Reaching Out To Oklahoma III Annual Pediatric Interdisciplinary.

Using Assessment in Counseling

Subfields in Psychology. Clinical Psychologists  Largest group of practitioners  Involved in the diagnosis and treatment of psychological disorders.

Clinical Trial Results. org The Canadian Cardiac Randomized Evaluation of Antidepressant and Psychotherapy Efficacy (CREATE) Trial François Lespérance,

Quality Measures for Rehabilitation: Policy, Provider and Patient Perspectives Measuring Clinical Change: Quality Indicators ACRM-ASNR Pre-Conference Institute.

Exploring the SF-36, V2: Measuring the Quality of Life of AgrAbility Program Participants Ronald C. Jester Robert A. Wilson University of Delaware National.

Assessing Change in Clinical Practice Richard Bost, Ph.D., ABPP Frances Wen, Ph.D. Michael Basso, Ph.D Oklahoma Psychological Association 11/6/04.

Psychosocial consequences of false- positive screening results - breast cancer as an example John Brodersen MD, GP, PhD The Department of General Practice.

Diagnosing Mental Disorders- The Multiaxial Approach

Libby Jamieson (R.M.N.) MENTAL HEALTH PRACTITIONER P.C.M.H.T.

EVIDENCE ABOUT DIAGNOSTIC TESTS Min H. Huang, PT, PhD, NCS.

Counseling Research: Quantitative, Qualitative, and Mixed Methods, 1e © 2010 Pearson Education, Inc. All rights reserved. Basic Statistical Concepts Sang.

THE USE OF PSYCHOLOGICAL INSTRUMENTS IN RESEARCH BY F.A. JINADU (MS) Director of Clinical Psychology.

Economic evaluation of psychotherapy for personality disorders: burden of disease and cost-effectiveness Djøra Soeteman Viersprong Institute for Studies.

Classification and Diagnosis Multiaxial System. Little Early Uniformity World Health Organization –In 1939 classified mental and physical disorders –Not.

Assessing Mental Health Among Latino Consumers of Mental Health Services Susan V. Eisen, PhD, Mariana Gerena, PhD, Gayatri Ranganathan, MS, Pradipta Seal.

Session 4 Reliability and Validity. Validity What does the instrument measure and How well does it measure what it is supposed to measure? Is there enough.

Appraisal and Its Application to Counseling COUN 550 Saint Joseph College Ability, Intelligence, Aptitude and Achievement Testing For Class #12 Copyright.

Assessing Responsiveness of Health Measurements Ian McDowell, INTA, Santiago, March 20, 2001.

SCHOOL COUNSELING INTERVENTIONS Adrienne WatkinsBall State University.

Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov February 16, 2011.

BECK DEPRESSION INVENTORY Angela M. Theobald Fort Hays State University.

SUBFEILDS 4. Students will be able to identify psychology’s main subfields.

Measuring intervention effects in children with ASD: The use of specific and global outcome measures A. Nordahl-Hansen 1, S. Fletcher-Watson 2, H. McConachie.

HYPOTHESES RESULTS CONT. Psychological Resilience: The Impact of Affectivity and Coping on State Anxiety and Positive Emotions During and After the Washington,

CONTENT DEFINITIONS, DIAGNOSIS OF ABNORMALITY. EXPLANATIONS AND TREATMENTS OF SCHIZOPHRENIA AND DEPRESSION (INCLUDING EVALUATION)

Cognitive Testing, Statistics and Dementia Ralph J. Kiernan Ph.D. 14 th May 2013.

Differences in Fatigue and Depressive Symptoms Between Long and Average Sleeping Older Adults Introduction Methods Results Discussion Support Major Depressive.

Control Group (n = 34) Assessment 1Assessment 2 Weekly Horse Interaction Group (n = 15) Assessment 1 Assessment 2 Daily Horse Interaction Group (n = 6)

Association of Cognitive Outcomes and Response Status in Late Life Depression: A 12 Month Longitudinal Study David Bickford B.A., Alana Kivowitz B.A.,

Psychological Treatments for Chronic Pain: The Example of Acceptance & Commitment Therapy for Chronic Pain Kevin E. Vowles, Ph.D. 5 th Annual A Thoughtful.

RAISING HIV-INFECTED AND AFFECTED YOUTH: THE IMPACT ON THE MENTAL HEALTH OF CAREGIVERS Stacey Alicea E. Karina Santamaria Elizabeth Brackis-Cott Curtis.

CHAPTER 4: HOW PSYCHOLOGISTS USE THE SCIENTIFIC METHOD.

Association of Body Mass Index (BMI) and Depression Severity

Sofija Zagarins1, PhD, Garry Welch1, PhD, Jane Garb2, MS

Posttraumatic Stress Disorder Checklist (PCL)

Applied Biostatistics: Lecture 4

Wechsler Test-Retest Combinations

The long-term impact of psychotherapy in patients with refractory angina Patel PA2, Ali N1, Thapar S1, Sainsbury PA1 1Department of Cardiology, Bradford.

PREDICTIVE VALIDITY OF THE MMPI-2: CLINICAL SCALE DISTURBANCE

Discussion and Next Steps

Janet Vogt, Kim Ankers, Barry Isaacs Surrey Place Centre

The numbered points represent individual studies

Applied Psychology Penn State Harrisburg

What is a Research Clinic?

Expanding Application of Clinical Significance for Outcome Measures: BAI and R-DAS Zack Hamingson, MA, Matt Multach, Jermaine Dictado, Kenichi Shimokawa,

The numbered points represent individual studies

Optimizing Quality of Life and Mental Health in Patients With Psoriasis.

The Prevalence and Odds of Depressive Symptoms and Clinical Depression in Psoriasis Patients: A Systematic Review and Meta-Analysis Emmilia A. Dowlatshahi,

Evaluating the effectiveness and cost effectiveness of BSL IAPT

What are Psychological Disorders?

Ronald C. Jester Robert A. Wilson University of Delaware

The Effect of Interaction with Horses

Assessment Chapter 3.

Presentation transcript:

Assessing Change in Clinical Practice Richard Bost, Ph.D., ABPP Frances Wen, Ph.D. Michael Basso, Ph.D

Reliable Change Index (RCI) Jacobsen & Truax (1991) Appropriate for measures not subject to practice effects Examples: measures of attitude, psychological disorders, life satisfaction, health habits, coping styles, marital adjustment

Reliable Change Index (RCI) Jacobsen & Truax (1991) Not appropriate for measures affected by practice effects Examples: measures of memory, intelligence

Reliable Change Index (RCI) Jacobsen & Truax (1991) Appropriate for measures with underlying normal distributions or frequency spreads Examples: Dyadic Adjustment Scale, Geriatric Depression Scale, SCL-90-R, BDI, SF-36, etc.

Reliable Change Index (RCI) Jacobsen & Truax (1991) Not appropriate for measures which do not have underlying normal distributions or frequency spreads Examples: the MCMI (I-III), and the MCMD (or MBHI)

Reliable Change Index (RCI) Jacobsen & Truax (1991) Does change exceed what would be expected based on measurement error alone? If “yes”, then change is considered to be “statistically reliable”

Reliable Change Index (RCI) 5 Steps to Assessing Reliable Change 1.Administer appropriate measure at pre-test 2.Re-administer measure at a post-test period 3.Calculate change score 4.Calculate the RCI 5.Compare change score to the RCI

Reliable Change Index (RCI) The Reliable Change Generator 2.0 ©Grant J. Devilly 2004 Web:

Reliable Change Index (RCI) The Reliable Change Generator Devilly, G.J. (2004). The Reliable Change Generator for Windows: Version 2.0 (computer programme). The Centre for Neuropsychology, Swinburne University, Australia.

Reliable Change Index (RCI) The Reliable Change Generator Jacobson, N.S., and Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59,

Reliable Change Index (RCI) Data for the Reliable Change Generator Test-retest reliability of the measure Sample Time period Standard deviation for the sample (at Time 1) which was used to estimate the test-retest reliability

Reliable Change Index (RCI) Assessing Clinical Meaningfulness Assess after a change in scores is found to be reliable Consider various criteria: diagnostic classification degree of change

Reliable Change Index (RCI) Assessing Clinical Meaningfulness Causation Reliable change implies lack of causation due to measurement error Variables unrelated to intervention may account for reliable change

Reliable Change Index (RCI) Assessing Clinical Meaningfulness Direction of Change Improvement? Deterioration?

Reliable Change Index (RCI) A Case Example: Jane D. 19 y.o., single, unemployed Wilson’s disease Candidate for liver transplant Pre-transplant assessment: clinical interview, BDI-II, SF-36, STAI, SWLS, WAIS subtests

Reliable Change Index (RCI) A Case Example: Jane D. Post-transplant psychotherapy Post-transplant/Pre-therapy re-assessment: –clinical interview –BDI-II –SF-36 –STAI –SWLS

Reliable Change Index (RCI) A Case Example: Jane D. Pre-transplantPost-transplant/ Pre-therapy 95% RCI BDI-II SF-36 PCS STAI-Trait SWLS

Reliable Change Index (RCI) A Case Example: Jane D.

Diagnosis: –Adjustment Disorder with Mixed Anxiety and Depression Therapy Issues: –Physical, familial, social, occupational

Reliable Change Index (RCI) A Case Example: Jane D. Post-therapy Changed occupational and academic goals Changed social network Changed residence

Reliable Change Index (RCI) A Case Example: Jane D. Pre-therapyPost- therapy95% RCI BDI-II SF-36 PCS STAI-Trait54 (70) 40 (54 ) SWLS

Reliable Change Index (RCI) A Case Example: Jane D.

Additional References Ferguson RJ, Robinson AB, Splaine M. (2002). Use of the reliable change index to evaluate clinical significance in SF-36 outcomes. Quality of Life Research, 11, Pavot W, Diener E. (1993). Review of the Satisfaction With Life Scale. Psychological Assessment, 5,

Additional References Sprinkle SD, Lurie D, Insko SL, Atkinson G, Jones GL, Logan AR, Bissada NN. (2002). Criterion validity, severity cut scores, and test-retest reliability of the Beck Depression Inventory-II in a university counseling center sample. Journal of Counseling Psychology, 49,

Additional References Spielberger CD, Gorsuch RL, Lushene RE (1970). Manual for the State-Trait Anxiety Inventory. Palo Alto, CA; Consulting Psychologists Press. Ware JE, Kosinski M, Keller SK. SF-36® Physical and Mental Health Summary Scales: A User's Manual. Boston, MA: The Health Institute, 1994.