Testing an Instrument to Measure Multidimensional Treatment Entry Pressures in Patients Undertaking Methadone Maintenance Treatment Authors: David M Greenwell,

Slides:



Advertisements
Similar presentations
Questionnaire Development
Advertisements

Motivation and diabetes self-management *Cheryl L. Shigaki, PhD, ABPP, **Robin L. Kruse, PhD, MSPH, **David Mehr, MD, MS, † Kennon M. Sheldon, PhD, ‡ Bin.
Reliability Presentation Test-Retest James Blackwood – AED 615 Fall Semester 2006.
The Research Consumer Evaluates Measurement Reliability and Validity
Taking Stock Of Measurement. Basics Of Measurement Measurement: Assignment of number to objects or events according to specific rules. Conceptual variables:
1 COMM 301: Empirical Research in Communication Kwan M Lee Lect4_1.
For pregnant teens in HS parenting programs, do attitudes, social norms, perceived control predict continuation in high school? P: Pregnant teens,15-17,
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT
MEQ Analysis. Outline Validity Validity Reliability Reliability Difficulty Index Difficulty Index Power of Discrimination Power of Discrimination.
Abstract People who enter substance abuse treatment under various degrees of legal pressure do at least as well at the end of treatment or at follow-up.
NAMA ANGGOTA : DIANITA YANA RATRI ( ) SELVI PUTRI SIMDORA ( ) DEDY ARFIANTO ( ) MUJI IDA KURNIASARI ( )
Work motivation among healthcare professionals in the Saudi hospitals Presented by Nouf Sahal Al-Harbi Supervised by: Dr. Saad Al-Ghanim 2008.
A Review of 3 Relationship Adjustment and Satisfaction Assessment Instruments.
FOUNDATIONS OF NURSING RESEARCH Sixth Edition CHAPTER Copyright ©2012 by Pearson Education, Inc. All rights reserved. Foundations of Nursing Research,
In the name of Allah. Development and psychometric Testing of a new Instrument to Measure Affecting Factors on Women’s Behaviors to Breast Cancer Prevention:
Jan Weiss, PT, DHS, CLT-LANA
Validity Lecture Overview Overview of the concept Different types of validity Threats to validity and strategies for handling them Examples of validity.
Test Validity S-005. Validity of measurement Reliability refers to consistency –Are we getting something stable over time? –Internally consistent? Validity.
Psychometrics Timothy A. Steenbergh and Christopher J. Devers Indiana Wesleyan University.
Measurement and Data Quality
Amber S. Emanuel 1, James A. Shepperd 2, Virginia J. Dodd 1 & Henrietta Logan 1 1 Department of Behavioral Sciences & Community Dentistry, University of.
The Distress Inventory of Partners of Substance Abusers (DIPSA)
Audrey J. Brooks, PhD University of Arizona CA-AZ node.
The authors would like to acknowledge the nursing staff that participated at all three locations. Without their support, many things would not be possible.
Instrumentation.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.
Induction to assessing student learning Mr. Howard Sou Session 2 August 2014 Federation for Self-financing Tertiary Education 1.
Purpose The present study examined the psychometric properties of the SCARED in order to begin establishing an evidence base for using the SCARED in pediatric.
Lecture 6: Reliability and validity of scales (cont) 1. In relation to scales, define the following terms: - Content validity - Criterion validity (concurrent.
Factor validation of the Consideration of Future Consequences Scale: An Assessment and Review Tom R. EikebrokkEllen K. NyhusUniversity of Agder.
Development and Validation of the Drexel University ACT/CBT Therapist Adherence Rating Scale: Phase II Kathleen B. McGrath, Evan M. Forman, Kimberly L.
10/29/2015 Exploring the Persuasiveness of “Just-in-time” Motivational Messages for Obesity Management Persuasive 2008, Oulu, Finland. Megha Maheshwari.
THE MEASUREMENT OF USER INFORMATION SATISFACTION (BLAKE IVES ET.AL) Presented by: IRA GERALDINA
Temperament and Character Adaptations to Addictions Treatment Daniel Angres, M.D.¹ &Stephanie Bologeorges, B.A.¹ ¹ Resurrection Behavioral Health-Addiction.
Presented By Dr / Said Said Elshama  Distinguish between validity and reliability.  Describe different evidences of validity.  Describe methods of.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.
Research Techniques Made Simple: Validation of Outcome Measures in Dermatology Kate V. Viola, MD, MHS 1 Tamar Nijsten, MD, PhD 2 Karthik Krishnamurthy,
Relational Discord at Conclusion of Treatment Predicts Future Substance Use for Partnered Patients Wayne H. Denton, MD, PhD; Paul A. Nakonezny, PhD; Bryon.
Template provided by: “posters4research.com” Data were collected by interviewing the caseload holders at Services A and B with reference to patients case.
The Self-Compassion Scale (SCS) is the primary measure of self- compassion in both social/personality psychology and clinical research (Neff, 2003). It.
Reliability Ability to produce similar results when repeated measurements are made under identical conditions. Consistency of the results Can you get.
DENT 514: Research Methods
Reliability a measure is reliable if it gives the same information every time it is used. reliability is assessed by a number – typically a correlation.
J. Aaron Johnson, PhD 1 and J. Paul Seale, MD 2 1 Institute of Public and Preventive Health and Department of Psychology, Georgia Regents University, Augusta,
School of Nursing Health Literacy Among Informal Caregivers of Persons With Memory Loss Judith A. Erlen, PhD, RN, FAAN; Jennifer H. Lingler, PhD, RN; Lisa.
Abstract A longitudinal study designed to follow children of alcohol and drug dependent fathers from adolescence into adulthood RISK began in 1993 and.
Psychosocial difficulties in head and neck cancer; the development of an evidence based measurement instrument Lucy Ziegler Rob Newell.
Measurement Chapter 6. Measuring Variables Measurement Classifying units of analysis by categories to represent variable concepts.
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.
Homelessness and Mental Illness: The Medical Students’ Viewpoints Charity Pires BS, Sarah Hilton MS, Faneece Embry BS, Anthony Ahmed PhD, Edna Stirewalt.
Psychometric Evaluation of an Instrument for Assessing Policy Outcomes for Families with Children Who Have Severe Developmental Disabilities: The Beach.
Reliability and Validity for Measures of Children’s Self- Efficacy for Walking to School David A. Rowe FACSM, Shemane Murtagh, David McMinn, Katherine.
Data Collection Methods NURS 306, Nursing Research Lisa Broughton, MSN, RN, CCRN.
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
DEVELOPMENT OF AN INSTRUMENT TO ASSESS THE WOMAN’S POSTNATAL NEEDS
Further Validation of the Personal Growth Initiative Scale – II: Gender Measurement Invariance Harmon, K. A., Shigemoto, Y., Borowa, D., Robitschek, C.,
Chapter 4 Research Methods in Clinical Psychology
Lecture 5 Validity and Reliability
Parental Alcoholism and Adolescent Depression?
Reliability and validity of the BREQ-2 for measuring high school students’ motivation for physical education Stuart Forsyth¹, David Rowe¹, and Nanette.
Psychometric testing of a self-administered, computerized adolescent drug and alcohol screening instrument Salvatore Libretto1 James Sexton1 Henry Wong1.
Theory of Stress & Coping Alice C
Test Validity.
Week 3 Class Discussion.
Reliability and Validity of Measurement
First study published in JOGS.
Instrumentation: Reliability Measuring Caring in Nursing
Introduction Measures
The first test of validity
Morgan M. Welch & David E. Szwedo James Madison University
Presentation transcript:

Testing an Instrument to Measure Multidimensional Treatment Entry Pressures in Patients Undertaking Methadone Maintenance Treatment Authors: David M Greenwell, Hazel Watson, Angus McFadyen, Dave Johnson, Susan Kerr Glasgow Caledonian University, NHS Highland 1. A MULTIDIMENSIONAL MODEL OF PRESSURE TO ENTER ADDICTIONS TREATMENT A number of studies have identified patients who have entered addictions treatment as a result of perceived pressures Brecht et al. (1993) Wild et al. (1998) Gregoire and Burke (2004) Marlowe et al. (1996). Marlowe et al. (2001) Stevens et al. (2006) Schaub et al. (2010) proposed a model of perceived treatment entry pressures which emanate from a range of life domains. These pressures can be either negative or positive and external or internal. Life Domains: The life domains from which the pressure emanate are either familial, financial, legal, medical, psychiatric or social. Negative vs. Positive: Negative pressures comprise escape or avoidance of aversive consequences. Positive pressures comprise the attainment of a positive reward. Whereas Internal vs. External: Internal pressures are those in which the reinforcement is in the persons control. External pressures are those in which the reinforcement is in someone else’s control. Whereas Crossing the type of reinforcement with the type of mediation yields four categories of treatment entry pressure: Coercion: externally mediated negative reinforcement Aversion: internally mediated negative reinforcement Approbation: externally mediated positive reinforcement Self improvement: internally mediated positive reinforcement Crossing these with the life domains produces 24 possible types of treatment entry pressure such as family coercion or social approbation. 2. THE STUDY The Survey of Treatment Entry Pressures of the University of Pennsylvania (STEP-UP), comprises 120 items, in 20 subscales. It was designed to measure these treatment entry pressures, however no psychometric data on the instrument was available. This study was carried out to examine the test- retest reliability, the internal consistency and the content validity of the STEP- UP in a sample of patients undertaking methadone maintenance treatment. The questionnaire was administered to 26 patients who had been undertaking MMT for a period of not less that six weeks in two drug services in the West of Scotland. The STEP-UP was administered to each participant on two occasions, the test and the retest. The mean interval between the test and the retest was 21 days. This was consistent with test-retest intervals identified in the literature (Burns and Grove 2005). 3. TEST RE-TEST RELIABILITY This is a measure of the stability of an instrument over time (Burns and Grove, 2005). If the STEP-UP is stable then the same scores should be obtained with the same people when the test is administered on separate occasions. The test-retest reliabilities of the individual items in the questionnaire were analysed using the sign test and the weighted Kappa statistic. The test-retest reliabilities of the subscales of the STEP-UP were analysed using t-tests and intraclass correlation coefficients. 4. INTERNAL CONSISTENCY This relates to the degree to which the questions in each section of the questionnaire, or in the whole questionnaire, are measuring the same dimension. Asking several questions to measure one particular facet reduces the risk that single idiosyncratic responses will have an undue effect on the measure (Anthony, 1999). The internal consistency of the subscales of the STEP-UP was analysed using the Cronbach’s alpha coefficient. 5. CONTENT VALIDITY This concerns the degree to which the items on a scale adequately cover the theory under investigation (Streiner and Norman, 2003). To assess the content validity of the STEP-UP the opinion of experts working in the field was sought and their comments were examined with reference to relevant literature (Streiner and Norman 2003). This analysis focussed on the relevance of the items in the STEP-UP to the concept multidimensional treatment entry pressures, whether any of the items were superfluous; whether the questions were easy to understand or, if not, which caused difficulty. 6. RESULTS The analyses of the test-retest reliability and internal consistency of the STEP UP resulted in the deletion of 51 items from the questionnaire. The analysis of the content validity of the resulted in further modification to the questionnaire through the deletion of some items and the rewording of others. The layout of the questionnaire was also changed to make it an easier instrument to complete. This resulted in a substantially modified questionnaire comprising 46 items. 7. CONCLUSIONS This work resulted in the further development of an instrument to measure multidimensional treatment entry pressures in people accessing drug problems treatment in the UK. The small sample did not permit an examination of the validity of the construct of multidimensional treatment entry pressures. Future studies should test the reliability and validity of the instrument with larger samples and with samples drawn from different populations. References: Anthony, D. (1999). Understanding Advanced Statistics A Guide for Nurses and Health Care Researchers. Edinburgh, London, New York, Philadelphia, Sydney, Toronto. Brecht, M.L., Anglin, M.D., Wang, J.C., (1993) Treatment effectiveness for legally coerced versus voluntary methadone maintenance clients. American Journal of Drug & Alcohol Abuse. Vol. 19 (1), pp Burns. N., Grove, S.K., (2005) The practise of nursing research conduct, critique and utilization. 5th ed. St Louis, Missouri: Elsevier Saunders Gregoire, T.K. Burke, A.C. (2004) The relationship of legal coercion to readiness to change among adults with alcohol and other drug problems. Journal of Substance Abuse Treatment. Vol. 26 (1), pp Marlowe, D.B., Kirby, K.C., Bonieskie, L.M., Glass, D.J., Dodds, L.D., Husband, S.D., Platt, J.J., Festinger, D.S. (1996) Assessment of coercive and noncoercive pressures to enter drug abuse treatment. Drug & Alcohol Dependence. Vol. 42 (2), pp Marlowe, D.B., Merikle, E.P., Kirby, K.C., Festinger, D.S., McLellan, A.T., (2001) Multidimensional assessment of perceived treatment-entry pressures among substance abusers. Psychology of Addictive Behaviors. Vol. 15 (2), pp Schaub, M., Stevens, A., Berto, D., Hunt, N., Kerschi, V., Mcsweeney, T., Oeuvray, K., Puppo, I., Santa Maria, A., Trinkl, B., Werdenich, W., Uchtenhagen, A. (2010) Comparing outcomes of ‘voluntary’ and ‘quasi compulsory’ treatment of substance dependence in Europe. European Addiction Research Vol. 16 (1) pp Stevens, A., Berto, D., Frick., Hunt, N., Kerschi, V., McSweeney, T., Oeuvery, K., Puppo, I., SantaMaria, A., Schaaf, S., Trinkl, B,. Uchtenhagen, A., Werdenich, W. (2006) The relationship between legal status perceived pressure and motivation in treatment for drug dependence: Results from a European study of quasi-compulsory treatment. European Addiction Research Vol. 12 (4): Wild TC, Newton-Taylor B, Alletto R Perceived coercion among clients entering substance abuse treatment: structural and psychological determinants. Addictive Behaviors Vol. 23 (1):81-95