1. Summit: Using Performance and Outcome Measures to Improve Treatment National Quality Forum National Voluntary Consensus Standards for Treatment of Substance Use Conditions: Evidence-Based Treatment Practices Los Angeles, CA March 20,2008 Victor A Capoccia PhD

2. Our Context How do we know that what we do is right? If it is right, how do we know if we are doing it well? If we are doing it well, how do we know if it makes a difference?

3. The Context Of NQF Quality Measurement of Addiction Treatment RWJF strategy for promoting quality in addiction treatment The NQF process and legitimacy for consensus standards

4. Why NQF Consensus? 6. What Is The Policy For Federal Use Of Standards? All federal agencies must use voluntary consensus standards in lieu of government-unique standards in their procurement and regulatory activities, except where inconsistent with law or otherwise impractical. In these circumstances, your agency must submit a report describing the reason(s) for its use of government-unique standards in lieu of voluntary consensus standards to the Office of Management and Budget (OMB) through the National Institute of Standards and Technology (NIST). a. When must my agency use voluntary consensus standards? –Your agency must use voluntary consensus standards, both domestic and international, in its regulatory and procurement activities in lieu of government-unique standards, unless use of such standards would be inconsistent with applicable law or otherwise impractical. In all cases, your agency has the discretion to decline to use existing voluntary consensus standards if your agency determines that such standards are inconsistent with applicable law or otherwise impractical. –(1) "Use" means incorporation of a standard in whole, in part, or by reference for procurement purposes, and the inclusion of a standard in whole, in part, or by reference in regulation(s). –(2) "Impractical" includes circumstances in which such use would fail to serve the agency's program needs; would be infeasible; would be inadequate, ineffectual, inefficient, or inconsistent with agency mission; or would impose more

5. NQF Standards for Evidence Based Practices: Domain 1 Identification of Substance Use Conditions:  Screening and case finding  Assessment and diagnoses for positive screens

6. NQF Standards for Evidence Based Practices: Domain 2 Initiation and Engagement in Treatment  Brief intervention  Promoting engagement  Withdrawal management

7. NQF Standards for Evidence Based Practices: Domain 3 Therapeutic Interventions to Treat Substance use Illness  Psychosocial interventions  Pharmacotherapy

8. NQF Standards for Evidence Based Practices: Domain 4 Continuing Care Management of Substance Use Illness  Long term continuing care management, self management, and recovery support

9. Let’s look at another condition: Diabetes

10. National Quality Measures Clearing House: Diabetes 89 measures 3 levels of patient indicators Primary outcome: HbA1c Secondary outcome: weight loss, blood pressure, etc. Quality of life: satisfaction, worry, etc Treatment practices: e.g. foot exam, Rx System practices: e.g. patient registry

11. Let’s look at addiction disorders

12. National Quality Measures Clearing House: Substance Use Disorders 64 measures Levels of patient indicators Primary outcome: none (What would you use?) Secondary outcome: screening for use Quality of life: family, job, justice involvement Treatment practices: MAT, other NQF,NOMS System practices: access, retention, NOMS, WCG Community practices: crime, employment, housing, other NOMS

13. AHRQ Clearinghouse Criteria

14. WCG, NQF, NOMS Aligning Quality Measures Focus of measures Adoption of measures Operationalize measures Availability of data

15. Focus of Measures Patient outcome Primary, secondary, self report Treatment intervention or practice System process or performance Community

16. Adoption of Measures Mandate (Oregon law, congress) Voluntary (early adopter) Purchaser required (SSA, MCO) Accreditation (CARF, JCAHCO)

17. Operationalize Measures Definition (key element, e.g. ‘continuing care’) Quantified (time, dose, dichotomous more/less) Tested (field tested) Reported (feedback)

18. Availability of Data: Billing system ( # visits) Electronic Medical Record (level of functioning) Special survey (any type) State MIS report (demographic, utilization) Existing survey (e.g.TEDS NSTATS)

19. Focus of Measures Adoption of Measures Operationalize Measure Data Available NQF -Ident -Init and Engage -Treat Intervent -Continuing Care Washington Circ -SBI -MAT -Recov Mgmt NOMS -level of funct -emp and schl -CJ involv -stability fam _access -bed use -socl supp -client report -cost effect -use of EBP

20. NQF Next Steps Disseminate standards Coordinate with WCG, NOMS (SAMHSA) Operationalize 2-4 practice measures Test measures Incorporate into regular reporting mechanism