NASC 2012 ANNUAL CONFERENCE AUGUST 6, 2012 NASC 2012 ANNUAL CONFERENCE AUGUST 6, 2012 Ray Wahl Deputy State Court Administrator

Why Evidence Based Practices Matter target criminogenic factors If a program doesn’t target criminogenic factors, it doesn’t lower recidivism (Bonta et al. 2008) wrong offenders Focusing on the wrong offenders, increases the likelihood of recidivism (Bonta, Wallace-Capretta & Rooney, 2000) If we want to see results, we have to use approaches that work principles of effective intervention Programs that adhere to principles of effective intervention result in lower recidivism rates while programs that don’t have higher recidivism rates (Gendreau P., French S.A., and A. Taylor, 2002)

Principles of Effective Intervention Risk Principle Risk Principle—focus on offenders at high risk for future criminal offending Need Principle Need Principle—target criminogenic needs Treatment Principle Treatment Principle—use behavioral approaches Program Fidelity Program Fidelity—ensure quality delivery

Why These Principles Matter Better Outcomes Andrews, Bonta & Hogue, 1990; Andrews & Bonta, 2006

Importance of Program Fidelity

Why Program Quality Matters Source: Washington State Institute of Public Policy 2011 Savings in Juvenile Programs

Why Program Quality Matters Source: Washington State Institute of Public Policy 2011 Savings in Adult Programs

Importance of Program Fidelity Barnoski & Aos, (2004) Outcome Evaluation of Washington State’s Research-Based Programs for Juvenile Offenders. WISP. Fidelity to the model and program delivery affect offender recidivism rates.

Importance of Program Fidelity characterize effective CBT programs monitoring of the quality and fidelity “What seems to most strongly characterize effective CBT programs is high quality implementation as represented by low proportions of treatment dropouts, close monitoring of the quality and fidelity of the treatment implementation, and adequate CBT training for the providers.” Landenberger,& Lipsey, (2005). “The Positive Effects of Cognitive-Behavioral Programs for Offenders: A Meta-Analysis of Factors Associated with Effective Treatment.” Journal of Experimental Criminology.

Importance of Program Fidelity Barnoski & Aos, (2004) Outcome Evaluation of Washington State’s Research-Based Programs for Juvenile Offenders. WISP. Fidelity to the model and program delivery affect the bottom line.

Ensuring Program Fidelity

Assessment of Programs aren’t mixing offenders We use a risk assessment to make sure we aren’t mixing offenders or focusing on low risk offenders targeting criminogenic needs We use case planning to make sure we are targeting criminogenic needs and matching offenders to the most appropriate programs But how do we know if the programs we send offenders to are doing any good?

Identifying Effective Programs Focuses on higher risk offender Targets criminogenic needs Targets criminogenic needs Use s evidence-based interventions Bases program design on proven theoretical model Bases program design on proven theoretical model Matches offender to treatment type Ensure s quality delivery of program Ensure s quality delivery of program Uses appropriate rewards and punishers How do I know if a program is effective for treating offenders?

14 Impact of the Numbers of Favorable Features on Recidivism Source: Adapted from Lipsey, 1997, 2005, cover 509 juvenile justice studies Average Practice

Qualities of Good Programs Ask These Questions stable leadership Is there stable leadership? training What training does staff receive? knowledge of EBP What is there knowledge of EBP ? ongoing monitoring Is there ongoing monitoring of program – quality assurance process manual Is there a manual of operation? – Program must be researched based risk factors What risk factors do they focus on ? cognitive behavioral Do they use cognitive behavioral approaches – practice skills? dosage What is the dosage? high risk Do they focus on medium and high risk offenders? dropout rates What are their dropout rates?

Assessment Process Overview Integrate Program Evaluation into RFP & Contract Evaluate Program Annually Using a Validated, Standardized Tool Provide Specific Feedback to the Program Provide Ongoing Expert Technical Assistance Measure Program Outcomes in Multiple Areas Use a Validated Risk Assessment Develop Case Plan Based on Risk Assessment Match Offender to Effective Services

What Utah is Doing to Ensure Fidelity in Programs research-based assessment tool Assessing programs using a research-based program assessment tool Each item on the assessment tool is related to reductions in recidivism The tool examines whether programs are implementing EBP models with fidelity Programs are provided with feedback on their progress and ongoing assistance to improve Recidivism is measured and linked to program assessment results and provided to probation management and programs Pre/Post tests measuring changes in offender attitudes and behaviors

What Utah is Doing to Ensure Fidelity in Programs Across the System Validated risk instrument Case Planning model Correctional Program Checklist – program improvement Certification of probation staff Training, training, training A vision statement that included EBP Report Cards/Rich information system Judicial/Legislative support

Contact Information Ray Wahl Ray Wahl – Deputy State Court Administrator