1. Research and Evaluation Center Jeffrey A. Butts John Jay College of Criminal Justice City University of New York August 7, 2012 Evidence-Based Models for Court-Involved Youth

2. Research and Evaluation Center WHAT IS EVIDENCE BASED PRACTICE? The use of systematic decision-making processes or provision of services which have been shown, through available scientific evidence, to consistently improve measurable client outcomes. Instead of tradition, gut reaction or single observations as the basis for making decisions, EBP relies on data collected through experimental research and accounts for individual client characteristics and clinician (or program) expertise. - University of Washington Evidence Based Practice Institute 2 Notice the creative contrast…

3. Research and Evaluation Center WHERE CAN WE GO FOR HELP? 33 Colorado Department of Public Safety George Mason University

4. Research and Evaluation Center ADVANCES IN EBP FOR YOUTH JUSTICE 4

5. Research and Evaluation Center ADVANCES IN EBP FOR YOUTH JUSTICE 5

6. Research and Evaluation Center ADVANCES IN EBP FOR YOUTH JUSTICE 6

7. Research and Evaluation Center ADVANCES IN EBP FOR YOUTH JUSTICE 7

8. Research and Evaluation Center ADVANCES IN EBP FOR YOUTH JUSTICE 8

9. Research and Evaluation Center ADVANCES IN EBP FOR YOUTH JUSTICE 9

10. Research and Evaluation Center 10

11. Research and Evaluation Center 11

12. Research and Evaluation Center 12

13. Research and Evaluation Center 13

14. Research and Evaluation Center 14

15. Research and Evaluation Center 15

16. Research and Evaluation Center 16

17. Research and Evaluation Center 17

18. Research and Evaluation Center EVIDENCE IS PURCHASED, NOT SIMPLY DISCOVERED  Research is a competitive enterprise  There are limited funds  Researchers are not always disinterested  Funding of research can be (is?) political  Some program models are easier than others to evaluate properly  Marketing forces often overwhelm data 18

19. Research and Evaluation Center SO NOT ALL PROGRAMS CAN BE EVALUATED… WHAT OTHER OPTIONS ARE THERE? 19

20. Research and Evaluation Center Georgetown University Center for Juvenile Justice Reform http://cjjr.georgetown.edu/pdfs/ ebp/ebppaper.pdf SPEP developed by Mark Lipsey of Vanderbilt University 20 STANDARDIZED PROGRAM EVALUATION PROTOCOL (SPEP)

21. Research and Evaluation Center STANDARDIZED PROGRAM EVALUATION PROTOCOL (SPEP)  Based on meta-analysis -- 600 studies of programs that reduce recidivism  SPEP assigns scores to a select core of program components based on how closely the components match programs with demonstrated effectiveness in prior research  Service Type  Supplemental Services  Treatment Amount (duration & contact hours)  Treatment Quality  Youth Risk Level 21

22. Research and Evaluation Center 22

23. Research and Evaluation Center STANDARDIZED PROGRAM EVALUATION PROTOCOL (SPEP) Two purposes of the instrument: 1)Assess the effectiveness of programs that seek to reduce recidivism 2)Identify the components of a program that need improvement States already using SPEP to assess youth programs  North Carolina  Arizona  Pennsylvania*  Florida*  Connecticut* * participating in Georgetown’s Juvenile Justice System Improvement Project (JJSIP) that incorporates SPEP 23

24. Research and Evaluation Center STANDARDIZED PROGRAM EVALUATION PROTOCOL (SPEP)  The SPEP approach would allow us to ensure higher quality programs without spending so much on evaluation  Incorporating principles supported by SPEP would allow programs to deliver better services during implementation and the scaling up of program procedures rather than waiting for data collection and follow-up  Research dollars could be use more efficiently, focusing on a smaller set of critical questions and answering them with a higher degree of accuracy  Many important questions have not been answered or even asked yet… 24

25. Research and Evaluation Center 25 WHAT’S YOUR THEORY? Risk Factors Community disorder Poverty Family violence School failure Thrill seeking Cognitive defects Unemployment Lack of empathy Defiance Poor decision-making Poor nutrition Hopelessness Greed Youth Crime Mental illness Substance abuse We Aren’t Even Close to Having All The Answers Protective Factors Family support School success Secure housing Stable employment Health Positive friends Ethical framework Belonging Adult guidance Self-efficacy Community respect Physical safety Future aspirations

26. Research and Evaluation Center 26 IF OUR GOAL IS EFFECTIVENESS…  When choosing interventions for youth in the justice system, we must be AGNOSTIC -- open to new facts  Advocating one intervention over another based on turf, convenience, bias or financial interests is simply wrong  Central goal of intervention is to ensure community safety by changing youth behavior -- NOT merely to deliver a particular type of service or to ensure the financial stability of providers

27. Research and Evaluation Center 27 Arrest?

28. Research and Evaluation Center 28 WHY IS THIS SO DIFFICULT? We seem to hear mostly about mental health, substance abuse, and trauma?  Most troubling cases often involve MH, SA and Trauma  MH, SA, Trauma overlooked & under-diagnosed for years  The science related to these issues has improved  Interest group politics and public relations

29. Research and Evaluation Center CONTACT INFORMATION Jeffrey A. Butts, Ph.D. Director, Research & Evaluation Center John Jay College of Criminal Justice City University of New York http://about.me/jbutts jbutts@jjay.cuny.edu