1. COMPREHENSIVE PROGRAM EVALUATION Internal Evaluation Sherri Kendall, LPC CEO, Aid to Victims of Domestic Abuse Houston External Program Evaluation / Research Jeff Temple, PhD Director, Behavioral Health and Research Department of Ob/Gyn UTMB Health

2. PROGRAM EVALUATION Part 1 – Internal Evaluation Sherri Kendall Aid to Victims of Domestic Abuse (AVDA) Houston sherrik@avda-tx.org 713.715.6925

3. Basic Questions Why do we evaluate? What do we evaluate? How will we evaluate? When will we evaluate? What do we do AFTER we’ve evaluated?

4. Why evaluate? 1. To determine if we are meeting our mission. 2. To determine if we are meeting our targets/goals for the program. 3. Based on results, to modify program (and/or training) to improve program effectiveness. 4. To be able to accurately demonstrate effectiveness to our funders. 5. To bolster support for legislation (and funding) for BIPP through demonstrating effectiveness.

5. Scope of Evaluation Evaluation should seek to provide a balance between both depth and breadth, providing an overview of multiple evaluation criteria, and with the option for follow-up on areas which, once evaluated, are found to be problematic or not meeting goals.

6. What to evaluate - MISSION Are we meeting our mission? Improving Victim Safety Impact Reducing Offender Recidivism & Continued Abuse Batterer Accountability Meeting Community Needs Additional Goals: Societal Change re: all forms of oppression Collaboration & a Coordinated Community Response Contributing to the DV Field Growth-promoting, satisfying workplace Others??

7. Program Evaluation may be based on: Goals Process Outcomes Needs Assessment Accreditation Cost/benefit Analysis Effectiveness Efficiency

8. Meeting Targets & Goals MEASURABLE OUTPUTS Number of BIPP participants served Completion of participants vs. dropouts Outreach to victims 100% Compliance with BIPP Guidelines & funder requirements Trainings, presentations, collaborations

9. Meeting Targets & Goals MEASURABLE OUTCOMES Reduced abuse Increased victim safety Offender accountability Meeting community need

10. Measuring OUTPUTS Number of BIPP participants served MAR / Actual Outputs Report (from referral to exit) Caseload/activity measurement per facilitator Completion of participants vs. dropouts MAR – don’t limit your exit categories WHY are they dropping? Can high completion rate be a negative? Outreach to victims Victim & Partner letters and resources Phone contact (safety concerns to consider) Compliance with BIPP Guidelines & funder requirements External audit results & internal ongoing monitoring Trainings, presentations, collaborations

11. Measuring OUTCOMES Cognitive awareness Pre/post tests Offender Exit Survey Exit Plan of Non-Abuse Reduced abuse & Increased victim safety Recidivism rates Exit Survey (client & victim/partner) Continued follow-up Meeting community need Operating groups in under-served areas Accessibility to clients (cost, schedule, location) Community Partner & Referral Surveys Making trainings, presentations, consultations available to community partners (not for purposes of profit)

12. When to begin program evaluation NOW! Start small… INCREASE in breadth and depth as you can.

13. Post-Evaluation Step 1Analyze data, share with Board and Staff Step 2Set NEW goals & targets Step 3Develop Plan of Action to meet goals Step 4Implement Plan of Action

14. Step 5?? Repeat Steps 1-4

15. Resources http://managementhlep.org/evaluation/program- evaluation-guide.htm http://managementhlep.org/evaluation/program- evaluation-guide.htm http://www.aecf.org/KnowledgeCenter/Publications.as px?pubguid={4977C910-1A39-44BD-A106- 1FC8D81EB792} http://www.aecf.org/KnowledgeCenter/Publications.as px?pubguid={4977C910-1A39-44BD-A106- 1FC8D81EB792} (A Guide to Measuring Advocacy and Policy) http://managementhelp.org/evaluation/program- evaluation-planning.htm http://managementhelp.org/evaluation/program- evaluation-planning.htm (Checklist for Program Evaluation Planning)