1. The Major Steps of a Public Health Evaluation 1. Engage Stakeholders 2. Describe the program 3. Focus on the evaluation design 4. Gather credible evidence 5. Justify Conclusions 6. Ensure use of findings and share lessons learned STANDARDS Utility Feasibility Propriety Accuracy Adapted from the Centers for Disease Control and Prevention (CDC) Program Evaluation Framework

2. Step 1. Engage Stakeholders Who are they? Those involved in program operations, those affected by the program operations, and primary users of evaluation results

3. Step 2. Describe the Program Program’s goal and purpose Problem or need that is to be addressed Expected effects, how success is defined Activities, what the program does to effect change Resources: time, talent, technology, money and any other available assets Stage of development, how long in operation Contextual aspects; history, socioeconomic factors Logic model; sequence of events to effect change

4. Logic Model Example Resources (Inputs)  Activities (Outputs)  Impact (Outcomes) InstructorsClasses &  Short-term Workshops Knowledge Money Skills Training inIntermediate Computers,  Relationship  Practices EquipmentSkills Behaviors Long-term CurriculumPre / Post Tests  Responsible Parenting Basic Model for a Paternity Education Program

5. Step 3. Focus the Evaluation Specify what you want to know (key questions) Decide who will be involved in or affected by the evaluation, or use the findings To focus an evaluation, consider its purpose, methods, roles, budget, deliverables, etc.

6. Purposes Gain insight: Assess needs, identify barriers, describe program Change practice: Refine plans, make mid- course adjustments/enhancements Assess effects: Assess success, skills development by program participants Affect participants: Raise awareness, support organizational development

7. Step 4. Gather Credible Evidence Select methodological approach, sources of evidence, and data collection instruments Determine who is to be studied and when Evidence must be believable, trustworthy, and relevant

8. Methodology and Sample Quantitative, including the use of linked data files Qualitative Mixed Method Things to Consider… Sample selection Use of comparison groups Timing and frequency of data collection

9. Step 5. Justify Conclusions Analyze data to determine findings Interpret: What do the findings mean? Judgments: What is the value of findings based on accepted standards Recommendations: What claims can be made based on the evidence and the programmatic context, i.e. environmental and social influences

10. Step 6. Ensure Use & Share Lessons Learned Ensuring that stakeholders are aware of the evaluation procedures and findings That findings are considered in decisions or actions that affect the program Those who participated in the evaluation have had a beneficial experience Lessons learned are disseminated in a timely, unbiased, and consistent manner