Presentation on theme: "HOUSEKEEPING All participants are automatically muted by webinar administrators. Please type any questions using the Chat feature. This Webinar will be."— Presentation transcript:
1HOUSEKEEPINGAll participants are automatically muted by webinar administrators.Please type any questions using the Chat feature.This Webinar will be recorded and posted on websites of the participant CBA programs.
2THIS WEBINAR IS PART OF THE GRANT WRITING PREPAREDNESS SERIES CO-HOSTED BY:SHARED ACTION,AIDS PROJECT LOS ANGELESCAPACITY FOR HEALTH,ASIAN AND PACIFIC ISLANDERAMERICAN HEALTH FORUMCA STD/HIV PREVENTIONTRAINING CENTER
3TODAY’S WEBINAR: Shared Action at AIDS Project Los Angeles, WAS DEVELOPED BY:Shared Action at AIDS Project Los Angeles,a Capacity Building Assistance Program, in Los Angeles
4WHO WE ARE:We are funded by The Centers for Disease Control and Prevention (CDC) to provide FREE trainings and one-on-one technical assistance for community-based organizations (CBOs) on:Organizational Infrastructure and Program Sustainability,Evidence-Based Interventions (EBIs) and Public Health Strategies, andMonitoring and Evaluation.
5DEVELOPING EVALUATION PLANS Andi ZaverlExperience:CBA Evaluation SpecialistEducation:Claremont Graduate UniversityChapman University
6Developing an Evaluation Plan This Webinar will be recorded and made available through our websites along with copies of the slides
7LEARNING OBJECTIVES By the end of this Webinar, participants will: Be able to explain the importance of developing an Evaluation Plan.Be able to identify the 5 key elements to include in an Evaluation Plan.
8What is an Evaluation Plan? An Evaluation Plan is a written document that outlines policy and procedure on how each of your objectives (outcome and process) will be evaluated to ensure that your program’s goal is met.
9What’s the Purpose? 6. Monitoring and Evaluation Develop a Monitoring and Evaluation Plan- Funded applicants must work with CDC to develop and implement a process monitoring plan and conduct routine monitoring and evaluation for each intervention and/or service they provide. For applicants that are selected for funding, CDC will provide a template and technical assistance for developing a process monitoring plan at the time of award. At a minimum, the monitoring plan will include the following:Program goals and measurable objectives.Activities that will be conducted to meet the objectives.Data collection plans, proposed staffing, timelines, and tools.How data will be used, by whom, and when to measure progress towards meeting objectives.Procedures to ensure that data quality and security are consistent with CDC guidelines.
10Purpose Other than being required: Increases efficiency of the evaluation.Ensure evaluation is planned from the beginning.Reduces duplicate work.Increases use of evaluation findings.
11Evaluation Plan Elements Description of your program (e.g. background, design)Purpose of the EvaluationObjectives, Indicators, Logic ModelEvaluation MethodsReport and Information Transfer
12An Example Intervention: Community Promise:Community Level InterventionUses Peer Advocates and Role Model Stories to diffuse HIV Prevention information to persons at risk.
13Evaluation Plan Elements Description of your program (e.g. background, design)Purpose of the EvaluationObjectives, Indicators, Logic ModelEvaluation MethodsReport and Information Transfer
14I. Description of your program Brief description of:Type of InterventionTarget PopulationGeographical CoverageGoals
15II. Determining the purpose What is the primary purpose of the evaluation?Who is most likely to need and use the information obtained?How will the information be used?
16III. Objectives, Indicators and Logic Model List of Process and Outcome objectivesProcess ObjectiveOutcome Objective:List of Indicators: expected outcomes
17Performance Indicators Indicator Year 1 Year 2 Year 3 Knowledge 10% 15% 15% Retention 70% 75% 80%
19Methods- Collecting Data Variables (e.g., demographics, KABB, participation, marketing)Data collection methodsFormative evaluation/Community Assessment: Literature review, existing data, focus groups, interviewsProcess and Outcome monitoring: Sign-in sheets, risk-assessments, pre and post, follow-ups, behavioral commitment forms, etc.Paper or computer-basedDescribe
20For Example:By December 31, 2011, the program staff will recruit 50 African American MSM at high risk for HIV to participate in HIV 101 workshop.The program staff will collect data from the participants on age, gender, ethnic background, sexual behavior and place of recruitment.
21Methods- Collecting Data (cont’) Staffing Pattern:Personnel involvement in the evaluationQualification skillsResources:Hardware and softwareConfidentiality/ProtectionSpecial infrastructure needs
22Methods-Analysis Data management Statistical analysis Organizing data Transforming data to electronic baseStorage of dataStatistical analysisDescription of statistical processes (e.g., frequencies, tables, special statistics)Triangulation
23V. ReportDescription of how the findings will be presented to the funders and opportunities to diffuse the information to other stakeholders.
24Evaluation Plan Remember to include: Program Description (e.g. background, design)Purpose of the EvaluationObjectives, Indicators, Logic ModelMethods (e.g. variables, collection methods)ReportAdd examples maybe?Background and Logic Modelbrief description of the history and current status of the program as well as of the logic model, which is a simple desciption of how the activities carried out within the program are related to the expected outcomes.Purpose of the EvaluationEvaluation QuestionsThe specific questions the evaluation will answer. Such questions should be closely aligned with the evaluation purposes,Evaluation MethodsOverall design strategy to answer the evaluation questions, including a plan to collect and analyze data.Team Composition and ParticipationProcedures and LogisticsSpecify the various procedural requirements of evaluation, including evaluation activities at the project level, the general schedule - duration, phasing and timing considerationsReporting and Assuring UseBudget
25Evaluation Plan for this Grant Proposal Describe the applicant’s goals for development and implementation of enhanced HIV testing.Provide objectives, a list of minimum steps to achieve objectivesDescribe how and at what point data collection will occur.Describe how monitoring and evaluation data will be used, by whom, and when.Describe how any technical assistance needs associated with meeting program monitoring and reporting requirements will be identified and met.
26Evaluation Plan Template QuestionIndicatorsData Sources/MethodsPerson ResponsibleTimeline1.2.3.
27Evaluation Plan Template 1.FocusWhat will we evaluate (which program or aspect of a program)?2. QuestionsWhat do you want to know?3. Indicators-EvidenceHow will we know it?4. TimingWhen should we collect data?5. Data CollectionSourcesWho will have this information?MethodsHow will we gather the information?SampleWho will we question?instrumentsWhat tools shall we use?18.104.22.168.a.b.c.
28Evaluation Plan Template 6. How will the data be analyzed?7. How will the data be interpreted?8. How will the results be communicated?To WhomWhen? Where? How?
32Additional ResourcesSlides and a recorded version of this webinar will be available on the following websites:-AIDS Project Los Angeles- Shared Action -Capacity 4 Health, APIAHF -CA STD/HIV Prevention Training CenterContact us for individualized capacity building assistance