Evaluating Title IIID Programs

November 8, :00-2:00 PM Webinar conference line toll free number (888) Code Login information

How do you Evaluate Title IIID Programs Is the program an evidence-based program? Highest Tier Does not require evaluation if you follow the program.

Intermediate Criteria Published in a peer-reviewed journal Uses pre-post tests or case controls Has dissemination products for use by community organizations

Minimum Criteria Evaluated to be effective for improving health, wellbeing or reducing disease, disability and or injury among older adults. Uses an appropriately credentialed practitioner Is backed by a peer-reviewed journal article on the activity Is ready to be used in the community

Steps Engage Participants Describe the program Focus the evaluation design Gather credible evidence Draw conclusions Ensure use and share lessons learned

Center for Disease Control Standards Utility Feasibility Propriety Accuracy

Supporting Documentation Journal Article demonstrating the activity is effective for improving the health, well being or reducing disease or disability among older adults. Evaluation of the program’s effectiveness for your participants. Credentialed Practitioner determined by the AAA Program or a health intervention OR AND

Why Evaluate When no research is available To meet AoA requirements For data driven decisions

When do you evaluate? At the beginning of your efforts Determine what you will measure To determine participant change at the end of the program To provide tailored results in the middle of the program To provide feedback on specific questions

What results do you need? Avoid measure mayhem Interact with participants on specific outcomes Evaluate only what you can control Get information that will help you determine if your program is effective or if you need to change direction

How do you evaluate? Determine who will evaluate Plan simple steps that are maintainable by staff Make evaluating routine Establish a plan to manage data, document results and publish findings

Examples of Evaluations Anecdotal stories or testimonials Surveys Pre and post tests Observations Use variety of data

Draw Conclusions What is the ultimate impact? Was the desired change accomplished? Look at short term, medium and long term results. What could be improved? Share your results.

Discussion What results do you want to evaluate? What can you measure to find the answer? Who will be responsible for the information?

References Evaluation of Health Promotion Programs for Older Adults: An Introduction. health/center-for-healthy-aging/content- library/EvaluatingEBPrograms_Intro.pdf health/center-for-healthy-aging/content- library/EvaluatingEBPrograms_Intro.pdf Evaluation Workshop PowerPoint. Evaluation-Workshop.pdf Evaluation-Workshop.pdf

Resources Administration on Aging Resource List of evidence-based programs: ex.aspx ex.aspx The Center for Health Aging (The National Council on Aging). Learning modules. The California Department of Aging ntion_and_Health_Promotion/ ntion_and_Health_Promotion/

Resources Evaluation Management Checklists by Western Michigan University Retrieved from: management/ management/ st_mar07.pdf st_mar07.pdf Developing an Effective Evaluation Plan Workbook-508.pdf Workbook-508.pdf

Resources A Framework for Program Evaluation orksummary.PDF orksummary.PDF Introduction to Program Evaluation for Public Health Programs: A Self-Study Guide Manual.pdf Manual.pdf