1. Adding evaluation to your plan and next steps: proposal Webinar 4 of the series Mapping an Outreach Project: Start with Information; End with a Plan The NN/LM Outreach Evaluation Resource Center

2. Agenda Webinar 1: (1 CE hour) How people adopt new ideas Webinar 2: (1 CE hour) Meeting the Community through Community Assessment Webinar 3: (1 CE hour) Planning Outcomes-Based Outreach Programs Webinar 4: (I CE hour) Adding evaluation to your plan and next steps: proposal writing Homework (4 CE hours): Four 1-hour homework assignments.

3. Objective written from logic model Outcome Parents will increase their ability to find online health information Outcome Objective By the end of the training session, 70% of parents will report being able to use MedlinePlus to locate information on at least one health topic that was important to them

4. Example Objective: Awareness Outcome The OERC will improve access to information about emerging evaluation trends among NN/LM members Outcome Objective By the May 2015, All 8 regional medical libraries will have re-posted OERC blog articles in their Newsletters or blog

5. Objective Example: Impact Outcome Clinicians will recommend health information to their patients Outcome Objective One month after training, 60% of clinicians will report providing at least one patient with Information about MedlinePlus

6. Webinar 4: Adding Evaluation to Your Plan

7. What your stakeholders want to know  Did you get there?  Did you do everything you planned?  How Did you get there?  Did you do everything you planned?  What unexpected things happened?  Would you go there again?  What advice do you have for others?  What would you do differently next time?  What nexpected things happened?  Would you go there again? What advice do you have for others? What would you do differently next time?

8. Focus on “Rapid” methods Short surveys Site visits Observations Key informant and focus group interviews Existing data review

9. Use mixed methods Quantitative methods for numbers Qualitative methods for text or images

10. Source and Method Where we find dataHow we collect data

11. Process evaluation: Keeping your eyes on the road

12. Process assessment is developed for planned activities

13. Documenting process

14. How to describe progress

15. Add check-ins with key players

16. Comments and feedback allow you to assess quality of your program

19. How do you evaluate your outcome objective? By the end of the training session, 70% of parents will report being able to use MedlinePlus to locate information on at least one health topic that was important to them DATA SOURCE Participants EVALUATION METHOD Session Evaluation Form DATA COLLECTION TIMING At the end of each training session

20. How do you evaluate your outcome objective? By the May 2015, All 8 regional medical libraries will have re-posted OERC blog articles in their newsletters or blog DATA SOURCE NN/LM websites EVALUATION METHOD Review of blogs and newsletters DATA COLLECTION TIMING At the end of each quarter

21. Cindy Olney’s go-to methods

22. Example: The STISD Health Literacy Internship Project

25. Appreciative Inquiry: Sharing peak experiences and aspirations

26. Basic AI Questions Tell me a story about the best experience you have had with our library. What did you value most about that experience? Why was that experience important to you? What services or opportunities do you wish the library offered users like you? What could make the library an even stronger asset to you?

27. Most Significant Change Method

28. Basic MSC Questions What is the most significant change you have experienced since________ Why was this change so significant to you? What different has it made already? What difference will it make in the future?

29. Photovoice: Telling stories through pictures

30. The Photo-Story Template Describe the picture (Who is in it? What are they doing? When did this happen? ) What happened as a result of your teaching this person or these people about MedlinePlus? (How did it help them? What did they do differently?) Why do you consider this change important?

31. How could the logic model help plan proposals? InputsBudget ActivitiesStrategies OutputsDeliverables OutcomesResults & Evaluation InfluencesSupport & Barriers AssumptionsReviewers’ questions

32. How this process assists proposal writing Evidence of need Target population Goals and objectives (Process; outcomes) Project plan and implementation schedule Promotion plan Evaluation plan Continuation plan Qualifications Budget

33. NN/LM Outreach Evaluation Resource Center Web Address: http://nnlm.gov/evaluation/ Cindy Olney Acting Assistant Director olneyc@uw.edu 678-682-3864

34. Notice about images in this document Many images in this documents are copyright protected and should not be used in other presentations or publications.