1. Cornell University Program Planning and Evaluation From Theory to Practice and Back: Finding New Ways to Link Research and Practice Jennifer Southwick Brown Ph.D. Candidate Department of Human Development May 31, 2007

2. Evaluation Team Leaders –Bill Trochim, Jennifer Southwick Brown, Sarah Hertzog, Claire Lobdell, Cath Kane Evaluation Planning Partnerships –7 sites in Cornell Cooperative Extension New York City, Tompkins County, St. Lawrence County, Jefferson County, Chenango County, Onondaga County, Ulster County –Museum of the Earth, Cornell Center for Materials Research Acknowledgements

3. Why did we read the Renger & Hurley (2006) article? Systems Evaluation –From logic models to Pathway models –Analysis of evidence The Netway: Creating a tool for the future Overview

4. Program theory –Theory of change What we’re going to do, with whom, in what context, to effect what outcomes –Logic Model Visual representation (typically columnar) of the inputs, activities, outputs, short- and long-term outcomes associated with a program Basic theory What do we mean by theory?

5. Activities, Stakeholders, Participants, Outcomes, Goals How can we achieve a link between research and practice? –Planning and Evaluation/Feedback What do we mean by practice?

6. Youth Leadership Academy Public Presentation Program Developing a Program Model: NYC 4-H After-School Clubs and Special Interest Projects Context / Assumptions InputsActivities Students make public presentations to a group Outputs Youth interest in science Increased interest in science education Develop leadership skills ShortMedium Long Outcomes Curricula FTE Extension Educators Partnerships (community, sponsors) State & National 4-H Initiatives Volunteers Agilent Science & Tech Volunteer Orientation & Trainings Students complete engineering kits Increased rates of higher education & career goal attainment Funder mandates time & budgetary constraints Staff is proficient at train-the trainer skills

7. Increased rates of higher education & career goal attainment Short-Term Outcomes Outputs Activity Developing a Pathway Model Agilent Science & Tech Public Presentation Program Volunteer Orientation & Trainings Youth Leadership Academy Legend: Students complete engineering kits Students make public presentations to a group Youth interest in science Develop leadership skills Increased interest in science education Medium-Term Outcomes Long-Term Outcomes

8. Articulating Causal Relationships Students complete engineering kits Youth interest in science Increased interest in science education

9. Analysis of Evidence: Finding the “Golden Spike” Students complete engineering kits Youth interest in science Increased interest in science education Increased rates of higher education & career goal attainment

10. The Netway is an internet-based database tool for monitoring and tracking program activities and participants Features of the Netway –Stores program information –Converts logic models to pathway models –Produces evaluation plans –Stores participant information –Provides logic model, pathway model, & participant reports The Netway

11. http://www.extensionnetway.net/ The Netway: Tracking Programs

12. The Netway: Logic Model

13. The Netway: Pathway Model

14. The Netway: Evaluation Plan Report

15. Program –Description –Questions –Activities Methods –Sampling –Measures –Design –Analysis Reporting The Netway: Develop Evaluation Plan

16. The Netway: Participant Report

17. Interactive user database –Practitioner Practitioner: Connecting similar programs, activities, outcomes, & measures –Practitioner Researcher: Connecting research to programs Referral Linkages Social Networking Interactive Web Graphics The Netway in the Future

18. The Netway in the Future: Referral Linkages

19. The Netway in the Future: Networking

20. The Netway in the Future: Academic Portal

21. The Netway in the Future: Student Portal

22. The Netway in the Future: Visual Networks http://www.touchgraph.com/

23. The Netway in the Future: Visual Networks http://www.touchgraph.com/

24. The Netway in the Future: Visual Networks

25. The Netway: Research to Practice AND BACK Pilot testing and development with the 7 CCE sites, Museum of the Earth, and CCMR Designing and populating the researcher portal Finding gaps in the research literature Adding additional portals

26. Online Resources Research Methods Knowledge Base http://www.socialresearchmethods.net Penn State Cooperative Extension (website) Extension and Outreach Program Evaluation: http://www.extension.psu.edu/evaluation/ University of Wisconsin Extension (online course) Enhancing Program Performance through Logic Models: http://www1.uwex.edu/ces/lmcourse/ Cornell Website: http://evaluation.cce.cornell.edu

27. InitiationDevelopmentMaturityTranslation & Dissemination Farmer’s Market EFNEP Project Bridge Program Lifecycle

28. InitiationDevelopmentMaturityTranslation & Dissemination Farmer’s Market Program Phase Evaluation Phase Project Bridge EFNEP Program & Evaluation Alignment