1. Developmental Evaluation Why we do it How we are using it A way to contribute

2. Intractable social issues

3. “In an increasingly complex world, sometimes old questions require new answers”

4. Developmental Evaluation (DE) (Patton, 2011) Innovative, design- oriented initiatives Strategies, Partnerships, & Outcomes can all be emerging Unfolding in complex contexts

5. The Good, the Bad and the Ugly of Evaluation

6. All evaluation should support learning Developmental evaluation is different because learning, reflection and ongoing discussion about how to do things is central to the process

7. Solving social issues can be a tricky, messy place

8. Provide Education & Training Workshops Support the Sharing of Learning & Knowledge within Hamilton and across Communities ASCY – Save the Day for Play Logic Model Early Learning Professionals Early Learning Child Care Centres OELF Principles Realized in Practice The early years of Ontario children are catalyst to the development of social, emotional, communication, cognitive and physical skills fundamental to life-long learning and health. Environments Prepared by The O’Halloran Group www.theohallorangroup.ca, October 2011www.theohallorangroup.ca More Welcoming Enriched to Spark Curiosity & Exploration Better Reflect Unique Needs & Diversity More Space and Time for Play Based Learning Communities Increased Mentorship Greater Collaboration Stronger Networks More Integrated Child Care System focused on the OELF Principles Greater Valuing & Sharing Between Early Learning Programs ASCY Deeper Knowledge & Understanding of OELF Greater Skill for & Valuing of Play Based Learning Increased Resources for Supporting \Sustainability Increased Reflection to Inform Planning Increased Creativity, Experimentation & Building More of Their Own Solutions More Amenable View of the Child More Common Professional Language Increased Skill for Observing & Documenting Play Facilitate Readiness for Curriculum Change Provide Mentoring & Coaching Support Leadership Development Strategic Planning, Program Logic Models, Policies & Procedures better reflect OELF/Save the Day for Play Improved Continuum of Development; Observation & Documentation Greater engagement of the director as a collaborator in learning

9. In a developmental evaluation, imposing a logic model can feel something like this…

10. #BeFearless Making mistakes Going back & redesigning your process

12. When DE Makes Sense  Initiative is emerging in a complex context  Direction and outcomes are unknown  Partners and collaborators may change & grow  There is openness to engagement & reflection  There can be comfort with ambiguity and shifting processes

13. Role of the evaluator

14. AskDesignDoShareListen What I would do in a typical evaluation

15. AskListenDistillShareReflect What I do in a DE context

16. Never Stop Questioning What, So What, Now What? What were the critical decisions that were made? How has learning informed the development of activities? Where are we now? Where do we want to go next? To what extent and in what ways are we working with others?

18. A good evaluation – developmental or otherwise – reflects the conditions of that which it is attempting to evaluate

21. Social Prosperity Wood Buffalo Theory of Change Complexity Momentum Sustainability Stakeholder Groups

25. To examine and characterize the contribution and outcomes of Social Prosperity Wood Buffalo as a systems-level intervention designed to achieve social change

27.  Learning  Knowledge transfer  Stakeholder Engagement  Complementary Research Strategies Social Prosperity Wood Buffalo Evaluation Plan

28. Phases Laying the Ground Work Learning as We Go Reflecting on What We Achieved Looking Forward

29. Evaluation Questions 1.What is the contribution to capacity & innovation? 2.How do activities change? 3.What are the lessons learned? 4.What supports innovation? 5.What supports resiliency? 6.What is the impact on relationships and networks? 7.What is the impact on capacity? 8.What are the outcomes of innovation? Social Prosperity Wood Buffalo Evaluation Plan

30. Methods & Tools Activity Tracking Community Asset Map Feedback Surveys Key Informant Interviews Capacity Assessment Social Prosperity Wood Buffalo Evaluation Plan

31. …so far

32. Innovation Capacity Building

34. Capacity Assessment Measure To assess capacity for delivering responsive programs and services. The development of supports The development of benchmarks and capacity indicators

35. Available online As a pdf on the Social Prosperity & Sector Link websites http://socialprosperity.ca http://nonprofitsectorlink.com Open from now until end of June Goal is 100 completed

38. Tanya Darisi, M.A. Director The O’Halloran Group tanya@theohallorangroup.ca www.theohallorangroup