Developmental Evaluation Why we do it How we are using it A way to contribute

Intractable social issues

“In an increasingly complex world, sometimes old questions require new answers”

Developmental Evaluation (DE) (Patton, 2011) Innovative, design- oriented initiatives Strategies, Partnerships, & Outcomes can all be emerging Unfolding in complex contexts

The Good, the Bad and the Ugly of Evaluation

All evaluation should support learning Developmental evaluation is different because learning, reflection and ongoing discussion about how to do things is central to the process

Solving social issues can be a tricky, messy place

Provide Education & Training Workshops Support the Sharing of Learning & Knowledge within Hamilton and across Communities ASCY – Save the Day for Play Logic Model Early Learning Professionals Early Learning Child Care Centres OELF Principles Realized in Practice The early years of Ontario children are catalyst to the development of social, emotional, communication, cognitive and physical skills fundamental to life-long learning and health. Environments Prepared by The O’Halloran Group October 2011www.theohallorangroup.ca More Welcoming Enriched to Spark Curiosity & Exploration Better Reflect Unique Needs & Diversity More Space and Time for Play Based Learning Communities Increased Mentorship Greater Collaboration Stronger Networks More Integrated Child Care System focused on the OELF Principles Greater Valuing & Sharing Between Early Learning Programs ASCY Deeper Knowledge & Understanding of OELF Greater Skill for & Valuing of Play Based Learning Increased Resources for Supporting \Sustainability Increased Reflection to Inform Planning Increased Creativity, Experimentation & Building More of Their Own Solutions More Amenable View of the Child More Common Professional Language Increased Skill for Observing & Documenting Play Facilitate Readiness for Curriculum Change Provide Mentoring & Coaching Support Leadership Development Strategic Planning, Program Logic Models, Policies & Procedures better reflect OELF/Save the Day for Play Improved Continuum of Development; Observation & Documentation Greater engagement of the director as a collaborator in learning

In a developmental evaluation, imposing a logic model can feel something like this…

#BeFearless Making mistakes Going back & redesigning your process

When DE Makes Sense  Initiative is emerging in a complex context  Direction and outcomes are unknown  Partners and collaborators may change & grow  There is openness to engagement & reflection  There can be comfort with ambiguity and shifting processes

Role of the evaluator

AskDesignDoShareListen What I would do in a typical evaluation

AskListenDistillShareReflect What I do in a DE context

Never Stop Questioning What, So What, Now What? What were the critical decisions that were made? How has learning informed the development of activities? Where are we now? Where do we want to go next? To what extent and in what ways are we working with others?

A good evaluation – developmental or otherwise – reflects the conditions of that which it is attempting to evaluate

Social Prosperity Wood Buffalo Theory of Change Complexity Momentum Sustainability Stakeholder Groups

To examine and characterize the contribution and outcomes of Social Prosperity Wood Buffalo as a systems-level intervention designed to achieve social change

 Learning  Knowledge transfer  Stakeholder Engagement  Complementary Research Strategies Social Prosperity Wood Buffalo Evaluation Plan

Phases Laying the Ground Work Learning as We Go Reflecting on What We Achieved Looking Forward

Evaluation Questions 1.What is the contribution to capacity & innovation? 2.How do activities change? 3.What are the lessons learned? 4.What supports innovation? 5.What supports resiliency? 6.What is the impact on relationships and networks? 7.What is the impact on capacity? 8.What are the outcomes of innovation? Social Prosperity Wood Buffalo Evaluation Plan

Methods & Tools Activity Tracking Community Asset Map Feedback Surveys Key Informant Interviews Capacity Assessment Social Prosperity Wood Buffalo Evaluation Plan

…so far

Innovation Capacity Building

Capacity Assessment Measure To assess capacity for delivering responsive programs and services. The development of supports The development of benchmarks and capacity indicators

Available online As a pdf on the Social Prosperity & Sector Link websites Open from now until end of June Goal is 100 completed

Tanya Darisi, M.A. Director The O’Halloran Group