Demonstrating the Outcomes What Does it Take to Make a Difference? Joint PDI / STRADA MASTERCLASS

Purpose of Today “PDI has made a significant contribution to the voluntary sector’s response to the needs of children and young people in the context of family and community, from the specific areas of drug and alcohol misuse. It is clear from the data surveyed that a much more holistic, strengths based perspective has been taken by the projects, than just what drugs and alcohol do to young people and families. In some respects this perspective has been ahead of its time. The measurement of outcomes has been to some extent pioneered by the PDI approach. PDI understands that what we measure should not be limited to that which we can measure. PDI is assisting in the development of how we show to both voluntary and statutory funders that the reporting of the ‘soft’ outcomes, the ‘distance travelled’ for many families and young people affected by drug and alcohol misuse depends upon more complex interpretation than quantitative data can provide.” Continuation Study of Practice Issues Evidenced in Projects Funded through PDI; STRADA (June 2010)

PDI Journey What is an outcome What is an indicator Reports provide outcome detail Measuring the indicators Building in the numbers Reports provide information on the positive changes Reflecting on the outcomes being achieved Understanding what it takes to achieve outcomes Recognition of the importance to reflect and develop outcomes

Achieving an Outcome  Focus on helping projects understand what realistic outcomes they can support and how this can help contribute to the longer journey  Offer ongoing guidance, support and training to help think through how outcomes and evaluation significantly impacts on delivery and planning  Understanding the importance of the soft measures, how they contribute to the ‘hard outcomes’

The Outcomes  Improved health and well-being  Increased confidence and self-esteem  Increased coping skills  Improved parenting capacity  Increased safety of children  Improved educational/employment attainment  Reduced or abstained substance use

The Indicators  Increased attendance at school  Improved family relationships  Parents setting routines and boundaries  Parents ensuring children access dental/health appointments  Parents understanding the impact of their substance use  Children have improved behaviour  Children are more able to make friends  Families are accessing community activities  Families have improved involvement with statutory services  Parents are accessing employment training opportunities  Increased identification of children at an earlier stage  Young people are involved in less risky behaviours

Progressing Change Abstaining from drug misuse Re-engaged with school Accessing community volunteering Improved self-esteem Improved family relationships Seeking support from other services Engaging with service Attending appointments on a regular basis Understanding the impact of substance use RELATIONSHIPS THROUGHOUT

Our Understanding of the Outcomes

Knowing this works Parents setting boundaries and routines Worker Observation Star Chart completed by child/parent Families involved in community activities Outcome Action Plan Counting! number of times family regular attend community activity children are more able to make friends Feedback from school Relationship Map with Child

Knowing this works  Relationship is key, using the workers experience and skills – observation.  Strengths based approaches isn’t just for assessment, an effective tool to be used to measure change.  It isn’t a form filling exercise – outcomes are about seeing the difference.  self-evaluation can work as long as it is robust and genuine understanding of how it helps.

Seeing the results Reported Core PDI Outcomes (33 projects – Apr 2012)

Seeing the results Reported Indicators of Self-esteem and confidence (33 projects – Apr 2012)

Seeing the results

So what next? We don’t know it all!! We need to improve our support and learning to:  Improving awareness of IT skills and database systems  Continual PDI self-development  Better ways of effectively and supportively involving children in evaluation  Become over complacent in a world of outcomes

Additional Information  Lloyds TSB Foundation for Scotland:  Evaluation Support Scotland:  Partners in Evaluation:  Outcome Star: