1. Monitoring and evaluation of service delivery and outcomes Sally Thompson Welsh Government

2. Importance of monitoring and evaluation Commissioners required to regularly assess whether the spending plans and projected outcomes of projects / services are aligned to objectives of local and national strategy and remain fit for purpose Need to ensure value for money of expenditure against outcomes

3. Importance of monitoring and evaluation Accountability Service development

4. Having a clear understanding What difference do you want to make? (aims) Why are you doing it (i.e. the differences an organisation hopes to make for substance misusers) (outcomes) What are you going to do to accomplish the aims? (Outputs)

5. Welsh Government expectations Each Area Planning Board Will be required to produce an outcome based commissioning strategy (April 13) Costed Implementation Plan (April 12) Work towards a Results Based Accountability approach and can evidence how this is monitored (April 12) Have a clear framework in which to performance manage the KPIs (April 12)

6. Mandatory requirements in Wales Implementation of the national Key Performance Indicators (KPI) New suite of KPIs will become operational from July 2012. The revised KPIs are looking at both activity levels and outcomes for clients

7. Proposed Indicators Increase the number of clients who engage with services between assessment and planned ending of treatment Achieve a waiting time of less than 20 working days between referral and treatment Substance misuse is reduced for problematic substance between start and most recent review / exit TOP

8. Proposed indicators Injecting risk behaviour between treatment start and exit Quality of life is improved between start and most recent review / exit TOP No. / % of cases closed (with a treatment date) as treatment completed There will also be a BBV indicator added for implementation in April 2013.

9. In true workshop style … What do you see as the difficulties / challenges of monitoring and evaluation of services within your areas? How do you overcome these? Or anything else you wish to raise …