Introduction to Impact Assessment This introduction uses the Weaver’s Triangle, designed by Jane Weaver it has been developed by the Charities Evaluation Service (CES) as part of their monitoring and evaluation model.

The Weaver’s triangle helps you identify the aims and objectives, so you can put in place methods for monitoring and evaluating the work you are carrying out using performance indicators such as: Impact or outcome and Output measures Self evaluation cycle to achieve and how? what do you want objectives: Set aims and Set performance measure your indicators: to progress programme Deliver work recommendations and implement Review project Needs assessment Who likes Data? I do find it fascinating and a great objective way of finding out why think are working well or not working.

The Weaver’s Planning Triangle Here we’ve got topics with the snappy title of 9 data projects to improve your provision All of these relate to the learner journey and their experience in any learning or training organisation. I wasn’t sure they would be applicable to all of our remit but I was talking to a Nextstep provider and he said at first about 7 were relevant, then a little while later said all are relevant and had done some really interesting things with them.

The Triangle in context The great thing about all these projects is that you don’t actually even need to use numbers with them, they work just as well without. For this example we will use numbers and we will make the picture quite extreme as that makes the illustration work even better. OK the scenario is a that a large national provider works that 80% of learners have an initial assessment What question does that immediately beg? Discussion Another situation might be that 50% of the learners receive additional learning Support What investigation might this trigger?

Aims relate to outcomes & impact Aims = the benefits or changes you are trying to achieve The overall aim should relate to the impact you are trying to achieve The specific aims should be linked to the outcomes start with words that indicate a change, for example: to increase, to enable, to develop, to improve etc. These projects generate what we call Quality Improvement Questions that will Help you focus on the main improvement issues and help you develop appropriate action plans

Objectives relate to products or outputs Objectives = the methods or the activities by which you achieve your aims The objectives should link to the products or outputs from your activities (eg events held, leaflets distributed, observations made) start with words that indicate activity, for example: to organise, to produce, to set up etc. These are the 9 topics now choose 1 that either fits in with one your key Challenges or another area of your choice. Select the relevant topic and go through the process. We will circulate to help you and provide the answer or Question sheet that will give you some more ideas.

The Weaver’s Planning Triangle

The Triangle in context

What are outputs? Outputs are linked to the project objectives Outputs are all the detailed activities, services and products connected to the project. Eg training events, materials, leaflets, visits, observations etc

Objective: Set up ‘surgeries’ to discuss the new-build Output example Objective: Set up ‘surgeries’ to discuss the new-build Outputs: Drop in sessions for staff and the public to meet the senior executive and estates manager in the organisation Targeted consultation and advice sessions Eg with learners with particular needs and their carers.

Output Indicators The indicators are what you can use to assess whether you have achieved your outputs They assess progress towards meeting your project objectives They are a type of performance indicator

Output indicators, example Drop in sessions for staff and the public to meet the senior executive and estates manager in the organisation Output indicators: Number of drop in sessions Number of people attending Types of drop in sessions Profile of people attending

Outcomes are linked to the specific aims What are outcomes? Outcomes are linked to the specific aims Outcomes are the changes, benefits, learning or other effects that actually occur as a result of your activities. They can be expected or unexpected, positive or negative.

Outcome indicators or measures are how you assess whether an expected outcome is occurring and assess progress towards meeting an aim Impact and outcome measurement is basically about the same thing, a change that results from the improvement actions taken Outcome indicators are a performance indicator and can be qualitative or quantitative

What indicators or measures could you use? Outcome example Specific aim: To improve the cascading of information regarding the new-build across the organisation and in the local community Outcomes: Increased knowledge of the new-build programme Increased marketing of the organisation Increased confidence and reputation What indicators or measures could you use?

Monitoring outputs and outcomes Use the indicators for monitoring Collate information on your output indicators to show outputs have been delivered and to show progress towards meeting targets. Collect information on your outcome indicators to demonstrate that outcomes are achieved. Collect baseline information before you start, in order to measure the impact of your improvement actions