Presentation on theme: "Introduction to Impact Assessment"— Presentation transcript:
1 Introduction to Impact Assessment This introduction uses the Weaver’s Triangle, designed by JaneWeaver it has been developed by the Charities Evaluation Service(CES) as part of their monitoring and evaluation model.
2 The Weaver’s trianglehelps you identify the aims and objectives, so you can put in place methods for monitoring and evaluating the work you are carrying out using performance indicators such as:Impact or outcome andOutput measuresSelf evaluation cycleto achieve and how?what do you wantobjectives:Set aims andSet performancemeasure yourindicators: toprogressprogrammeDeliver workrecommendationsand implementReview projectNeeds assessmentWho likes Data?I do find it fascinating and a great objective way of finding out why thinkare working well or not working.
3 The Weaver’s Planning Triangle Here we’ve got topics with the snappy title of 9 data projects to improveyour provisionAll of these relate to the learner journey and their experience in anylearning or training organisation.I wasn’t sure they would be applicable to all of our remit but I was talkingto a Nextstep provider and he said at first about 7 were relevant, then alittle while later said all are relevant and had done some really interestingthings with them.
4 The Triangle in context The great thing about all these projects is that you don’t actually even need touse numbers with them, they work just as well without.For this example we will use numbers and we will make the picture quite extremeas that makes the illustration work even better.OK the scenario is a that a large national provider works that 80% of learnershave an initial assessmentWhat question does that immediately beg?DiscussionAnother situation might be that 50% of the learners receive additional learningSupportWhat investigation might this trigger?
5 Aims relate to outcomes & impact Aims = the benefits or changes you are trying to achieveThe overall aim should relate to the impact you are trying to achieveThe specific aims should be linked to the outcomesstart with words that indicate a change, for example: to increase, to enable, to develop, to improve etc.These projects generate what we call Quality Improvement Questions that willHelp you focus on the main improvement issues and help you developappropriate action plans
6 Objectives relate to products or outputs Objectives = the methods or the activities by which you achieve your aimsThe objectives should link to the products or outputs from your activities (eg events held, leaflets distributed, observations made)start with words that indicate activity, for example: to organise, to produce, to set up etc.These are the 9 topics now choose 1 that either fits in with one your keyChallenges or another area of your choice. Select the relevant topic and gothrough the process. We will circulate to help you and provide the answer orQuestion sheet that will give you some more ideas.
9 What are outputs?Outputs are linked to the project objectivesOutputs are all the detailed activities, services and products connected to the project. Eg training events, materials, leaflets, visits, observations etc
10 Objective: Set up ‘surgeries’ to discuss the new-build Output exampleObjective: Set up ‘surgeries’ to discuss the new-buildOutputs:Drop in sessions for staff and the public to meet the senior executive and estates manager in the organisationTargeted consultation and advice sessionsEg with learners with particular needs and their carers.
11 Output IndicatorsThe indicators are what you can use to assess whether you have achieved your outputsThey assess progress towards meeting your project objectivesThey are a type of performance indicator
12 Output indicators, example Drop in sessions for staff and the public to meet the senior executive and estates manager in the organisationOutput indicators:Number of drop in sessionsNumber of people attendingTypes of drop in sessionsProfile of people attending
13 Outcomes are linked to the specific aims What are outcomes?Outcomes are linked to the specific aimsOutcomes are the changes, benefits, learning or other effects that actually occur as a result of your activities. They can be expected or unexpected, positive or negative.
14 Outcome indicators or measures are how you assess whether an expected outcome is occurring and assess progress towards meeting an aimImpact and outcome measurement is basically about the same thing, a change that results from the improvement actions takenOutcome indicators are a performance indicator and can be qualitative or quantitative
15 What indicators or measures could you use? Outcome exampleSpecific aim: To improve the cascading of information regarding the new-build across the organisation and in the local communityOutcomes:Increased knowledge of the new-build programmeIncreased marketing of the organisationIncreased confidence and reputationWhat indicators or measures could you use?
16 Monitoring outputs and outcomes Use the indicators for monitoringCollate information on your output indicators to show outputs have been delivered and to show progress towards meeting targets.Collect information on your outcome indicators to demonstrate that outcomes are achieved.Collect baseline information before you start, in order to measure the impact of your improvement actions