1. The Baseline, Value Model of Evaluation …. and how it applies to Workplace LLN* Paul Kearns Director PWL Author “Evaluating the ROI from Learning” (CIPD 2005) www.paulkearns.co.uk *Please note that the contents of this presentation may be reproduced on the condition that the source is fully acknowledged. www.paulkearns.co.uk

2. 'the ability to read, write and speak in English and to use mathematics at a level necessary to function at work and in society in general.' http://www.dfes.gov.uk/curriculum_literacy/intro/ns/ The National Standards for Adult Literacy and Numeracy

3. Why all the fuss about evaluation? Is there a simple theory and practice for evaluation? Yes. Is evaluation easy in practice? It depends. Does the evaluation process add value? Yes! Is evaluation very important? Yes!

4. PRIORITY 1 Validate Basic education Minimum standards/ Compliance with legislation Language? Literacy? Numeracy? Performance improvement arising from:- More Knowledge Better skills Applied learning Not sure why we’re doing this but it sounds like a good idea The 3 Box System – Where does LLN sit? PRIORITY 3 Shift PRIORITY 2 Evaluate & ROI (£’s) BOX 1 ‘Must have’ BOX 3 ‘Nice to have’ BOX 2 ‘Added value’

5. Is the learning being applied at work? Measuring what was learned (testing) Reactions to the training Level 1 - Validation Baseline level Level 2 - Validation Level 3 - Validation What value did the training add (£’s ROI)? Level 4 - Evaluation Existing performance measures? Potential value add from training(£’s)? Baseline Kirkpatrick Evaluation Model

6. ROI = GROSS BENEFIT - COST COST X 100% ROI = £3.7M - £1.4M £1.4M ROI = £2.3M £1.4M ROI = 1.64 Eg. The business case for LLN? Using Return on Investment (ROI) X 100% ROI = 164% in 1 year X 100% £2.3M

7. No. of employees Performance UNACCEPTABLE ACCEPTABLE SUPERIOR 1 2 3 4 5 6 7 8 9 10 Shifting the Performance Curve through LLN LLN?

8. The learning and improvement cycle PLANNING TO LEARN/IMPROVE LEARNING/DOING CHECKING (EVALUATING) ACTING (REVIEWING) MEASURE What measures are we trying to improve? e.g. LLN Training Did the action achieve the planned improvement? Should we do anything different?