Measuring Impact – Making a Difference Carol Candler – NRF Graeme Oram – Five Lamps.

Slides:



Advertisements
Similar presentations
Template: Making Effective Presentation about Your Evidence-based Health Promotion Program This template is intended for you to adapt to your own program.
Advertisements

HELPING THE NATION SPEND WISELY Performance audit and evaluation: common ground with Internal Audit ? The UK National Audit Office experience Jeremy Lonsdale.
X4L Prog Mtg – March 05 Evaluation – What works best - when and why? Prof Mark Stiles Project Director: SURF X4L, SURF WBL, SUNIWE and ICIER Projects Head.
Outputs, outcomes and impacts Using Theory of Change to plan, develop and evaluate your initiative.
Measuring The Difference Social Return On Investment Adrian Dewhurst.
Measuring Impact Through Social Return On Investment (SROI)
Evaluating and Measuring Impact Presented by – Date –
Being The Best We Can A self-evaluation and improvement process for libraries Melanie McCarten State Library of Victoria Euan Lockie ACIG.
Tired of hanging around Evaluating projects with young people.
Evaluating Social Prescribing: Towards an Understanding of Social and Economic Impact Presentation to BVSC Conference 9 th July 2014 Chris Dayson Research.
Writing a Grant Application in 10 Steps Museum Development Network 20 Nov 2013.
Evaluation of Wellbeing 2 Quick update for grant holders Nicki Smith / Sarah Jenkins Ecorys UK #wellbeing.
Reaching Out - Empowering Young People Agenda 2.15 pm Introduction Overview of Reaching Out: Empowering Young People Overview of other Big Lottery Fund.
1 Unlocking Impact: The Five Key Questions Malen Davies RNIB Research Officer (Impact) 9 September 2014.
Monitoring and evaluation of carers’ services and projects Dr Andrea Wigfield - Associate Professor of Social Policy Centre for International Research.
Project Monitoring Evaluation and Assessment
Using your data to make your project better Ceris Anderson - StreetGames.
RBM in the context of Operations and Programme and Project Management Material of the Technical Assistance Unit (TAU)
Social Impact Measurement What gets measured gets managed
Challenge Questions How well do we meet the need of our stakeholders?
Identifying a Research Problem
Challenge Questions How good is our operational management?
ActionAid Value for Money Pilot Update May Origins of the VFM Pilot -Measuring cost effectiveness approved in September 2010 as part of the new.
A New Tool to Describe the Power of Our Work. Funding Provided by: City of Edmonton In Kind Contributions: City of Edmonton Edmonton Social Planning Council.
1 Qualitative Evaluation Terms Coding/categorization The process of condensing qualitative data through the identification of common themes. Data Matrix.
Monitoring Evaluation Impact Assessment Objectives Be able to n explain basic monitoring and evaluation theory in relation to accountability n Identify.
Scottish Government funded Projects: Monitoring, Evaluation and Learning (MEL) … and reporting 4 September 2013.
ISTEP: Technology Field Research in Developing Communities Instructor: M. Bernardine Dias CAs: Sarah Belousov and Ermine Teves Spring 2009.
1 Module 4: Designing Performance Indicators for Environmental Compliance and Enforcement Programs.
X AXIS LOWER LIMIT UPPER LIMIT CHART TOP Y AXIS LIMIT v MEASURING IMPACT: USING QUANTITATIVE RESEARCH Eibhlín Ní Ógáin London, November 2012 NPC - title.
Measuring your Impact & Outcomes How you know you are making a difference Jill Davies – South Hams CVS.
Supporting voluntary and community action supporting voluntary and community action Measuring Outcomes How do we understand the changes we are making …
Contribution Analysis: An introduction Anita Morrison Scottish Government.
How can we evaluate the impact of supported employment and help make a better business case To demonstrate impact we need to measure the social value created.
EVALUATION APPROACHES Heather Aquilina 24 March 2015.
Value for Money “ Good value for money is the optimal use of resources to achieve the intended outcome.” UK’s National Audit Office... or making better.
Assessment/Evaluation 1) Determine Desired Outcomes 2) Determine Activities to achieve outcome 3) Determine Indicators to measure whether you are making.
Workforce matters How to workforce plan to support
Making an impact: making impact measurement work for you Chris Dayson, Sarah Pearson and Peter Wells 15 November 2012.
Evaluating and measuring impact in career development: extension workshop Presented by – Date – Just to identify strengths and areas to improve are no.
Donor perspectives on planning and evaluation Janice Astbury The J.W. McConnell Family Foundation.
Slide 1 The Young Foundation 2010 Making the difference – why measurement matters in work with young people Gemma Rocyn Jones The Young Foundation NYCI.
Nef (the new economics foundation) Sustainable Commissioning NAVCA Susan Steed nef (the new economics foundation)
Alain Thomas Overview workshop Background to the Principles Definitions The National Principles for Public Engagement What.
Social Return on Investment (SROI) and the SROI Network An introduction…
Hosted by: Funded by: The ambitions and challenges of SROI Domenico Moro Third Sector Research Centre University of Birmingham.
Transforming Patient Experience: The essential guide
Social Impact – What Works NEFF 7 September 2011 Carol Candler NRF.
Click to edit Master subtitle style How to start measuring your organisation’s social impact Paul Henry Inspire2Enterprise.
© nef consulting Value for Money (VfM) in international development: useful elements of Social Return on Investment (SROI) Michael Weatherhead nef consulting.
Kathy Corbiere Service Delivery and Performance Commission
1 The project is financed from the European Union funds within the framework of Erasmus+, Key Action 2: Cooperation for innovation and the exchange of.
Measuring Real Value: A DIY guide to social return on investment Lisa Sanfilippo Q & A with Eilís Lawlor and Richard Murray.
Jane Holdsworth 20 January The terminology of outcomes and impact How to evidence outcomes and impact Methods for collecting evidence Sources of.
Evaluating Engagement Judging the outcome above the noise of squeaky wheels Heather Shaw, Department of Sustainability & Environment Jessica Dart, Clear.
© EIPA – Robin Smail / Ex-ante Project Appraisal & project selection 1 Robin Smail Senior Lecturer CoR / DG Regio Open Days 28 September 2004 Steps for.
Being The Best We Can A self-evaluation & improvement process for libraries Key results for Victoria’s public library services.
Anne Lythgoe April What I want to do… Agree the scope of ‘social value’ Discuss why social value is important to commissioners of services and how.
Funders typically looking for applications to demonstrate: Evidence of need for what you are proposing, and why your project is the right approach to meeting.
Chapter 1 Toward Accountability. The Faces of Accountability Professional Accountability.Service Delivery Accountability.Coverage Accountability.Cultural.
Assessment/Evaluation Make evaluation a central part of planning – not an afterthought 1) Determine Needs 2) Determine Desired Outcomes 3) Determine Activities.
PROGRAM EVALUATION A TOOL FOR LEARNING AND CHANGE.
Applied Methodologies in PHI Session 5: Evaluation Kath Roberts (NOO/EMPHO)
How to show your social value – reporting outcomes & impact
Assessing the impacts of your grants: what and how to measure
Gathering a credible evidence base
Resource 1. Evaluation Planning Template
A Focus on Outcomes and Impact
Social Impact Workshop
Quality Framework Overview
Presentation transcript:

Measuring Impact – Making a Difference Carol Candler – NRF Graeme Oram – Five Lamps

Welcome (back)

Outline What is Impact and why focusing on (social) impact matters Which approach –what to think about in choosing your approach –Some approaches Impact Measurement in practice – the Five Lamps experience Help and resources

Why we are all here Organisations – support for people to address social problems Foundations / Grant Makers / Funders – support for organisations that work with people to address with social problems Aim – to make a difference

MAKING SENSE OF IMPACT Inputs OutputsOutcomesImpacts Assessment Spending / Funding effectively Making a difference to individuals Making a difference to problems / communities Organisations Monitoring/Feedback Evaluation Small MediumLarge Increasing: Size/Cost - Scope - Innovation - Risk Projects

How our projects work

Why measuring (social) impact matters To know weve made a difference To know what difference weve made To show what difference weve made (contribution not attribution!)

Measuring what matters Knowing what success looks like Choosing the right approach Asking the right questions Getting feedback from the right people Producing simple, meaningful information Using the information well

Exercise – What does success look like? Write down in one sentence what your organisation / project is trying to achieve In 2s discuss –how you know you are making progress towards this –who you are sharing this information with

Deciding on your approach Questions / approach Information / evidence Decisions / changes Who / what are you planning to influence or change? What do you want / need to give them? How to best collect / present the information? Funders Managers / Staff Decision makers Numbers Case studies Quotes On-going One-off Internal / external

One size fits all? Different needs (planning / proving / improving) Different capacity (size and scope of organisation) Different capability (experience / support) Different audiences (commissioners / foundations) Different focus (individuals / communities / policies)

Approaches - Qualitative (Soft Measures Feedback analysis (ad hoc / structured) Case studies Outcomes Tools (Stars / Radars) Progress scales (Cyrenians Matrix) Intermediate Outcomes Measures (CEI)

Approaches – Quantitative (Numbers) Surveys Proxy measures / Wider impact measures (NPC) On-line tools SROI (NEF) Case Controlled Trials (CCTs) Population statistics

Approaches - Mixed Using Outcomes stars / radars to generate progress data Mixed method reporting (Output numbers / outcomes and impact narrative / case studies) Social Audit / Social Accounting

Graemes slides

Resources (examples/information/resources) (information / tools) (social return on investment guide) (wellbeing measures)

Final thoughts So what difference are we making? Measure what matters Keep it clear and simple (fewer, better) (Social) Impact work that is useful and used