Measuring the Performance and Impact of Community Indicator Systems: Key Performance Indicators and Evaluation Charles Thrift & Bobbie Macdonald February.

Slides:

Advertisements

Similar presentations

MAPP Process & Outcome Evaluation

Advertisements

1 EU Strategy for the Baltic Sea Region Evaluation: Setting Outcome Indicators and Targets Seminar: 15 March 2011, La Hulpe Veronica Gaffey Acting Director.

Introduction to Impact Assessment

International Housing Partnership Annual Conference 2012 – Vancouver Rob Young, Chief Executive, Helena Partnerships, UK Rob Webber, Acting Chief Executive,

Catalogue Energy Interventions Data and Information Needs Development and Energy in Africa First National Workshop September 1, 2005 ….innovating energy.

Donald T. Simeon Caribbean Health Research Council

AN INTRODUCTION TO SPHERE AND THE EMERGENCY CONTEXT

Communities First Mike Durke. Key Lessons 2002: Early days 2003: Deputy Minister Review 2006: Interim Evaluation 2008: ‘Communities Next’ 2009: Wales.

Project Monitoring Evaluation and Assessment

Lesson 2: Project: Evaluation, Monitoring, Auditing Macerata, 22 nd October Alessandro Valenza, Director, t33 srl.

Decision Making Tools for Strategic Planning 2014 Nonprofit Capacity Conference Margo Bailey, PhD April 21, 2014 Clarify your strategic plan hierarchy.

PERFORMANCE MANAGEMENT HOW TO GET THE MOST OUT OF THE PROCESS Tuesday 2nd September pm.

Program Performance Reporting and Evaluation in Australia Mark Nizette Department of Finance and Administration October 2001.

Pestalozzi Children‘s Foundation emPower 2012 Monitoring & Evaluation Lecturers: Beatrice Schulter.

Performance Management Upul Abeyrathne, Dept. of Economics, University of Ruhuna, Matara.

CSR and Business Performance KPIs Claus Aabling Advisor, Business Development and CSR.

CDC Evaluation Process Harlen Hays, MPH Office of Health Promotion, KDHE.

Macquarie University Library1 LAMS, e-learning & Information Literacy: possibilities & practicalities Margaret Wright, Macquarie University Heather Cooper,

August 23, 2015 Education Bradford Curricular Targets Georgina Graham and Jonathan Nixon ISP Consultants, Education Bradford.

Monitoring Evaluation Impact Assessment Objectives Be able to n explain basic monitoring and evaluation theory in relation to accountability n Identify.

ISTEP: Technology Field Research in Developing Communities Instructor: M. Bernardine Dias CAs: Sarah Belousov and Ermine Teves Spring 2009.

Introduction A GENERAL OVERVIEW OF THE WCD FINDINGS, RECOMMENDATIONS & APPLICATION Alex Muhweezi & Chihenyo Mvoyi IUCN Uganda Country Office.

LEARNING WALKS How we can share good practice and learn from one another.

Performance Measurement and Analysis for Health Organizations

Supporting voluntary and community action supporting voluntary and community action Measuring Outcomes How do we understand the changes we are making …

SEISMIC Whole School and PLC Planning Day Tuesday, August 13th, 2013.

Foundations of Planning

Lesson 2: Project: Evaluation, Monitoring, Auditing Macerata, 22 nd October Alessandro Valenza, Director, t33 srl.

Structure of the HFA2 Input Paper. Outline Introduction and Rationale Process of consultation in the Asia Pacific region Synthesis of the AP experience.

Rwanda MCC Threshold Program CIVIL SOCIETY STRENGTHENING PROJECT Cross-Cutting Advocacy Issues Data Collection Monitoring and Evaluation.

QUALITY STANDARDS IN CAREER DEVELOPMENT SERVICES A Canadian Snapshot and an International Perspective CDSWG Report: 2010.

IAOD Evaluation Seminar “Demystifying Evaluation in WIPO- Best Practices from Initial Evaluations” Geneva November, Evaluation Section Internal.

Understanding monitoring and evaluation FACTSHEET 8 Food and Garden Organics Best Practice Collection Manual.

Evaluation. HPS is a “change” process that takes place within a school community A key consideration is that the change needs to be sustainable.

Project Management Learning Program 7-18 May 2012, Mekong Institute, Khon Kaen, Thailand Writing Project Report Multi-Purpose Reporting.

Forest Carbon Partnership Facility Overview of the R-Package Kenn Rapp, Facility Management Team Asia-Pacific Indigenous Peoples Dialogue of the FCPF Chiang.

Advice on Data Used to Measure Outcomes Friday 20 th March 2009.

M & E TOOLKIT Jennifer Bogle 11 November 2014 Household Water Treatment and Water Safety Plans International and Regional Landscape.

INTEGRATED ASSESSMENT AND PLANNING FOR SUSTAINABLE DEVELOPMENT 1 Click to edit Master title style 1 Evaluation and Review of Experience from UNEP Projects.

Monitoring & Evaluation

Support the spread of “good practice” in generating, managing, analysing and communicating spatial information Evaluating and Reflecting on the Map-making.

District Accreditation Completing the Standards Assessment Report July 20, 2010.

EVALUATION OF THE SEE SARMa Project. Content Project management structure Internal evaluation External evaluation Evaluation report.

Governance Orientation. Governance Model 1 Principles maintain future orientation and outcomes focus Board representing the ownership capture decisions.

Community Planning: Monitoring & Evaluation Geddes Institute Research The Geddes Institute Emma Coles.

Continual Service Improvement Methods & Techniques.

Developing Monitoring & Evaluation Frameworks: Process or Product? Anne Markiewicz.

June 12, 2004 Resource Planning CAUBO Meeting. June 12, 2004 Questions we want answered? How much investment will take us to where we want to be? How.

Thepul Ginige Lecture-7 Evaluation Approaches of Information System Thepul Ginige.

Defining Key Performance Indicators Learning from international practices Challenges for the UI scheme in Viet Nam By Celine Peyron Bista, 13 December.

IMPLEMENTING LEAPS IN CENTRAL AND EASTERN EUROPE: TRAINERS’ HANDBOOK Monitoring and Evaluating Results.

Module 9 Monitoring and Evaluation Tuesday, Oct 14, 2013 Ngo Thi Loan and John Carter.

Teacher Professional Learning and Development Presentation for PPTA Curriculum Workshops 2009.

Middle Managers Workshop 2: Measuring Progress. An opportunity for middle managers… Two linked workshops exploring what it means to implement the Act.

ICT4D: Evaluation Dr David Hollow DSV, University of Stockholm.

Alice Pedretti, Project Manager Effective management of complaints for companies Lessons learned from the Management of Complaints Assessment Tool Amsterdam,

Selection Criteria and Invitational Priorities School Leadership Program U.S. Department of Education 2005.

Supporting community action on AIDS in developing countries ‘Evaluating HIV and AIDS-related advocacy’ Skills Building Session International.

Principles of planning

Session VII: Formulation of Monitoring and Evaluation Plan

Programme Board 6th Meeting May 2017 Craig Larlee

Continuous Improvement through Accreditation AdvancED ESA Accreditation MAISA Conference January 27, 2016.

School Self-Evaluation

Business Environment Dr. Aravind Banakar –

Business Environment Dr. Aravind Banakar –

Business Environment

Business Environment

Business Environment

Business Environment

Monitoring and Evaluation in Communication Management

Presentation transcript:

Measuring the Performance and Impact of Community Indicator Systems: Key Performance Indicators and Evaluation Charles Thrift & Bobbie Macdonald February 17, 2011

Outline 1. Introduction 2. Why Evaluation and KPIs? 3. Peg evaluation framework 4. Challenges & lessons learned 5. Discussion & Next steps

Introduction Purpose: 1. To demonstrate the value of KPIs 2. To present the Peg evaluation framework 3. To elicit feedback and discussion on KPIs Key Performance Indicators (KPIs) are quantitative or qualitative measures that assess the performance, progress, and impact of a project, program, or organization.

Introduction Program/Project Evaluation is a formal approach to assessing progress, performance, and impact. KPIs provide data and information on which to base findings and conclusions. “ Action without reflection is wrongheaded; reflection without action is self-indulgent. ” - Nancy Scheper- Hughes, Death Without Weeping, p. 171

Why Evaluate a CIS? to assess CIS outcomes or impacts to assess whether CIS objectives are being met to find out how CIS is operating to understand who is using CIS and how to find out how well users’ needs are being met to improve the CIS (to better meet community needs, better manage the initiative or make it more sustainable) to understand why CIS or elements of CIS do or do not work

Why use Key Performance Indicators? Reduce the number of decisions that are based solely on instinct and make decisions based on objectivity and facts. Quantify the achievement of goals by setting, monitoring and measuring against a standard or target. As your CIS grows it becomes more difficult to remain as close to the operational details as you once were. Allows you to focus on facts and see where you need to improve.

Peg evaluation framework Process: 1. Develop long list of KPIs 2. Develop evaluation framework for Peg 3. Select KPIs directly relevant to Peg

1. Develop list of KPIs: Legwork: indicator system contributions + brainstorming = 133 KPIs 115 Quantitative, 18 Qualitative indicators +=

2. Develop evaluation framework for Peg Inputs - resources required to undertake project activities Receiving - persons receiving our information Seeking - persons seeking information related to our work Engaging - joint efforts to foster change Using - persons using our framework or information for other purposes Observed Change - actual change in policies and indicators

3. Select KPIs directly relevant to Peg 54 Selected: 48 Quantitative, 6 Qualitative Exit

Challenges 1. Finding KPIs relevant to community indicator systems current list not exhaustive 2. Deciding which KPIs to use choosing too few vs choosing too many internal vs external indicators

Lessons Learned 1. Existence of an evaluation and KPI gap in community indicator systems. 2. High value for labour ratio

Next steps 1. Extend KPI list to make it exhaustive. e.g. environmental sustainability KPIs, more qualitative KPIs, Create dialogue to generate participation, buy-in, and uptake. 3. For Peg, take selected KPIs to internal groups.

Discussion 1. Is there value in using KPIs for community indicator systems? 2. How do we move forward with the momentum we’ve built? 3. How are you using KPIs now?

Charles Thrift Project Officer, Measurement & Assessment, IISD Bobbie Macdonald Research Student, Measurement & Assessment, IISD Comments/Questions? Peg: