Presentation on theme: "1 A proposed approach to developing indicators Use the Strategic Targets document as the basis –Recent; explicitly addresses outcomes; relatively concise."— Presentation transcript:
1 A proposed approach to developing indicators Use the Strategic Targets document as the basis –Recent; explicitly addresses outcomes; relatively concise Steps: 1.Categorize all outcome statements in terms of their measurability in principle. 2.Brainstorm potential indicators for each outcome considered measurable in principle. 3.Assess lists of potential indicators against a set of criteria to focus on strongest candidates. 4.Seek information from others to test feasibility. 5.Proposal to ExCom (test relevance). 6.Develop a measurement strategy.
2 Step 1: Possible categories A: Likely measurable; can readily think of potential indicators. B: Possibly measurable; outcome is not entirely clear or there are questions that need to be answered before measurability can be decided. C: Determinable but not measurable; it is possible to determine objectively though qualitatively whether the outcome has been met, but it does not readily support quantification. C1:Not measurable but examples of progress may be identified. D: Not measurable; difficult to see how the outcome could be measured, even in principle. E: Not an outcome.
3 Step 3: Possible criteria for assessing/ranking indicators Validity – does the indicator really measure what it purports to measure? Feasibility – will measurement data for this indicator be technically and practically possible to obtain? Objectivity – is the indicator based on data collected by an independent source and/or using methods that are potentially verifiable? Value for money – is the cost of measuring the indicator reasonable in the context of the information it provides? Relevance – is the information relevant to decisions that may be taken? Comparability – will the measurements yield meaningful comparisons (e.g. time periods, geographic regions)? Clarity – will the meaning of the indicator value and trends be readily understood by its intended audience?
4 Step 6: Contents of a measurement strategy Description of the performance indicators Data sources Definitions and methodology Known limitations of the indicator Data collection responsibility Frequency of data collection Reporting methods and frequency Target level and date to achieve target Baseline level and date of baseline measurement