1. Quantitative/qualitative indicators & critical analysis of data
Session 12
Indicators (III)
Quantitative/qualitative indicators & critical analysis of data

2. Quantitative and qualitative indicators

3. Quantitative & qualitative indicators
assessment by a jury during a competition (e.g. score given)
ranking by people based on their opinions, perceptions etc.
parents' opinion on the possibility of their children attending a primary school class with a qualified and experienced teacher.
number of qualified and experienced teachers
cost per pupil
number of qualified and experienced teachers per 1,000 children of primary-school age.
QUALITATIVE INDICATORS
Information produced through a qualitative method (opinion based). It is not based on a measure using a standardized instrument.
QUANTITATIVE INDICATORS
Fact-based information using a counting process (elementary indicator) or can be computed using elementary indicators (ratios, rates, i.e. derived indicators)

4. Qualitative indicators are useful
Qualitative indicators are as useful as quantitative ones
Reflecting the opinion of stakeholders provides key info on whether the change process is taking place (or not)
Diverse and disaggregated qualitative information helps highlight the diversity of perceptions about an action
Allow cross-checking with the opinions/perceptions of different stakeholders
Can facilitate a participatory approach to measurement

5. Exercise| Balancing quantitative and qualitative indicators
exercicse
Exercise| Balancing quantitative and qualitative indicators
Using examples and in discussion with 1 or 2 colleagues, think about how we could:
Make a quantitative indicator more qualitative?
Make a qualitative indicator more quantitative?
Activity– small group discussion followed by a plenary discussion

6. Comparison methods & critical analysis of data

7. With indicators we can compare…
The baseline situation vs. actual situation
Actual vs. planned
Trends over time and comparisons between periods
Geographical variability
Variability between groups
Standards and benchmarks
For more info on comparability see chapter 2.4 of the guide on « Performance measurement… »

8. Activity | Indicators and comparison
exercicse
Activity | Indicators and comparison
Three main methods of comparison to assess the added value of an action
Before / after (6 months, 1 year of) the action based on observation of the actual situation and the initial situation
With / without the action based on a scenario/model
With / without the action based on observation of a control group and the target group
Each method has its advantages and disadvantages. Take a real example to identify the respective pros & cons. Summarize in a table (+/-).
Activity – 3 groups

9. Interpreting data
Indicators and resulting data/information help tell us what is happening, but not necessarily why
A project may not be achieving objectives and targets for a variety of reasons, including:
Weak understanding of the pathway of change
Unrealistic initial objectives/targets
Constraints outside of the project’s control; or
Poor project management
Reasons need to be understood if appropriate corrective action is to be taken
Data users… Look for the « reason why »!

10. Figures have a mathematical dimension which creates the illusion that they are scientific facts … Keep thinking !
Data analysis
Data needs to be analysed to turn it into useful management information
Some actions generate data that lends itself to some quantitative analysis – others do not
Data used for monitoring/assessing performance should always be treated with caution and analysed before drawing conclusions
Operational Managers can
provide ideas/advice to implementing partners to improve their analysis
contribute their own opinions on what data may be indicating about project performance