1. Results Based Management for Monitoring & Evaluation
Abid Razaq, Omer Awan, Unber Khan

2. AT end of this session participants will be able to understand
Monitoring & Evaluation
What is Results-Based Management (RBM)?
Key Principles of RBM
Why is Results-Based Management necessary?
What is a Result?
Results Chain
Results Framework
M&E Process of NDRMF
Reporting Requirements of NDRMF
M&E Requirements for Proposal Submission

3. Key Concepts (Have you heard about!)
PCM
Monitoring
Evaluation
Log frame
M&E Plan
M&E Toolkit
FGDs
Indicators
Risks & Assumptions
Mitigation Measures
Theory of change (TOC)

4. What is Monitoring & Evaluation?
Measuring Performance.
Checking results (Nos, %)
Validating Standards (Engineering Designs)
Drawings/ BOQs/ SOPs
What about Indicators? Targets? Baselines-End-lines?
% of population become resilient against the exposed disaster?
No of Bunds/ Culverts/ Infrastructure rehabilitated?

5. Operational definition of Monitoring is...

6. Monitoring Cont…..

7. Parts of the M&E System

8. M&E Data Collection PROCESSES
Monitoring Activities
Baselines
Annual Reviews
Mid-Term Reviews
End-Term Evaluations
Ex-post Evaluations

9. A Functional M&E System Require..

10. M&E TOOLs! Project Log frame/ Result Framework
Monitoring & Evaluation Plan
Risk Management Plan
DIP/ Work plan
Standard Operating Procedures (SOPs)/ Activities Guidelines.
Baselines/ Midterm Reviews
Primary/ Secondary Data/ Statistical Data
Reporting
Words must have Evidences ( Pictures, Videos etc).

11. Culture of Results-Based Management?
RBM is a management approach aimed to improve management effectiveness and accountability in achieving results.
RBM is focused on results chain: output, outcomes, and impact.

12. RBM Cycle:

13. Key principles of RBM
Define expected results first and activities later
Foster the active participation of stakeholders
Ensure that all stakeholders work towards achieving expected results
Apprise your work critically and learn the lessons

14. What is Result

15. Results Chain

16. Results Chain

17. Why Results-Based Management
Improved focus on results instead of activities
Improved transparency
Improved accountability
Enhanced performance orientation
Improved measurement of achievements
Enhanced strategic focus
No choice, it is a standard

18. Logic Model: Pakistan (2017) Intermediate Outcomes
Example of RBM
Logic Model: Pakistan (2017)
Goal
Vulnerable farming communities in Mirpurkhas, including women, exercise their right to access and control water resources and benefit from the sustainable use and management of water for agriculture
Activities
Outputs
Immediate outcomes
Intermediate Outcomes
Long term Outcome
: Rehabilitate critically damaged distributaries and water courses
: Distributaries and water courses rehabilitated
:Improved irrigation infrastructure
2.1.1: Increased access of water for agriculture among men and women farmers
2.1: Vulnerable farming communities, including women, benefit from the sustainable use and management of water for sustainable agriculture
: Construct/rehabilitate disposal points, culverts, storage tanks and washing facilities to ensure safe access and management of water during monsoon season
: Disposal points, culverts, storage tanks and washing facilities constructed/rehabilitated to ensure safe access and management of water during monsoon season
: Train Farmer Organisations and Water Course Associations on water management and maintenance of irrigation infrastructure
: Farmer Organisations and Water Course Associations trained on water management and maintenance of irrigation infrastructure
: Improved management of water infrastructure
: Provide training and support to male and female farmers on adopting sustainable agricultural practices
: Male and female farmers trained on sustainable agriculture and supported to adopt sustainable agricultural practices.
: Farmers have increased knowledge and resources to implement sustainable agricultural practices.
2.1.2: Male and female farmers are adopting sustainable agricultural practices which increase their resilience and are actively implementing disaster management plans
: Provide farming equipment which supports sustainable agriculture
: Farming equipment which supports sustainable agriculture is distributed
: Establish information kiosks on sustainable agriculture
: Information kiosks established
: Provide training to agriculture and irrigation extension staff on sustainable agricultural practices and support for the promotion of same
: Agriculture and irrigation extension staff trained on sustainable agricultural practices and supported to promote them
: Agriculture and irrigation extension workers have increased knowledge and resources to implement sustainable agricultural practices.
: Provide training and support to male and female farmers in community-based disaster management planning
: Male and female farmers trained on community-based disaster management planning
: Communities have developed disaster management plans

19. Evaluation

20. Two Types of Evaluation
An act of collecting, analyzing, and interpreting data at the project start up to determine the initial values of outcome indicators and during the project implementation to determine initial project responses of the target population is called formative evaluation.
An act of collecting, analyzing, and interpreting data after the project implementation ends to determine the final project effects on or responses of the target population is called summative evaluation.

21. Example of Evaluation Types
Formative Evaluation
Summative Evaluation
Baseline studies or surveys
Annual project reviews
Mid-term reviews (MTRs)
Result/Outcome monitoring
End-term evaluations (ETEs)
End-line studies or surveys
End-of-project evaluations
Final evaluations
Ex-post evaluations

22. What is Evaluation cont..
DAC Criteria.
Efficiency, Effectiveness, Coverage, Impact, Sustainability.
Learnings
Best Practices
Challenges?
Cost effective ratio?
More sustainable models?

23. M&E Process of NDRMF
NDRMF Monitoring and Evaluation framework follows the simplified log-frame and results-based model for the implementation and administration of interventions / projects.
NDRMF Results Framework is finalized on the basis of:
Project Administration Manual of ADB
National Disaster Management Plan
National Flood Protection Plan-IV
NDRMF Results Framework covers major outcome along with key outputs and relevant sub-outputs with performance indicators

24. M&E Process of NDRMF Performance Indicators
FIPs must select relevant indicators from NDRMF Results Framework
Customized Indicators will be mutually agreed
Baseline & Target
Means of Verification
Indicators Monitoring Framework
Sr #
Indicator
Type
Definition
Unit of Measure
Data Source
Data Collection Method
Frequency / Timing
Segregation (Gender / Geographic)
Responsibility (Org / Person)

25. M&E Process of NDRMF Field Visits Data Quality Assessments (DQA)
Field visits serve the purpose of validation. They validate the results reported by grants and projects.
Data Quality Assessments (DQA)
Reported Data will be verified by checking where it originated from, who was responsible for its collection and the methods and standards used to collect it.
Third-Party Evaluations / Verifications
to verify and evaluate program achievements – claimed in progress reports

26. Reporting
“When performance is measured, performance improves. When performance is measured and reported back, the rate of improvement accelerates” (Pearson's law)

27. Reporting Requirements of NDRMF
Standardized Reporting Formats & Tools developed
Quarterly Progress Report (QPR)
Within 5 Days after ending of a calendar quarter
Semi-Annual Environmental and Social Management System (ESMS) Report
Within 5 Days after every alternate quarter along with QPR
Annual Progress Report (APR)
Within 5 Days every calendar year
Completion report
Within 45 Days after project end

28. Reporting Requirements of NDRMF
RAG Report for Implementation / Work Plan

29. Automated M&E System Systematically manage and monitor the progress
Real-time and rigorous data collection
Allow stakeholders to get tailored access to the data, analysis and reports
Enable online entry, collection, intelligent analysis, and efficient reporting of real-time activity based data
Measure project / programme results (especially outputs and outcome) indicators against targets, milestones etc
Track progress of Implementation Plan / Work Plan

30. M&E Requirements for Proposal Submission
Results Framework
Results
Performance Indicators
Means of Verifications
Risks / Assumptions
Baselines
Targets
Outcome
Outputs 1.
1a.
1b.
1c. 2.
2a.
2b.
2c.

31. M&E Requirements for Proposal Submission
Monitoring table
Indicators
Indicator Definition/Unit
Data Collection method/sources
Frequency of Monitoring
Outcome
Output1
Output 2

32. M&E Requirements for Proposal Submission
M&E plan narrative
How will the performance of the project be tracked in terms of achievement of the milestones set forth in the results framework?
How will the impact of the project be assessed in terms of achieving the project's objectives?
How will the mid-term assessment and related adjustment of the project design and plans be managed?
How will the inclusiveness of stakeholders/community members (including Gender, Vulnerable groups) in the project M&E processes be achieved?

33. Thanks