Systems/Methodologies for Monitoring and Evaluation of National Food Security Mission by National Productivity Council
Consultancy to NPC Strengthening Monitoring and Evaluation of NFSM –Setting up monitoring systems to cover the entire project cycle of the Mission –Develop templates in conducting concurrent and other evaluations –Designing dynamic methods for ease of use at various levels for sustainability
Report Formats Monitoring Formats Concurrent Evaluation Mid-term Evaluation Performance assessment for awards Record Formats LFA matrix Planning Implementatio n MonitoringEvaluationNFSM TASKS ASSIGNED TO NPC UNDER NFSM contd.
Analysis and appraisal of:- Quarterly physical and financial progress reports (QPRs); Annual physical and financial progress reports (APRs); PMT tour reports; CDD’s tour reports; NLMT reports; and Concurrent evaluation reports. Preparation of league tables of the NFSM districts for categorizing/quantifying district performance for State/National level awards. Preparation of impact evaluation report based on secondary data. Continuous activities
LFA based PPM Objectively Verifiable Indicators Means of Verification Records Concurrent Evaluation Impact Evaluation Mid-term Evaluation Terminal Evaluation PlanningPlanning Implementatio n EvaluationEvaluation Performance Recognition NFSM Awards MonitoringMonitoring Reporting & monitoring Process specific interrelation of documents of NFSM
A modern tool used in planning, monitoring and evaluation of development projects. Provides insight towards project aims and aspects upon which success depends. A handy summary to inform project staff, benefactor, beneficiaries and stakeholders throughout the lifecycle of the project. Better supervision based on intended outcomes rather than intended expenditure. Key Concepts - Logical Framework Approach
Key Concepts - Logical Framework Approach contd.. Identification of the Objectively Verifiable Indicators (OVIs) and Means of Verification (MOVs) at goal, purpose & activity levels; Reckoning of external factors and the risks; and Keeping track on the mission activities.
Levels of formats for record keeping Panchayat level District level State level Level of formats for progress reporting District level State level
State Level Quarter, component & Intervention specific physical & financial progress Reporting Structure under NFSM National Level Panchayat Level Beneficiary, Component & Intervention specific records District Level Quarter, component & Intervention specific physical & financial progress QPRs/ APRs QPRs/ APRs
Level of formats for monitoring reports National Level: NALMOT National Consultant /PMT CDDs State Level: SLMT State Consultant /PMT District Level: DLMT District Consultant Baseline survey
Monitoring Structure under NFSM at National Level NALMOTNational PMT National Consultants StateDistrict Panchayat Level Vill-1: (B1, B2)Vill-2: (B1, B2)Vill-3: (B1, B2)
Monitoring Structure under NFSM at State Level SLMTState PMT State Consultants District-1District-2 Panchayat Vill-1: (B1, B2)Vill-2: (B1, B2)Vill-3: (B1, B2) Panchayat
Monitoring Structure under NFSM at District Level DLMT District PMT District Consultants Panchayat-1Panchayat-2 Vill-2: (B1, B2) Vill-1: (B1, B2) Vill-2: (B1, B2) Vill:-1 (B1, B2)
Key features of formats for records, reports & monitoring Standardization - devoid of duplicity Empowering with information across the levels Uniformity Precision in data capturing Interoperability across the program Easy to fill, maintain & report Adequate checks & balances Data Integrity True projection of performance Ensuring credibility & wider acceptance of the output IT enabled
Handbook on concurrent evaluation Key concepts: Understanding of concept Uniformity in methodology Comprehension of process related bottlenecks, difficulty and problems Timely mid-course correction Sharing of best practices related to processes rather than results Understanding of concept Uniformity in methodology Comprehension of process related bottlenecks, difficulty and problems Timely mid-course correction Sharing of best practices related to processes rather than results
Formats devised for concurrent evaluation by states Collection of information from State NFSM Agency Season/Intervention wise updated physical & financial Progress Report of NFSM Rice Season/Intervention wise updated physical & financial Progress Report of NFSM Wheat Season/Intervention wise updated physical & financial Progress Report of NFSM Pulses Collection of information from District NFSM Agency. Beneficiary specific common observation sheet for all the interventions Intervention specific observation Sheet for Beneficiary-FFS Intervention specific observation Sheet for Beneficiary- Demonstration Intervention specific observation Sheet for Beneficiary-Seed Distribution Intervention specific observation Sheet for Beneficiary-Seed Minikit Intervention specific observation Sheet for Beneficiary-INM & Soil Ameliorants Intervention specific observation Sheet for Beneficiary-Farm Mechanization Intervention specific observation Sheet for Beneficiary-IPM Intervention specific observation Sheet for Beneficiary-Pilot Project & Local Initiatives Non-beneficiary Specific observation Sheet Report Structure
State Level District Level PRI level BeneficiaryBeneficiary Non-beneficiary level Concurrent Evaluation Report Study flow chart - Concurrent Evaluation
Methodology on performance assessment of districts for State/National level awards Awards’ parameters Outcome based parameters: Performance will be assessed in relation to baseline data. Intervention related parameters: Performance will be assessed in relation to achievements against the targets. In case of the interventions for which baseline data is available, performance will be assessed in relation to baseline data. Process oriented parameters : Performance will be assessed based on documentary evidence relating to activities envisaged vis-à-vis carried out.
NFSM Award Scheme – Key concepts Quantifiable parameters Objective assessment of relative performance Transparency in assessment Recognition of merit Sharing of best practices Enhancement of acceptability & ownership
Way forward Circulation of the documents to the stakeholders Comprehension workshops of master trainers on documentation at regional level for devising training curriculum in 1 st week of January, 2010 Organization of training for field staff on documentation at SAMETI level during 2 nd fortnight of January, 2010 Translation of documents in the regional languages for internalization across levels in the states w.e.f. 1 st April, 2010 Review workshops on documents at SAMETI level in November, 2010 Review workshops on documents at regional level in December, 2010 Modification of documents, if any, for continuous adoption.