Module 8: Monitoring and Evaluation Gap Analysis and Intervention Plans

Learning Objectives Perform M&E gap analysis by identifying current NDOH M&E challenges Develop M&E intervention plan to begin implementing M&E best practices within NDOH HIV/AIDS programs Identify lessons learned during the course

M&E Challenges

Illustrative Resources to Meet Challenges Time! Capacity-building Technical quality and permanence of staff Stakeholder commitment and participation Collaborative exchange and dissemination of M&E results with partners and others Technical assistance where outsourcing is cost-effective

Desired Performance Actual Performance Gap Cause Analysis Intervention Implementation Evaluation Intervention Identification and Design Performance and Quality Improvement Model Model Adapted from the International Society for Performance Improvement

M&E Gap Analysis in NDOH Goal National implementation of best practices in M&E Key HIV/AIDS program indicator data are available in a timely manner on a routine basis Measurable Objectives Monthly summary report data from each facility matches totals calculated from logbooks Monthly summary data are submitted from facilities to sub-district or district by first week of following month Monthly summary data entered into DHIS Each facility receives a quarterly feedback report

Cause Analysis and Intervention Design Types of Causes Knowledge, Skills, Information Resources, Capacity Motivation Appropriate Interventions Incentives Strengthening of Management Systems, Provision of Resources Training, Communication

Intervention: Incentives How do we motivate: Nurses to collect and enter accurate client data into logbooks? Data capturers to enter data properly and on time? HIV/AIDS program managers to provide feedback to facilities?

Intervention: Strengthening of Management Systems, Provision of Resources How do we address M&E resource and capacity-building challenges? Clarify stakeholders’ M&E-related reporting requirements Put resources in place to assure data are available and analyzed correctly (staff, computers, supervision) Develop Data Quality Assessment guidance and implement routine data audits

Intervention: Training, Communication How do we address deficits in knowledge, skills and information? Facilitate meetings to gather information about and document M&E quality gaps (completeness, timeliness, accuracy, dissemination and use of data) Build fundamental M&E human capacity among program staff (M&E basics) Build advanced M&E human capacity among program staff Train staff in qualitative data collection methods

M&E Gap and Intervention Plan Desired Performance Actual Performance M&E GapCause Analysis InterventionResponsible Person(s) Deadline Data for each client are completely and accurately recorded in the VCT logbook There are missing data in the logbook VCT counselor and/or nurses are not recording complete and accurate data on all clients Lack of knowledge of utility of data recorded and its use Train VCT counselors and nurses on VCT indicator calculation, data presentation and interpretation District Information Officer April 15, 2005 MotivationProgram implications of information reviewed and discussed at routine staff meetings Program manager May 1, 2005 Recognize staff for keeping complete and accurate data over time SupervisorsApril 1, 2005

Lessons Learned During the Course

Keep Improving Your M&E The better your M&E System, the less time / effort M&E will require the more clearly you will understand your results the less difficult it will be to identify and correct problems in program implementation or activities the more easily you will communicate your results the more convincingly you will be able to demonstrate your program’s impact the more quickly and appropriately resources can be directed to their most effective, efficient use the simpler future strategic planning & program implementation, scale-up, or redesign will be