1. Public Policy Process: Monitoring and Evaluation plans, frameworks, methods & process
Ghanashyam Bhattarai

2. Monitoring plan, framework, method & process
continuous assessment aimed at providing early information of the ongoing activities
regular collection and analysis of information to track the progress of program implementation against pre-set targets and objectives and
action taken to correct the deficiencies 2

3. Monitoring plan, framework, method & process
Characteristics
Clarifies program objectives,
Links activities and resources to objectives,
Translates objectives into performance indicators and
sets targets,
Routinely collects data on these indicators,
compares actual results with targets 3

4. Monitoring plan A monitoring plan outlines: underlying assumptions
activities, outputs, and outcomes relationships
baseline data
monitoring schedule
data sources
associated cost estimates
information on dissemination and utilization plan 4

5. Monitoring plan Key consideration: Resources Capacity Feasibility
Reliability
Timeline
Ethics 5

6. Monitoring Framework 6

7. Logical Framework PROJECT/ Narrative SUMMARY INDICA TORS
MEANS OF VERIFICA TION
RISKS / ASSUMPTI ONS
Goal
Outcomes
Outputs
Activities 7

8. Evaluation plan, framework, method & process
process of determining worth or significance of a development activity, policy or program (determining relevance of objectives, efficacy of design and implementation, efficiency or resource use, and sustainability of results) 8

9. Evaluation plan, framework, method & process
making of a judgment about the amount, number, or value of something; assessment.
systematic and objective assessment of an on-going or completed project, program, or policy, and its design, implementation and results. 9

10. Evaluation Method and Process
Requirements;
robust, reliable and repeatable
Simple to operate in terms of technology and user skills
cheap to operate and of a high out put in a short time
Data able to be related to sensitivity responses in the field 10

11. Evaluation plan Evaluation is carried out for assessing Relevance
Efficiency
Effectiveness
Impact
Sustainability
of a plan, program and/ or policy implementation 11

12. Evaluation plan Answers are sought on who will
involved in design, implementation and reporting
clarify scope
develop the questions
select indicators
determine data collection methods
analyze and synthesize the information you obtain
interpret the findings, provide feedback, and make recommendations
communicate 12

13. Evaluation plan
A written document detailing the program model being evaluated
Description and justification of the approach
Instructions for the evaluation/ a guide for each step of the evaluation process
It Creates a shared understanding
helps decide on how to address the objectives
helps identify methods for getting information
helps identify issues and strategies to overcome challenges
helps determine reasonable and realistic timeline 13

14. Evaluation Framework Purposes of framework are to
summarize the essential elements of program evaluation,
provide a framework for conducting effective program evaluations,
clarify steps in program evaluation,
review standards for effective program evaluation, and
address misconceptions regarding the purposes
methods of program evaluation. 14

15. Evaluation Framework Conceptual Frameworks Results Frameworks
Logical Frameworks
Logic models
Speaker Notes:
We will start by reviewing the different types of frameworks and by learning how to design goals and objectives that will be measurable. Frameworks are probably not new to you; However, people tend to use different terms for different types of frameworks. So we will mention these other terms as we go along. All of you should have received a handout containing examples of frameworks. You may find these handouts helpful for understanding the content and purpose of the different types of frameworks. You may want to keep these handouts for future reference. Please keep in mind that these frameworks are meant to be examples and are not intended to be interpreted as the “correct” framework for a certain program. There will be an opportunity to develop examples of the different types of frameworks. Lastly, the interface between frameworks and M&E planning will explored. The last few hours of the day will be devoted to work on your group projects that will last the duration of the workshop. 15

16. Conceptual Frameworks
maps pathways to achieve results, and
constitutes logical framework for evaluation
Inputs
Process/ Functional Outputs
Service Outputs
Outputs
Intermediate outcomes
Long-term outcomes
Social
Cultural
Economic
Political
Legal 16

17. A results framework is both planning tool and management tool
Results Frameworks
A results framework is both
planning tool and
management tool
Provides program-level framework for mangers
Objectives/
Outcomes
Indicators
Means of Verification
Important Assumptions
IMPACT
Objectives
Action taken (Tasks)
Products or services
Intermediate effects
Long term effects
Objective:
Outcome:
Speaker Notes:
We will start by reviewing the different types of frameworks and by learning how to design goals and objectives that will be measurable. Frameworks are probably not new to you; However, people tend to use different terms for different types of frameworks. So we will mention these other terms as we go along. All of you should have received a handout containing examples of frameworks. You may find these handouts helpful for understanding the content and purpose of the different types of frameworks. You may want to keep these handouts for future reference. Please keep in mind that these frameworks are meant to be examples and are not intended to be interpreted as the “correct” framework for a certain program. There will be an opportunity to develop examples of the different types of frameworks. Lastly, the interface between frameworks and M&E planning will explored. The last few hours of the day will be devoted to work on your group projects that will last the duration of the workshop. 17

18. Results Frameworks
A results framework is both a planning and management tool. It provides a program- level framework for mangers
WHAT WE WANT DO?
WHY
HOW?
INPUTS
ACTIVITIES
OUTPUTS
OUTCOMES
IMPACT
USE OF RESOURCES
INPUTS MOBILIZED THROUGH ACTIONS TAKEN
PRODUCTS, CAPITAL GOODS AND SERVICES
SHORT-TERM AND LONG- TERM EFFECTS
ACTUAL OR INTENDED CHANGES
RESOURCES
RESULTS
PLANNING
IMPLEMENTATION
Speaker Notes:
We will start by reviewing the different types of frameworks and by learning how to design goals and objectives that will be measurable. Frameworks are probably not new to you; However, people tend to use different terms for different types of frameworks. So we will mention these other terms as we go along. All of you should have received a handout containing examples of frameworks. You may find these handouts helpful for understanding the content and purpose of the different types of frameworks. You may want to keep these handouts for future reference. Please keep in mind that these frameworks are meant to be examples and are not intended to be interpreted as the “correct” framework for a certain program. There will be an opportunity to develop examples of the different types of frameworks. Lastly, the interface between frameworks and M&E planning will explored. The last few hours of the day will be devoted to work on your group projects that will last the duration of the workshop. 18

19. Evaluation Framework Logical Frameworks
Core of the Logical Framework is "temporal logic model" that runs through the matrix as
Vertical (Intervention) Logic: specifies project goals, clarifies relationship and specifies externalities
Horizontal Logic : relates to measurement of effect, resources used, specific indicators and sources of verification
Speaker Notes:
We will start by reviewing the different types of frameworks and by learning how to design goals and objectives that will be measurable. Frameworks are probably not new to you; However, people tend to use different terms for different types of frameworks. So we will mention these other terms as we go along. All of you should have received a handout containing examples of frameworks. You may find these handouts helpful for understanding the content and purpose of the different types of frameworks. You may want to keep these handouts for future reference. Please keep in mind that these frameworks are meant to be examples and are not intended to be interpreted as the “correct” framework for a certain program. There will be an opportunity to develop examples of the different types of frameworks. Lastly, the interface between frameworks and M&E planning will explored. The last few hours of the day will be devoted to work on your group projects that will last the duration of the workshop. 19

20. Evaluation Framework Logical Frameworks PROJECT/ Narrative SUMMARY
INDICA TORS
MEANS OF VERIFICA TION
RISKS / ASSUMPTI ONS
Goal
Outcomes
Outputs
Activities
Speaker Notes:
We will start by reviewing the different types of frameworks and by learning how to design goals and objectives that will be measurable. Frameworks are probably not new to you; However, people tend to use different terms for different types of frameworks. So we will mention these other terms as we go along. All of you should have received a handout containing examples of frameworks. You may find these handouts helpful for understanding the content and purpose of the different types of frameworks. You may want to keep these handouts for future reference. Please keep in mind that these frameworks are meant to be examples and are not intended to be interpreted as the “correct” framework for a certain program. There will be an opportunity to develop examples of the different types of frameworks. Lastly, the interface between frameworks and M&E planning will explored. The last few hours of the day will be devoted to work on your group projects that will last the duration of the workshop. 20

21. Evaluation Framework Logic models
Describes logical linkage among program resources, activities, outputs audience and short, intermediate and long term outcomes to the related the program. Logic model is a narrative or graphical description of processes in the real life. It illustrate sequence of cause and effect relationship
Tracking progress against well defined output indicators provides a clear basis for monitoring progress; verifying purpose level and goal level progress.
Speaker Notes:
We will start by reviewing the different types of frameworks and by learning how to design goals and objectives that will be measurable. Frameworks are probably not new to you; However, people tend to use different terms for different types of frameworks. So we will mention these other terms as we go along. All of you should have received a handout containing examples of frameworks. You may find these handouts helpful for understanding the content and purpose of the different types of frameworks. You may want to keep these handouts for future reference. Please keep in mind that these frameworks are meant to be examples and are not intended to be interpreted as the “correct” framework for a certain program. There will be an opportunity to develop examples of the different types of frameworks. Lastly, the interface between frameworks and M&E planning will explored. The last few hours of the day will be devoted to work on your group projects that will last the duration of the workshop. 21

22. Evaluation Method and Process
Phases of Evaluation:
Planning Phase
Implementation Phase
Completion Phase
Post completion Phase
Speaker Notes:
We will start by reviewing the different types of frameworks and by learning how to design goals and objectives that will be measurable. Frameworks are probably not new to you; However, people tend to use different terms for different types of frameworks. So we will mention these other terms as we go along. All of you should have received a handout containing examples of frameworks. You may find these handouts helpful for understanding the content and purpose of the different types of frameworks. You may want to keep these handouts for future reference. Please keep in mind that these frameworks are meant to be examples and are not intended to be interpreted as the “correct” framework for a certain program. There will be an opportunity to develop examples of the different types of frameworks. Lastly, the interface between frameworks and M&E planning will explored. The last few hours of the day will be devoted to work on your group projects that will last the duration of the workshop.
Evaluation Methods
Quantitative Evaluation
Qualitative Evaluation
Mixed Methods 22

23. Evaluation Method and Process
Evaluation Methods
Quantitative and qualitative methods provide important information for evaluation
These methods are rarely used alone; combined, they generally provide the best overview of a project
Speaker Notes:
We will start by reviewing the different types of frameworks and by learning how to design goals and objectives that will be measurable. Frameworks are probably not new to you; However, people tend to use different terms for different types of frameworks. So we will mention these other terms as we go along. All of you should have received a handout containing examples of frameworks. You may find these handouts helpful for understanding the content and purpose of the different types of frameworks. You may want to keep these handouts for future reference. Please keep in mind that these frameworks are meant to be examples and are not intended to be interpreted as the “correct” framework for a certain program. There will be an opportunity to develop examples of the different types of frameworks. Lastly, the interface between frameworks and M&E planning will explored. The last few hours of the day will be devoted to work on your group projects that will last the duration of the workshop. 23

24. Quantitative Evaluation
Provide information that can be counted to answer such questions as
How many?
Who was involved?
What were the outcomes? and
How much did it cost?”
Data collected by surveys or questionnaires, pretests and posttests, observation, or review of existing documents and databases
Speaker Notes:
We will start by reviewing the different types of frameworks and by learning how to design goals and objectives that will be measurable. Frameworks are probably not new to you; However, people tend to use different terms for different types of frameworks. So we will mention these other terms as we go along. All of you should have received a handout containing examples of frameworks. You may find these handouts helpful for understanding the content and purpose of the different types of frameworks. You may want to keep these handouts for future reference. Please keep in mind that these frameworks are meant to be examples and are not intended to be interpreted as the “correct” framework for a certain program. There will be an opportunity to develop examples of the different types of frameworks. Lastly, the interface between frameworks and M&E planning will explored. The last few hours of the day will be devoted to work on your group projects that will last the duration of the workshop. 24

25. Qualitative Methods Qualitative data answer such questions as
What is the value added?
Who was responsible? and
When did something happen?
Qualitative data are collected through
direct or participant observation,
interviews,
focus group discussions,
case studies and
written documents.
Speaker Notes:
We will start by reviewing the different types of frameworks and by learning how to design goals and objectives that will be measurable. Frameworks are probably not new to you; However, people tend to use different terms for different types of frameworks. So we will mention these other terms as we go along. All of you should have received a handout containing examples of frameworks. You may find these handouts helpful for understanding the content and purpose of the different types of frameworks. You may want to keep these handouts for future reference. Please keep in mind that these frameworks are meant to be examples and are not intended to be interpreted as the “correct” framework for a certain program. There will be an opportunity to develop examples of the different types of frameworks. Lastly, the interface between frameworks and M&E planning will explored. The last few hours of the day will be devoted to work on your group projects that will last the duration of the workshop. 25

26. Qualitative Methods Analysis of Qualitative data examining,
comparing and contrasting, and
interpreting the patterns
Speaker Notes:
We will start by reviewing the different types of frameworks and by learning how to design goals and objectives that will be measurable. Frameworks are probably not new to you; However, people tend to use different terms for different types of frameworks. So we will mention these other terms as we go along. All of you should have received a handout containing examples of frameworks. You may find these handouts helpful for understanding the content and purpose of the different types of frameworks. You may want to keep these handouts for future reference. Please keep in mind that these frameworks are meant to be examples and are not intended to be interpreted as the “correct” framework for a certain program. There will be an opportunity to develop examples of the different types of frameworks. Lastly, the interface between frameworks and M&E planning will explored. The last few hours of the day will be devoted to work on your group projects that will last the duration of the workshop. 26

27. Qualitative Methods Analysis include identification of themes, coding,
clustering similar data, and
reducing data to meaningful and important points or
other approaches
Speaker Notes:
We will start by reviewing the different types of frameworks and by learning how to design goals and objectives that will be measurable. Frameworks are probably not new to you; However, people tend to use different terms for different types of frameworks. So we will mention these other terms as we go along. All of you should have received a handout containing examples of frameworks. You may find these handouts helpful for understanding the content and purpose of the different types of frameworks. You may want to keep these handouts for future reference. Please keep in mind that these frameworks are meant to be examples and are not intended to be interpreted as the “correct” framework for a certain program. There will be an opportunity to develop examples of the different types of frameworks. Lastly, the interface between frameworks and M&E planning will explored. The last few hours of the day will be devoted to work on your group projects that will last the duration of the workshop. 27

28. Evaluation Methods Mixed Methods
Based on the nature of participation by stakeholders may need both qualitative and quantitative methods because of the diversity of issues addressed (e.g., population, type of project, and goals).
The choice of methods should fit the need for the evaluation, its timeline, and available resources
Speaker Notes:
We will start by reviewing the different types of frameworks and by learning how to design goals and objectives that will be measurable. Frameworks are probably not new to you; However, people tend to use different terms for different types of frameworks. So we will mention these other terms as we go along. All of you should have received a handout containing examples of frameworks. You may find these handouts helpful for understanding the content and purpose of the different types of frameworks. You may want to keep these handouts for future reference. Please keep in mind that these frameworks are meant to be examples and are not intended to be interpreted as the “correct” framework for a certain program. There will be an opportunity to develop examples of the different types of frameworks. Lastly, the interface between frameworks and M&E planning will explored. The last few hours of the day will be devoted to work on your group projects that will last the duration of the workshop. 28

29. An Exercise on Logframe:
A half of round 1000 students in Grade 5 & 6 of a community were not found to satisfactory in their reading proficiency and the school drop rate was very high. By the time the students reach Grade 10 the number of students is almost half. Department of Education is planning to improve the percentage of school going students at Grade 10 by at least 10% and also improve proficiencies of the students and intends to introduce an intervention at Grade 5 and 6 and. As an effort to improve it, Government has asked DoEd to prepare plan and implement it. DoEd has prepare a programme to organize five summer camps with 100 students of Grade 5 & 6 in each camp. The community members have expressed their concerns on the performance of their wards but have not been able to give time for them. The government has assured of the required budget in upcoming budget for the programme and has instructed DoEd to submit a plan for implementation 29

30. Logical Framework Example
PROJECT / NARRATIVE SUMMARY
INDICATO RS
MEANS OF VERIFICATI ON
RISKS / ASSUMPTION S
Goal
10% increase in the number of Grades primary students continuing on to high school within 3 years.
Percentage of Grades primary students continuing on to high school.
Comparison of primary and high school enrolment records.
N/A
Outcome 
Improve reading proficiency among children in Grades 5-6 by 20% within 3 years.
Reading proficiency among children in Grades 5-6
Six monthly reading proficiency tests using the national assessment tool.
Improved reading proficiency provides self confidence required to stay in school. 30

31. Number of students completing a reading summer camp.
PROJECT SUMMARY
INDICATORS
MEANS OF VERIFICATION
RISKS / ASSUMPTIONS
Outputs
1.  500 Grade students with low reading proficiency complete a reading summer camp
Number of students completing a reading summer camp.
Summer camp attendance records.
Children apply what they learnt in the summer camp.
parents of children in Grade with low reading proficiency help their children read at home.
Number of parents helping their children to read at home.
Survey of parents conducted at the end of each summer camp.
Children are interested in reading with their parents.
Activities
1.  Run five reading summer camps, each with 100 Grades students who have low reading proficiency.
Number of summer camps run.
Summer camp records.
Parents of children with low reading proficiency are interested in them attending the camps.
2. Distribute “Reading at Home” kits to parents of children attending summary camps.
Number of kits distributed.
Kit distribution records.
Parents are interested and able to use the kits at home. 31

32. Thank You