1. Developing SEA Change’s Evaluation Plan
Annual Members’ Meeting
Track A
November 10, 2011

2. Purpose of the Session
To develop parts of an evaluation plan for the second year of SEA Change
To provide participants with a participatory M&E planning experience

3. Agenda Review the stages of M&E and the steps for M&E planning
Conduct a stakeholders’ analysis
Define the purpose of the evaluation
Develop key evaluation questions
Identify data sources and collection methods
Discuss next steps

4. Analyze & Interpret Information
Stages of M&E
Plan the Evaluation
Engage
Stakeholders
Engage
Stakeholders
Report & Use
the Results
Collect Information
Analyze & Interpret Information

5. Reasons for Participatory Evaluation
Obtain better quality data
Because the evaluation will be more relevant, more likely to have the results used
Foster greater ownership
Develop evaluation capacity

6. An evaluation plan is your roadmap
Unit 2: Evaluating outcomes
An evaluation plan is your roadmap
(University of Wisconsin-Extension, Program Development & Evaluation)
Outcome Evaluation for Community Organizations 6

7. Steps to M&E Planning Describe the project
Identify major stakeholders and their information needs and uses
Define the M&E purpose(s)
Formulate M&E questions and indicators
Identify sources of information and data collection methods
Determine ways to analyze the M&E data
Decide how to report and facilitate the use of the M&E results
Time: 2:00 – 2:15, Energizer
Explain slide, 15 minutes, 2:15 – 2:30

8. Step 2: Evaluation Stakeholder Analysis
Major Stakeholder
Groups
What information do they need from the evaluation?
How will they use the results of the evaluation?

9. Step 3: Define the Purpose(s) of the Evaluation
 How will the information be used?

10. Unit 4: Focus the evaluation
Underlying purpose =
LEARNING
Outcome Evaluation for community Organizations 10

11. Common Purposes for M&E
To be accountable and report to:
Donors
Program participants and community members
Government
To improve program (re)design, planning and implementation
To obtain additional resources
To advocate for particular issues
To acknowledge and celebrate our successes
Other ???

12. Step 3: Define Our Evaluation Purposes
In your work groups, write a purpose statement:
“We are conducting an evaluation of SEA Change in order to obtain information that will be used to:

13. Steps to M&E Planning Describe the project
Identify major stakeholders and their information needs and uses
Define the M&E purpose(s)
Formulate M&E questions and indicators
Identify sources of information and data collection methods
Determine ways to analyze the M&E data
Decide how to report and facilitate the use of the M&E results
Time: 2:00 – 2:15, Energizer
Explain slide, 15 minutes, 2:15 – 2:30

14. Step 4: Formulate Evaluation Questions
What are Evaluation questions?
Information needs stated as questions
State what aspects or topic of the project will be addressed in the evaluation
Provide:
Focus
Clarity

15. Time to focus, focus, focus . . .
Unit 4: Focus the evaluation
Time to focus, focus, focus . . .
The secret to good MERL is focus, focus, focus
And one way we become very focused is by using MERL questions and indicators
(University of Wisconsin-Extension, Program Development & Evaluation)
Outcome Evaluation for community Organizations 15

16. Step 4: Formulate Evaluation Questions
What are typical types of evaluation questions?
 Use the Logic Model
What project activities have been implemented? Have they been implemented as planned? If not, why not?
To what extent have expected outcomes been achieved?

17. Step 4: Formulate Evaluation Questions
Other types of evaluation questions:
Efficient use of resources?
Effective in achieving project objectives?
Is the project relevant?
Are the activities and/or outcomes sustainable?
To what extent has the project achieved its expected impact?

18. Step 5: Decide Sources of Information and Data Collection Methods
Where will the information come from to answer the evaluation questions? What methods will be used to collect that information?

19. Project Element or Topic
Data Collection Plan
Project Element or Topic
Evaluation Question
Data Source and
Collection Method

20. Next Steps Sign up for the Evaluation Committee, if you’re interested
How should be share this with the rest of the CoP?
How should we share this with Track B?