1. Participation in Evaluation Practice: Idealistic or Achievable? Dr. Ian Patrick, Ian Patrick & Associates

2. What is participatory evaluation?

3. Information SharingInput Seeking Group Problem Solving / Decision Making Source: Kaner et al 2008

4. Participatory monitoring & evaluation (PM&E) is a process through which stakeholders at various levels: Engage in M or E of a particular initiative Share control over the content, the process and the results of the M&E activity Engage in taking or identifying corrective actions World Bank, 2003

6. Participation Participation as an END Building capacity to negotiate and change structural relationships and conditions, and acquire resources Participation as a MEANS Using methods and techniques whereby stakeholders can be included / represented

10. Evaluations are often labelled as ‘participatory’, but often only involve consultation.

12. Participation in Evaluation Evaluation Design Data Collection Data Analysis Developing Recommendations Reporting of Findings Dissemination of Findings Weaver and Cousins, 2004 & Cullen, 2009

13. Argument Against PE “Simply amateur evaluation, with the only professional involved being self-excluded from exerting any control over conclusions drawn” (Scriven, 2005)

14. Time Resources Acceptability

15. Evaluator as Facilitator Community / Organisation Take Stock Set Goals Develop Strategies Document Progress Empowered Outcomes Empowering Process Empowerment Evaluation Unambiguous values orientation - principle driven End point is not assessment of program's worth Foster improvements and self-determination On-going process - program improvement & people's empowerment Evaluation is not neutral - for one group to force social change - for another to reinforce the status quo

16. Most Significant Change (MSC) 16

17. - Knowledge, meaning and value ascribed through experience - Reality is interpreted differently by different people Process reinforces group cooperation, learning and consensus building Learning and agreement about significant change, project achievement and appropriate directions Action is based on what people truly value Complements other monitoring and evaluation approaches

19. Progress Markers

21. Arguments for Participatory Evaluation Rights Relevance Accuracy Effectiveness Process Who would argue against participation?

22. Issues in PE Increased time and resource demands Difficulty managing multiple stakeholders Lack of stakeholder skill or knowledge; and possible low priority Empowerment focus – ideological motivations or evaluative? Destabilising – unleash demands Rigour and objectivity Few studies of efficacy

23. Considerations when deciding on a PE Why is participation being advocated? Is there support for a participatory approach? Whose voice counts and which stakeholder would need to be included? In what capacity could they participate? How will you ensure that decision making about the evaluation is inclusive? Are there sufficient resources available (time, funding and capacity) Who is likely to benefit from the participatory evaluation process, and from its outcomes?

24. PE depends ability of the evaluators to : Assess interest in & scope for a participatory approach to the evaluation Advocate for participation and its benefits Establish positive working relationships Establish ways in which participatory methods will be used Use strong facilitation skills to manage the process and identify/mediate competing interests as they appear Ensure the process communicates findings