1. Using Appreciative Inquiry to Build Evaluation Capacity

2. Objectives
Understand the basic principles of Appreciative Inquiry (AI)
Understand the structures and processes in building evaluation capacity
Experience the first phase of AI
Explore how AI can be applied in building evaluation capacity in own context
Introduce own introduction to AI
Mention methods to be used:
Mini-lectures (5-10 minutes)
Small group work
Discussions
Supplementary materials

3. Methods Mini-lectures Individual reflections Small group discussions
Large group discussions

4. What is Appreciative Inquiry?

5. Appreciative Inquiry
“is the cooperative search for the best in people, their organizations, and the world around them. It involves systematic discovery of what gives a system ‘life’ when it is most effective and capable in economic, ecological, and human terms…
the art and practice of asking questions that strengthen a system’s capacity to apprehend, anticipate, and heighten positive potential.”
Cooperrider & Whitney, 1999
Cooperrider, D.L. & Whitney, D. (1999). “Appreciative Inquiry: A positive revolution in change.” In P. Holman & T. Devane (eds.), The Change Handbook, Berrett-Koehler Publishers, Inc., pages

6. Appreciative Inquiry
“is the study and exploration of what gives life to human systems when they function at their best...
Questions and dialogue about strengths, successes, values, hopes and dreams are themselves transformational…
Human organizing and change, at its best, is a relational process of inquiry, grounded in affirmation and appreciation.”
Whitney & Trosten-Bloom, 2003, p.1

7. Brief Background on AI
Dissertation work of David Cooperrider in organizational development, Case Western University School of Management (1980)
Currently used in evaluation and research on:
organizational effectiveness or change
community development
social work
education
health

8. Assumptions
Half-empty?
Half-full?
Half-fool?

9. Language and Context The language we use reflects our context
The language we use can influence our context
How many people here speak a language other than English?
Translation is not literal;
Example: What is “people” in French? The many words for rice in Filipino.
Lakas ng loob = strength of inside (self-confidence, but use of word strength and concept of the “a person’s core”)
Snowflake:
Rice image:
How many people have children or interact with children? One of the main challenges of being a parent is providing discipline. What do the experts tell us? Use positive reinforcement. Say “do” and not “don’t.”
Example 2: Use of negatives in disciplining young children.
If I tell you: Don’t think of a pink elephant
What happens?
If I tell you: Think of a clear blue sky

10. Appreciative Inquiry Process
Inquire
Evaluation
Capacity
Building
Imagine
Innovate
Implement
4-D model of Cooperrider:
Discover
Dream
Design
Destiny
Based on the 4-I Model. Preskill & Catsambas, 2006

11. AI Philosophy
Action research method: the act of asking questions or doing research is an intervention and changes the context
The language we use creates our reality
Positive image results in positive action
People perform better and are more motivated to act when they have a choice in what they will contribute.

12. A small group exercise
You are working in an organization where evaluation is accepted by some and not by others
You want to know:
what are people’s experiences with evaluation
how to increase staff buy-in, and
how to build capacity for evaluation
You decide to use Appreciative Inquiry

13. Phase 1: Inquire Choose a partner at your table
First, answer the questions on your own (2 minutes)
Then, take turns interviewing each other (5 minutes each)
Listen with great curiosity and interest
Take notes, and listen for memorable quotes
Ask probing questions

14. Conducting the appreciative interview
Peak experience
“Tell me about an exceptional experience when an evaluation process was working very well.”
Values
“What do you value most about yourself and your role in that experience?”
Wishes
“What 3 wishes do you have so you can have more of this exceptional experience?”

15. Small Group Tasks Form a small group of about 6 to 8 persons
Tell your partner’s story, values and wishes
Listen for and note themes as you hear the stories
Discuss and identify the themes
Write up to 5 themes on the flipchart

16. In the larger group What are the common themes? What are the values?
What made success possible?

17. From Problem-Focused to Appreciative Inquiry
What problems are we having?
Appreciative Inquiry:
What’s working well around here?
How can we do more of it?

18. Appreciative Inquiry & Problem-Solving Approaches
Language used: deficit-based
Problem talk
Focus on what does not work
Generates blame and defensiveness
Tends to have fragmented view of the system
Language used: affirmative
Possibility talk
Focus on what works
Generates vision
Tends to have a more wholistic view of the system

19. Using AI to learn about action research
Everyone’s input is welcome and captured
Opportunity for learning to conduct interviews
Opportunity for learning facilitation of group discussions (focus groups) and identifying themes

20. Doing Appreciative Inquiry

21. Phase 1: Inquire peak experience values wishes Paired interviews
Core questions:
peak experience
values
wishes
Share stories in a small group
Identify themes

22. Phase 2: Imagine
Small groups envision a future state: What will the program/organization look like in 3, 5 or 10 years?
Visions shared in words and/or visual images
Groups share their visions and images
Discussion of themes

23. Phase 3: Innovate
Develop provocative propositions for themes based on stories and visions
Stretch the imagination
Represent the organization’s social architecture (culture, leadership, policies and processes, communications, relationships, structure)

24. Phase 4: Implement Members select propositions they wish to work on
Monitor, evaluate and celebrate progress
Keep the conversation ongoing

25. In small groups
Imagine that 3 years have passed, and evaluation practices are successfully implemented and used in your organization.
Describe:
What does it look like? How does it work?
Who participates?
What types of evaluation knowledge, behaviour and attitudes are occurring?

26. Tasks for the Group
Reflect on the scenario individually, then share to your small group
Identify and discuss themes
Select a photo or create a drawing that represents the themes
Share in the larger group

27. AI as a road map for evaluation
Inquire
Evaluation
Capacity
Building
Imagine
Innovate
Implement
Use the 4-I phases
Clarifying
outcomes
Developing
evaluation
questions
Identifying
stakeholders
measures &
indicators
Using data for
reporting &
managing

28. AI can be successfully applied if
The organization is interested in using participatory and collaborative approaches
The organization wishes to build capacity for evaluation
The evaluation involves a wide range of stakeholders
The organization values innovation and creativity
The organization wants to use evaluation findings to improve its programs

29. Applying AI approaches
Evaluation or QI: questionnaires, interviews
Meetings
Strategic planning

30. Case Example 1: Questionnaire
Annual survey to members of the Centre’s reference group
Top 3 outstanding contributions or achievement of the reference group
Wishes for Centre to be more responsive
Wishes for the group to be more effective

31. Case Example 2: End of the year project report
Project leads respond to a questionnaire to assess how well the project has contributed to the Centre’s Strategic Goals
Questionnaire is an online form using a web-based project management software (SmartSimple)

33. Case Example 2: End of the year project report
Number and type of internal and/or external stakeholders
Evidence that the project was successful in addressing the strategic goal
Other key contributions
How can the questions be changed to reflect an AI approach?

34. Evaluation Capacity-Building

35. Evaluation capacity building
“the intentional work to continuously create and sustain overall organizational processes that make quality evaluation and its uses routine.”
Stockdill, Baizerman & Compton, 2002, p. 14
“The extent to which an organization has the necessary resources and motivation to conduct, analyze and use evaluations” Gibbs, Napp, Jolly, Westover & Uhl, 2002, p. 161

36. In English….
Evaluation that is sustainable, appropriate and high quality
To do: plan and implement
To use: analyze results, engage stakeholders, improve programs

37. Source: Preskill & Boyle, 2008
Preskill H & Boyle S (2008). A Multidisciplinary Model of Evaluation Capacity Building American Journal of Evaluation :
Check to see if some of the elements here were mentioned in the Inquire or Imagine phase.
Strengths of the model:
Helps organizations identify strategies for building evaluation capacity
Identifies factors important in moving towards sustained evaluation practices
Invite questions about the model
Source: Preskill & Boyle, 2008

38. Some facilitators for building evaluation capacity
Leadership, management, champions
Systems: collection of data or information, familiarity with QI processes, feedback
Organizational culture and stability
Communication
Invite to see if some of the themes mentioned included this.

39. Evaluation Capacity Building Objectives
Knowledge
Example: various approaches and methods
Skills
Example: developing a logic model
Affective
Example: Evaluation adds value and yields useful information
From Table 1 of Preskill & Boyle 2008

40. AI + ECB = ?
What is the value of using an appreciative approach to evaluation?
How can the Centre assist your organization in building capacity for evaluation?

41. Checking Out What did you find surprising? Exciting?
What is your one key insight?
What wish do you have to make today’s workshop work better for you?
What is one thing you can do/want to do based on what we discussed today?

42. Thank you! For questions or comments contact:
Evangeline Danseco, PhD
Head, Evaluation and Research
x3319