1. Non-academic Impact of Research through the Lens of Recent Developments in Evaluation Brad Cousins, Ph.D. University of Ottawa New Frontiers in Evaluation, Vienna, April 2006 Contact: bcousins@uottawa.cabcousins@uottawa.ca

2. 2 Collaborative Processes Emergence of alternative approaches: participatory, empowerment, democratic- deliberative New roles and goals for evaluators and non-evaluator stakeholders Pragmatic and/or transformative purposes

3. 3 Collaborative Inquiry Control of technical decision making (evaluator vs. non-evaluator stakeholder) Diversity of non-evaluator stakeholders selected for participation (limited vs. diverse) Power relations among non-evaluator stakeholders (neutral vs. conflicting) Manageability of the evaluation implementation (manageable vs. unwieldy) Depth of participation (involved in all aspects of inquiry vs. involved as a source for consultation)

4. 4 From Weaver & Cousins (2004)

5. 5 Conceptions of Use Process Use Individual, group, organizational Link to evaluation capacity building and organizational learning Theory of Influence Source of influence, intention, time Pathways of influence: level of analysis, type of mechanism

6. 6 Unintended Consequences Evaluation misuse Intended user behaviours Use, misuse, misevaluation, abuse, justified non-use.. Unintended Consequences Unforeseen vs. unforeseeable Tactics for minimizing..

7. 7 From: Cousins (2004)..

8. 8 Unforeseen Consequences Unforeseeable Consequences Life cycle dynamicsExtend internal monitoring Interdisciplinary teamsEnvironmental scanning Building on the already knownFutures markets Planning methodologiesRetrospective logic modelling Temporal, causal distanceData Group processesKnowledgeable pool of advice Tactics for Minimization From: Morrell (2005)

9. 9 Proposals for Consideration 1. Embrace models of collaborative inquiry 2. Continue with methodological innovation 3. Expand conceptions of use 4. Awareness of unintended consequences and potential misuses

10. 10 Proposals for Consideration 5. Attention to research program process considerations 6. Use frameworks in retrospective and prospective ways 7. Augment empiricism on research use