Presentation on theme: "Using Evaluation Theory to Improve Priority Setting for Healthcare Neale Smith & Craig Mitton Centre for Clinical Epidemiology & Evaluation, Vancouver."— Presentation transcript:
Using Evaluation Theory to Improve Priority Setting for Healthcare Neale Smith & Craig Mitton Centre for Clinical Epidemiology & Evaluation, Vancouver Coastal Health Research Institute, University of British Columbia Presentation to the 8 th Biennial Conference of the International Society on Priorities in Health Care Waltham, MA --- April 23, 2010
Evaluation and Priority Setting: Common Roots 1.Increased expectations for government accountability 2.Evidence-based decision making 3.Increased demand for efficient use of resources in times of fiscal restraint
Priority Setting & Resource Allocation Literature Evaluation & Evaluation Theory Literature Objective: From this...
Priority Setting & Resource Allocation Literature Evaluation & Evaluation Theory Literature... to this
An Evaluation Theory Tree SOURCE: Alkin, M.C., & Christie, C.A. (2004). An evaluation theory tree. In M.C. Alkin (Ed.), Evaluation roots: tracing theorists views and influences. Thousand Oaks, CA: Sage. Pages
Primary Perspective MethodsEvaluator UseDecision Maker ValuingLarger Public or Society
Guiding Evaluation Question MethodsHow to measure the impact of PSRA processes on desired outcomes? UseWhat do decision makers in a particular context need in order to improve the usefulness to them of PSRA? ValuingHow do the results of PSRA processes affect the interests of different social groups (especially the least advantaged)?
Common Methods MethodsControlled experiments if possible Quantitative measures if possible Focus on measures of PSRA outcomes UseInterviews, focus groups with decision makers Action research Other qualitative methodologies, e.g., phenomenology ValuingConstructivist, critical, participatory action research approaches
Evaluation Focus MethodsIntended outcomes and objectives Program theories External or independent observer UsePSRA processes Intended use Organizational capacities ValuingPSRA processes Unintended outcomes Power relationships
Implications More evaluation of PSRA is needed – and we should expand its focus to consider outcomes, as well as process and outputs Evaluation should be considered from the beginning – this can influence process design Existing PSRA studies fail to draw upon evaluation theory: we can take advantage of such approaches to more clearly identify features we wish to address, and how best to do so