Evidence-based Practice v. Practice-based Evidence

Slides:



Advertisements
Similar presentations
Measuring health outcomes of engagement in the arts: the Arts Health Strategy for the Australia Council.
Advertisements

Health Promotion.
SETTINGS AS COMPLEX ADAPTIVE SYSTEMS AN INTRODUCTION TO COMPLEXITY SCIENCE FOR HEALTH PROMOTION PROFESSIONALS Nastaran Keshavarz Mohammadi Don Nutbeam,
Introduction to the unit and mixed methods approaches to research Kerry Hood.
Using RE-AIM as a tool for Program Evaluation From Research to Practice.
Quantitative Research Deals with quantities and relationships between attributes (variables). Involves the collection and analysis of highly structured.
Community Level Interventions
Problem Analysis Intelligence Step 2 - Problem Analysis Developing solutions to complex population nutrition problems (such as obesity or food insecurity)
Capacity building for NGOs to support people to make healthy choices and take an active role in maintaining good health and wellbeing.
STUDY PLANNING & DESIGN TO ENHANCE TRANSLATION OF HEALTH BEHAVIOR RESEARCH Lisa Klesges, Russell Glasgow, Paul Estabrooks, David Dzewaltowski, Sheana Bull.
Learning Outcomes of the SCPHN Programme & How they Link to Practice.
Center on Knowledge Translation for Disability and Rehabilitation Research The Work of the EPPI-Centre A webcast sponsored by SEDL’s Center on Knowledge.
RHS 303. TRANSITION OF THEORY AND TREATMENT nature of existence and gives meaning to and guides the action Philosophical Base: Philosophy of occupational.
Knowledge Translation: Research Into Practice Ian D Graham, PhD FCAHS University of Ottawa Ottawa Hospital Research Institute August 9, 2012.
Student volunteers and the volunteer- involving community organisations vinspiredstudents research.
WASHINGTON STATE UNIVERSITY EXTENSION Evaluation Based Program Development This material was developed in partnership with Rutgers's University and Lydia.
Using Logic Models in Program Planning and Grant Proposals The Covenant Foundation.
Improving skills and care standards in the support workforce: a realist synthesis of workforce development interventions Jo Rycroft-Malone, Christopher.
RE-AIM Framework. RE-AIM: A Framework for Health Promotion Planning, Implementation and Evaluation Are we reaching the intended audience? Is the program.
Realising a whole systems approach to tackling obesity in Medway
Representing Simple, Complicated and Complex Aspects in Logic Models for Evaluation Quality Presentation to the American Evaluation Association conference,
Implementation Science: Finding Common Ground and Perspectives Laura Reichenbach, Evidence Project, Population Council International Conference on Family.
Critical Realism and Realist Synthesis Sam Porter School of Nursing and Midwifery March 2016.
Health Care and Promotion Fund Project Expo 2006: Beginning with dissemination in mind: Characteristics of successful health promotion programs Dr. Charles.
Applied Methodologies in PHI Session 5: Evaluation Kath Roberts (NOO/EMPHO)
Incorporating Evaluation into a Clinical Project
Knowledge Transfer Partnership Project Nottingham Trent University and Nottinghamshire County Council Dr Adam Barnard Rachel Clark Catherine Goodall 19/4/16.
Proctor’s Implementation Outcomes
A Framework for Evaluating Knowledge Transfer and Exchange (KTE) in Public Health Paper Presented at the Annual Conference of the American Evaluation Association.
The What Works Centre for Crime Reduction: An evaluation
Key recommendations Successful components of physical activity interventions fall into three categories: Planning and developing physical activity initiatives.
RHIVA and IQ SROI Introduction
Developing Sustainable Behaviour Change Training
Linda de Caestecker Director of Public Health
Participatory Action Research (PAR)
Using Logic Models in Program Planning and Grant Proposals
NHS Education for Scotland Effective Practitioner Funded Project Implementing Caseload Supervision in a Nurse-Led Community Service.
The Relationship of CDC’s Conceptual Framework for PHIN Communities of Practice to Program Activities Andrea M. Hegedus, PhD, MPA Northrop Grumman Corporation.
Supporting Effective Public Services in Scotland.
…….So What, Proving You Are Making a Difference
What can implementation research offer?
Kate Yorke, Project Manager – MECC
National Science Learning Network development day: Evaluation Workshop
Lecture 4: Approaches to Health Promotion (A) Dr J. Sitali
RESEARCH IMPLEMENTATION PRACTICE
Workforce Planning Framework
Kate Yorke, Project Manager – MECC
Evaluating health promotion programs
Models, Theories and Frameworks
COMMUNITY RELATIONS, EQUALITY & DIVERSITY IN EDUCATION POLICY
An initiative that makes a difference
Blueprint Outlines practical, consumer-focused, state and local strategies for improving eating and physical activity that will lead to healthier lives.
HMS Academy Fellowship in Medical Education Research June 2, 2016
BELFAST HEALTHY CITIES 25th ANNIVERSARY LECTURE SERIES
REAL (working with Singizi) Presentation to NSA 3rd/4th August
How could quality standards benefit target populations?
Changing the Health System to Improve the Health of Older Patients
Department of Applied Social Sciences
The Use and Impact of FTA
Building Capacity for Quality Improvement A National Approach
NHS Education for Scotland Effective Practitioner Funded Project Implementing Caseload Supervision in a Nurse-Led Community Service.
Session 7 Some Key Concepts
Salford Integrated Care Programme
Program Planning: Models and Theories
HOW TO ENGAGE COMMUNITY MEMBERS IN OUTCOME EVALUATION?
Strategy April 2018 – March 2022.
Our Plan on a Page.
Research design and techniques Workshop ICBEDC 2010
Picking and Applying a Dissemination & Implementation Science Theory
@smharden Specifying implementation strategies to enhance reviewer comprehension of your work 2019 Dissemination & Implementation Science Grant Development.
Presentation transcript:

Evidence-based Practice v. Practice-based Evidence With Angela Beggan angela.beggan@uws.ac.uk @AngelaBeggan #LSA2014

Introduction Physical Activity can be both an outcome and a mechanism within community health improvement. Interventions are the main mode of delivery for such mechanisms which are largely concerned with lifestyle and behavioural change supported by empirically derived evidence. Design and implementation of complex, real world interventions are a pragmatic mix of research and practice based evidence.

Mismatch? “Change is conceptualized as a linear, deterministic process… Consistent with this framework, the associated statistical models have almost exclusively assumed a linear relationship between psychosocial predictors and behavior (change); i.e., greater increases in knowledge, attitudes and intentions will lead to greater change in behavior (Resnicow and Vaugh, 2006, p.2).” “A recognition of emergence means that we cannot understand things simply in terms of their components, the essence of the reductionist approach that underpins positivist science. Instead, we have to think about parts and wholes and we must recognize that causality does not run in any one direction (Byrne, 2013, p. 218).”

Interventions are natural Experiments “When the subject of new intervention development is one with such epidemiologic urgency as obesity and with such a paucity of evidence-based practices, practitioners and communities cannot sit idly while science develops refıned interventions. Action is a political, economic, and public health necessity, and such actions must be taken in the absence of absolute confıdence in their effıcacy, much less their effectiveness in the particular communities, settings, and populations (Sallis and Green, 2012, S411).”

Translation How can research and practice communicate better? RE-AIM Framework (Glasgow, Vogt, and Boyles, 1999)

Evaluation Application Dimension Outcome(s) Measures Reach   1,7 Representativeness of participants to intended target groups. Number of participants accessing AC activities in each area. Rate of penetration into available target groups in each area. Effectiveness 1,2,6 Self-report survey measures on increases in physical activity and increases in awareness of health benefits Health-related quality of life – SF-12v2 7-day recall of physical activity Adoption 3,4 Representativeness of partners engaging the services Uptake of partner organisations in each area. Implementation 1,3,5,8,9 Interviews with partners Interviews with instructors Reporting on processes Document review Maintenance 5,8 Rate of attrition Reporting on volunteer development Community intervention targeting hard to reach groups as defined by stakeholders. Multiple outcome objectives across several theoretical and practice-based domains. Post implementation only – retrospective.

Selected Findings Dimension Practice implications Research Implications Reach Specific barriers were not targeted Why did it work anyway in some groups and locations? Effectiveness Specific behavioural mechanisms were not employed How can evidence be more readily communicated and applied in practice – expediency? Adoption Partners have good working links – good uptake. Potential for wide dissemination to practice through partners Implementation Varying levels of buy-in affected outcomes in some areas Competing agendas affect programme fidelity Maintenance Failure to engage instructors affected sustainability Why didn’t participants engage better with the activities and training opportunities?

Implications Theory-based design and evaluation: Complexity Theories Realist Evaluation Theories of Change Complexity Theories Participatory Methods Practice Academics Participants Need to think about interventions differently. Instead of empirically derived linear causal relationships – collaborative insightful development with pragmatic measures of effectiveness.

Questions/Comments? Co-Production “As such action rolls out, the opportunities to evaluate its development, application and effects become the stuff of practice-based evidence that will contribute to and make more robust the long-awaited evidence-based practice (Sallis and Green, 2012, S411).” Questions/Comments?

References Byrne, D (2013). Evaluating complex social interventions in a complex world. Evaluation 19(3): 217-228. Glasgow, R; Vogt, T; Boyles, S (1999). Evaluating the public health impact of health promotion interventions: the RE-AIM framework. American Journal of Public Health Sep 89(9): 1322-7. Rescinow, K and Vaugh, R (2006). A chaotic view of behavior change: a quantum leap for health promotion. International Journal of Behavioural Nutrition and Physical Activity 3(1):25. Sallis, J and Green, L (2012). Active living by design and its evaluation: contributions to science. American Journal of Preventive Medicine 43(5): S410-S412.