Barbara Resnick, PhD, CRNP, FAAN, FAANP

Slides:



Advertisements
Similar presentations
Nursing Diagnosis: Definition
Advertisements

Chronic disease self management – a systematic review of proactive telephone applications Carly Muller Dean Schillinger Division of General Internal Medicine.
Template: Making Effective Presentation about Your Evidence-based Health Promotion Program This template is intended for you to adapt to your own program.
Evidence Based Practices Lars Olsen, Director of Treatment and Intervention Programs Maine Department of Corrections September 4, 2008.
Introduction to the unit and mixed methods approaches to research Kerry Hood.
TRANSFORMING EDUCATION THROUGH EVIDENCE. The Centre for Effective Education SCHOOL OF Education Conducting Educational Randomised Control Trials in Disadvantaged.
Using RE-AIM as a tool for Program Evaluation From Research to Practice.
Transition to Practice Study: Outcomes Data Mary Blegen, PhD, RN, FAAN Mary Lynn, PhD, RN Phase II Site Coordinator Meeting February 1, 2012.
Reclaiming Futures as part of the OJJDP required Three-Year State Plan A Presentation to State SAGs Tom Begich.
Introduction Results and Conclusions Comparisons on the TITIS fidelity measure indicated a significant difference between the IT and AS models on the Staffing.
Program Evaluation and Measurement Janet Myers. Objectives for today… To define and explain concepts and terms used in program evaluation. To understand.
Succesful implementation of a multi- modal pressure ulcer prevention program in nursing homes Eva, Nuria, Luk, Theo, Cecile, Niina, Vivi, Antoinette.
2.11 Conduct Medication Management University Medical Center Health System Lubbock, TX Jason Mills, PharmD, RPh Assistant Director of Pharmacy.
Journal Club Alcohol and Health: Current Evidence May–June 2005.
Evaluation is a professional and ethical responsibility and is a core part of PHN professional practice Commitment to evaluation helps build the PHN intelligence.
Journal Club Alcohol, Other Drugs, and Health: Current Evidence January–February 2011.
1 Minority SA/HIV Initiative MAI Training SPF Step 3 – Planning Presented By: Tracy Johnson, CSAP’s Central CAPT Janer Hernandez, CSAP’s Northeast CAPT.
Presented By: Tracy Johnson, Central CAPT
Judith E. Voelkl, PhD, CTRS and Begum Aybar-Damali, MS chapter 12 Aging and the Life Span.
Evaluating Physical Activity Intervention Programs Thomas Schmid, PhD Physical Activity and Health Branch CDC Atlanta, Georgia, USA.
NATIONAL AND COMMUNITY MENTAL HEALTH PROGRAMME. AIMS OF NCMHP To ensure treatment and prevention of mental and neurological disorder. To ensure treatment.
TOOLS FOR POLICY DEVELOPMENT AND ANALYSIS Goals and Objectives.
DC Home visiting Implementation and impact evaluation
Studying treatment of suicidal ideation & attempts: Designs, Statistical Analysis, and Methodological Considerations Jill M. Harkavy-Friedman, Ph.D.
How to Develop the Right Research Questions for Program Evaluation
Queen’s University Initiative to Reduce Harmful Drinking Main Components Process Objectives Short-Term Outcome Objectives Long-Term Outcome Objectives.
Illinois EMSC1 Planning for Students with Special Health Care Needs Objectives Upon completion of this lecture, you will be better able to: Develop an.
Community Care and Wellness for Seniors
STUDY PLANNING & DESIGN TO ENHANCE TRANSLATION OF HEALTH BEHAVIOR RESEARCH Lisa Klesges, Russell Glasgow, Paul Estabrooks, David Dzewaltowski, Sheana Bull.
Opioid Misuse Prevention Program “OMPP” Strategic Planning Workshop
Evaluating Dissemination of AHRQ CER Products Darren Mays, PhD, MPH Department of Oncology Georgetown University Medical Center Lombardi Comprehensive.
Increasing CRC Screening among Filipino Americans (Maxwell, Bastani, Danao, Crespi, UCLA. ACS ) Recruitment of subjects in 45 CBOs and churches.
Nova Scotia Falls Prevention Update Preventing Falls Together Conference October 29, 2009 Suzanne Baker.
RE-AIM Plus To Evaluate Effective Dissemination of AHRQ CER Products Michele Heisler, MD, MPA September, 2011.
My Own Health Report: Case Study for Pragmatic Research Marcia Ory Texas A&M Health Science Center Presentation at: CPRRN Annual Grantee Meeting October.
Health & Welfare Council of Long Island May 12, 2010.
1 What are Monitoring and Evaluation? How do we think about M&E in the context of the LAM Project?
Implementation Science Vision 21: Linking Systems of Care June 2015 Lyman Legters.
2004 National Oral Health Conference Strategic Planning for Oral Health Programs B.J. Tatro, MSSW, PhD B.J. Tatro Consulting Scottsdale, Arizona.
The Alabama REACH Demonstration Project (ARDP) A case example using the RE-AIM model Lou Burgio, Ph.D. University of Alabama Center for Mental Health and.
Dissemination and Translation Breakout Session. 2 Translation and Diffusion Translation: the process by which EB programs become adopted, adapted, and.
Evidence-Based Public Health Selecting Evidence-Based Interventions Joanne Rinker 1.
Indicators for ACSM.
Integrating Knowledge Translation and Exchange into a grant Maureen Dobbins, RN, PhD SON, January 14, 2013.
Western NSW Integrated Care Strategy To transform existing services into an integrated Western NSW system of care that is tailored to the needs of our.
Integration of General Practice in Health services Doris Young Professor of General Practice.
Consultant Advance Research Team. Outline UNDERSTANDING M&E DATA NEEDS PEOPLE, PARTNERSHIP AND PLANNING 1.Organizational structures with HIV M&E functions.
+ Evidence Based Practice University of Utah Evidence-Based Treatment and Practice: New Opportunities to Bridge Clinical Research and Practice, Enhance.
Evaluation design and implementation Puja Myles
EVIDENCE BASED INTERVENTIONS (EBI) Why Diffusion and Dissemination of parent support and youth peer to peer interactive programs are important By Rogers.
RTI International RTI International is a trade name of Research Triangle Institute. Evaluation of the Office of Juvenile Justice and Delinquency.
Using Outcomes and other Assessment Tools to Improve Quality Quality Improvement.
Georgia Comprehensive Cancer Control Program 3/10/2015 Program Monitoring and Evaluation Activities Short-Term Outcomes Long-Term Outcomes Intermediate.
Open Forum: Scaling Up and Sustaining Interventions Moderator: Carol O'Donnell, NCER
Monika M. Safford, MD University of Alabama at Birmingham.
Resource Review for Teaching Resource Review for Teaching Victoria M. Rizzo, LCSW-R, PhD Jessica Seidman, LMSW Columbia University School of Social Work.
RE-AIM Framework. RE-AIM: A Framework for Health Promotion Planning, Implementation and Evaluation Are we reaching the intended audience? Is the program.
Implementation Science: Finding Common Ground and Perspectives Laura Reichenbach, Evidence Project, Population Council International Conference on Family.
Program Planning for Evidence-based Health Programs.
OSP REBECCA JOOSTENS, ELIZABETH KLYNSTRA, MARSHA THOMAS.
Health Care and Promotion Fund Project Expo 2006: Beginning with dissemination in mind: Characteristics of successful health promotion programs Dr. Charles.
Chapter 9 Case Management Copyright © 2015, 2011, 2007, 2001, 1997, 1993 by Saunders, an imprint of Elsevier Inc.
Testing the Feasibility and Impact of the Res-Care-CI Elizabeth Galik, MSN, CRNP University of Maryland School of Nursing AMDA 30th Annual Symposium March.
Stages of Research and Development
Incorporating Evaluation into a Clinical Project
Research Questions Does integration of behavioral health and primary care services, compared to simple co-location, improve patient-centered outcomes in.
Pre-implementation Processes Implementation, Adoption, and Utility of Family History in Diverse Care Settings Study Lori A. Orlando, MD MHS.
Quality Improvement Indicators and Targets
HMS Academy Fellowship in Medical Education Research June 2, 2016
Program Planning: Models and Theories
Presentation transcript:

Barbara Resnick, PhD, CRNP, FAAN, FAANP Understanding RE-AIM Barbara Resnick, PhD, CRNP, FAAN, FAANP

RE-AIM The Reach, Effectiveness, Adoption, Implementation, and Maintenance framework. 14 years old. The first RE-AIM publication was in the American Journal of Public Health in 1999. The model grew out of need for improved reporting on key issues related to implementation/real world research. Driven by work and teams within the BCC.

Definition of RE-AIM Components Dimension Indicators of Achievement Sources of Evidence Reach refers to the proportion of representativeness of the population targeted by the innovation. Recruitment of settings and participation of champions throughout the study; numbers of residents potentially reached. Site recruitment rates and class participation; total number of residents potentially impacted by function focused care. Efficacy refers to the extent to which the intervention improved outcomes of participants. Evidence of change in the environment, policy and service plans to optimize function and physical activity. Decreased falls and hospitalizations of residents. Measurement of the environment, policy and service plans; measurement of resident falls and hospital transfers in the month prior to and in the last month of the 12 month study period. Adoption refers to the proportion of organizations or settings that adopt the innovation. Setting willingness to provide a champion and work with the function focused care nurse on implementation activities; evidence of integration of function focused care. Setting identification of a champion and adherence of the champion to meetings and participation in function focused care activities; Evidence of changes in environment, policies and service plans.

Definition of RE-AIM Components Dimension Indicators of Achievement Sources of Evidence Implementation refers to evidence that the intervention was implemented as intended. Treatment fidelity based on delivery; and receipt. Delivery was based on evidence that all champions received the initial face- to-face training; evidence that the champions were provided with the resources to teach and raise awareness of function focused care among their staff, residents and families; completion of the environment and policy assessments and appropriate changes discussed; that champions received the weekly tidbits. Receipt was based on evidence that the champion used the Nasco gift certificate. Maintenance refers to the long term adherence to the intervention and transition of the intervention into routine care. Evidence of adherence to function focused care activities at the end of the 12 month study period. Evidence of changes in the environment and policies within settings that better reflect function focused care.

Challenges/Recommendations for Reach Not reporting characteristics of participants compared with nonparticipants. Not reporting on recruitment methods and implicit “screening/selection.” Not reporting on a “valid denominator.” Report on any criteria you can, even if it is just 1 characteristic.

Challenges/Recommendations for Efficacy Not reporting measurement of short-term or differential rates by participant characteristic or treatment group. Not reporting on broader effects (e.g., quality of life or unintended consequences). Measure of primary outcome relative to public health goal. Reporting of short-term loss to follow-up can easily be added to CONSORT figures. Use national guidelines (Healthy People 2020).

Adoption Not reporting percent of settings approached that participated based on a valid denominator. Not reporting recruitment of setting details and exclusion criteria (e.g., only picking optimal sites). Use of a valid denominator at the setting level can be challenging. Use any information you can. At minimum, report the sampling frame from which your settings were selected and percentage of participation.

Implementation Not reporting adaptations made to interventions during study. Not reporting on costs and resources required. Not reporting differences in implementation or outcomes by different staff. Report any changes that made the intervention easier to delivery or to fit into real world settings. Remember, this is not the same as fidelity.

Maintenance Not reporting results of long-term broader outcomes, such as quality of life or unintended outcomes. Reporting broader outcomes provides a context in which to evaluate the long-term primary outcome results.

Results Reach: 300 settings invited: 99 sites (33%) volunteered and 38 attended the initial face-to-face (28% of sites). Potentially impacted 3,676 older adults.

Efficacy : Descriptive Outcomes at Baseline and Follow up Variable Baseline Follow-up F(p)* Falls 12.00 (16.21) 9.33(16.40) 4.1(.05)* Hospitalizations 2.60(2.61) 2.27(4.76) .11(.74) Emergency Room Visits 1.69(1.25) 1.92(2.43) .09(.76) Policy 4.15(3.70) 10.79(4.07) 78.22(.00)* Environment: Positive Subscale .12 (.33) .03(.17) 22.34(.001)* Environment: Negative Subscale .12(.33) 3.19(.08)

RE-AIM Results Adoption : 21 settings (21%) did not participate. Implementation : all components implemented in 79 sites. Did not consider costs. Maintenance: through 12 months positive qualitative findings; enduring environment and policy changes.

Have to have champion and site buy in Challenges/Opportunities Identified With Regard to Dissemination and Implementation Work Have to be flexible and meet the needs of each setting (ex. We revised materials for them; wrote policies) Utilize measures that are practical and real world (ex. falls and hospitalizations versus actigraphy) Have to have champion and site buy in