Translating Aspiration to Operation: Developing Active Implementation Capacity and Infrastructure W. Oscar Fleming; MSPH Tuesday, September 29 th 2:30-4:00pm (repeat 4:15 – 5:30pm).

Agenda 1.Orientation to Implementation Science 2.Introduction to the Active Implementation Frameworks 3.Reflection and Action Planning Objectives: Participants will: Learn the definition and purpose of implementation science. Understand and apply the Active Implementation to contextually relevant Title V opportunities. Plan for further learning & action in support of local Title V programs. 2

Methodology Brief content review Individual and Small group Application Group reflecting and discussion

Introduction & Affiliations MCH Workforce Development Center offers: State and territorial Title V leaders training, collaborative learning, coaching and consultation in implementing health reform. Cutting edge tools and techniques No Cost to States/Territories National Implementation Research Network (NIRN) provides technical Assistance and collaborative research to… Advance the science of implementation across human service domains. Inform policies that promote implementation science and best practices in human services. Ensure that the voices and experiences of diverse communities and consumers influence and guide implementation efforts.

Definition Implementation: A specified set of activities designed to put into practice an activity or program of known dimensions 1

Why it Matters Women, children and families do not benefit from interventions they do not receive. Developing and identifying evidence-based/informed programs and practices has improved significantly… The science and practice of Implementing these programs with fidelity, in real-world settings, has lagged behind… …but the science is emerging rapidly

Evolution of the Science Letting it happen – Diffusion; networking; communication Helping it happen – Dissemination; manuals; websites Making it happen – Purposeful and proactive use of implementation practice and science

System: Policy and Infrastructure Organizational Leadership Site Leadership Providers Constituents External Supports Systems Context Funding Policy Culture History Economy Know How

A word on Evidence… Implementation is at the nexus of evidenced-based practice and practice-based evidence. Evidence can be co-created Regardless of what you are working with, the implementation science can inform what you do and how you do it

Contextualize Have in mind an NPM and related programs you are considering as we work through the Active implementation Frameworks

Effective Interventions Effective Implementation Enabling Contexts Significant Outcomes Implementation Equation

Active Implementation Frameworks Frameworks Usable Interventions Stages Teams Drivers Improvement Cycles

The “How” Implementation Stages: Describe and guide how the work unfolds over time. Implementation Drivers: Identify the capacity and infrastructure linked to effective intervention delivery across the stages. Effective Implementation StagesDrivers

ExplorationInstallation Initial Implementation Full Implementation 2-4 Years Implementation Stages Stages

Applied Exploration

Pulse Check Discuss: – How will you gather the necessary information to compare and contrast alternative programs? – Who will be involved? Capture: – What are your next steps? Stages

The “Who” Implementation Teams: Integrate the use of implementation stages, drivers and improvement cycles to support the implementation, sustainability, and scale- up of usable interventions Teams “MAKE IT HAPPEN ” Effective Implementation

Site Implementation Team Regional Implementation Team State Implementation Team State Implementation Team Implementation Teams have… -Competencies Know the Interventions/Programs Know and apply Implementation Science (e.g. AI Frameworks) Facilitate Organization and Systems Change –Minimum of three people four or more preferred Teams Implementation Teams

EFFECTIVE INTERVENTIONS YESNO 80% 3 Years 14% 17 Years EXPERT IMPLEMENTATION TEAM? Implementation Teams (Balas & Boren, 2000; Green, 2008) (Fixsen, Blase, Timbers, & Wolf, 2001) (Saldana & Chamberlain, 2012) Evidence

Imp. ComponentTime 1Time 2Time 3 Selection Training Coaching Fidelity Assessment DSDS Fac. Administration Systems Intervention Average Composite Score Fidelity (% of cases) 18%83% Metz, et al. (2013). Stages, Drivers, & Teams Evidence Teams

Pulse Check Discuss: – Who can be engaged in an Implementation Team to support more effective intervention selection, preparation, delivery and improvement? Capture: – What’s your next step? Teams

All too often…

The “What” Neither “Rigorous evidence” for evidence-based/informed interventions nor promising results from emerging practice is enough… Interventions must be teachable, learnable, doable, assessable, and repeatable in practice Effective Interventions

The “What” 1.Clear Description of the program  Philosophy, values, principles  Inclusion – exclusion criteria 2.Identified Core Components (aka, active ingredients, essential functions) 3.Operational Definitions of core intervention components (what practitioners do, say) 4.Practical Fidelity Assessment Operational Definitions Clear Description Performance Assessment Essential Functions Usable Interventions

Pulse Check Discuss: – How could you use the Usable intervention criteria in the context of developing your local strategies? Capture: – What’s your role? What could you do differently?

The “How” Implementation Stages: Describe and guide how the work unfolds over time. Implementation Drivers: Identify the capacity and infrastructure linked to effective intervention delivery across the stages. Effective Implementation StagesDrivers

ExplorationInstallation Initial Implementation Full Implementation 2-4 Years Implementation Stages Stages

Fidelity Assessment Coaching Training Selection Systems Intervention Facilitative Administration Decision Support Data System Competency Drivers Organization Drivers Leadership Drivers Consistent Uses of Innovations Reliable Benefits Integrated & Compensatory Implementation Drivers Effective Implementation

Competency Drivers  Build provider confidence and competence to deliver intervention with fidelity – Selection – Training – Coaching – Fidelity Assessment

Organizational Drivers  Align organizational and system resources to support high fidelity delivery -Decision Support Data System -Facilitative Administration -Systems Intervention

Leadership Drivers Promote Active Implementation – Communicate importance of effective implementation methods Support Learning – Encourage learning from success and failure Respond appropriately – Recognize adaptive from technical challenges Sustain Attention & Resources – Keep goals in focus and resourced

ExplorationInstallation Initial Implementation Full Implementation Assess needs Examine intervention components Consider Implementation Drivers Assess fit Assess needs Examine intervention components Consider Implementation Drivers Assess fit Acquire Resources Prepare Organization Prepare Implementation Drivers Prepare staff Acquire Resources Prepare Organization Prepare Implementation Drivers Prepare staff Activate Data Systems Manage change Strengthen Implementation Drivers Initiate Improvement Cycles Activate Data Systems Manage change Strengthen Implementation Drivers Initiate Improvement Cycles Achieve and improve Fidelity and Outcomes Monitor & manage Implementation Drivers Achieve and improve Fidelity and Outcomes Monitor & manage Implementation Drivers Drivers and Stages Together Effective Implementation 2-4 Years

Drivers Assessment A comprehensive evaluation model of a practice/program measures the following: ImpactFidelity CapacityScale How well are we implementing Project XYZ’s critical components as intended? How many communities are implementing Project XYZ? And what is their current stage of implementation? How well are we using evidence-based implementation processes to support the use of the Project XYZ model? How are intended outcomes improving?

Drivers Assessment ImpactFidelity CapacityScale How well are we using evidence-based implementation processes to support the use of the Project REACH model? Drivers Best Practices Assessment measures the capacity of local sites to implement evidence-based programs.

Drivers Assessment Composite Scores for each Driver: – Assign values to “in place” (2), “partially in place” (1), and “not in place” (0) – Add values together – Divide the total value by the number of items in each scale

Pulse Check Discuss – Which drivers need more attention in your context? Capture: – What are your next steps?

Quality Improvement “Getting Started, Getting Better” Rapid Cycle Improvement Usability Testing Practice Policy Feedback Loops Enabling Contexts

Form Supports Function Policy Practice Do External Implementation Support Policy Practice Structure Procedure StudyAct Practice Informs Policy Policy Enables Practice Plan Practice Policy Feedback Loops Quality Improvement

Pulse Check Are robust practice policy feedback loops in place? What’s your role? What could you do differently? Teams

Discussion

Oscar Fleming Additional Resources Website: Website: Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M. & Wallace, F. (2005). Implementation Research: A Synthesis of the Literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231). Implementation Research: A Synthesis of the Literature

Health Resources and Services Administration (Maternal and Child Health Workforce Development Center) Annie E. Casey Foundation (EBPs and Cultural Competence) William T. Grant Foundation (Implementation Literature Review) Substance Abuse and Mental Health Services Administration (Implementation Strategies Grants; National Implementation Awards) Centers for Disease Control & Prevention (Implementation Research) National Institute of Mental Health (Research And Training Grants) Juvenile Justice and Delinquency Prevention (Program Development And Evaluation Grants) Office of Special Education Programs (Scaling up and Capacity Development Center) Administration for Children and Families (Child Welfare Leadership; Capacity Development Center) The Duke Endowment (Child Welfare Reform) Recognition

©Copyright Oscar Fleming, Dean Fixsen and Karen Blase This content is licensed under Creative Commons license CC BY-NC-ND, Attribution-NonCommercial- NoDerivs. You are free to share, copy, distribute and transmit the work under the following conditions: Attribution — You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work); Noncommercial — You may not use this work for commercial purposes; No Derivative Works — You may not alter or transform this work. Any of the above conditions can be waived if you get permission from the copyright holder.