Presentation on theme: "Using the Evidence Base to Improve Local Public Health Practice"— Presentation transcript:
1 Using the Evidence Base to Improve Local Public Health Practice Katie Duggan, MPH, MS, RD, Manager of Special Projects, The Prevention Research Center in St. Louis, St. Louis, MO Dorothy Cilenti, DrPH, MPH, MSW, Assistant Professor UNC Gillings School of Global Public Health, Chapel Hill, NCModerator: Paul C. Erwin, MD, DrPH, University of Tennessee
2 Evidence-Based Public Health The integration of science-based interventions with community preferences to improve the health of populations (Kohatsu ND, Am J Prev Med. 2004)Relevance to PHAB Standard 10: “Contribute to and apply the evidence base of public health”Relevance to Essential Service 10: “Evaluates the development, implementation, and impact of LPHS research efforts on public health practice.”
3 Evidence-Based Public Health What is it?Evidence-Based PracticeAdministrative Evidence-Based PracticesEvidence-Based Decision MakingPractice-Based ResearchHow is it measured?Who is involved?What works?
4 Local Evidence Affecting Decisions IN Public Health Project LEADKatie Duggan, MPH, MS, RD, Manager of Special Projects, The Prevention Research Center in St. Louis, St. Louis, MOLocal Evidence Affecting Decisions IN Public Health
5 Acknowledgements Robert Wood Johnson Foundation National Coordinating Center for PHSSR + University of Kentucky in LexingtonProject Team:Katie Stamatakis, PhD MPHRodrigo Reis, PhD MScCarolyn Leep, MPHBeth Dodson, PhD MPHKatie Duggan, MPH MS RDPaul Erwin, DrPH MDPeg Allen, PhD MPHRoss Brownson, PhDJenine Harris, PhDCarson Smith, MPARobert Fields, BS
6 What are we trying to achieve? - “Evidence-based public health is the process of integrating science-based interventions with community preferences to improve the health of populations.”Kohatsu, et al. Am J Prev Med 2004
7 But, more than only interventions… from PHSSR, administrative EBPs - Agency (health department)-level structures and activities that are positively associated with performance measures (e.g., achieving core public health functions, carrying out evidence-based interventions).
8 What is Project LEAD? 4 Aims: Describe the evidence-base for local EBPH in the United States (esp. A-EBPs)Test the effectiveness of local-level EBPH capacity building in 4 statesDescribe a range of local models in EBPHTranslate and disseminate findings to stakeholders
9 A few early findings for Aim 1 Online survey was sent to 967 LHDs517 completed surveys were returned (54% response rate)68% with top health official, 23% with deputy
11 Preliminary ResultsPatterns of A-EBPs and use of EBDM vary significantly based on:Population size served by the LHD (strongest predictors after adjustment)Governance structure (state governed)Age group in the 50s
12 Use of resources26% of LHDs reported systematic reviews as 1 of top 3 most important resources33.5% were not familiar with the Community Guide
13 Most important resources for decision making Funding guidance (57%)Guidance from state health agency (53%)Health Planning tools e.g., MAPP or Healthy People (42%)Success stories or lessons learned from peers (42%)
14 How do LHDS learn about public health findings? Professional Associations (56%)Seminars or workshops (52%)alerts (34%)Academic journals (31%)
15 Top Read Journals American Journal of Public Health (22%) Morbidity Mortality Weekly Report (21%)Journal of Public Health Management and Practice (12.4%)Public Health Reports (10.5%)Of those who listed Journals as 1 of their top resources these are the journals most often read
16 Evidence-Based Interventions 21% reported EBDM was packaged in a way that is usable18% felt they are designed in a way to be self-sustaining25% agreed EBDM is easy to understand in their agency
17 What encourages use of EBDM in LHD’s? Trainings in EBDM (83%)High priority placed by Leadership (67%)Positive feedback or encouragement to use EBDM (45%)A performance evaluation that considers the use of EBDM (45%)
18 Factors Contributing to Successful Implementation of Evidence-Based Public Health Practice: Findings from Case Studies of Four Local Health DepartmentsDorothy Cilenti, DrPH, Ross C. Brownson, PhD, Karl Umble, PhD, Paul Campbell Erwin, MD, DrPH, Rosemary Summers DrPH
19 AcknowledgementsFunding: University of Kentucky National Coordinating Center for Public Health Systems and Services Research and the Robert Wood Johnson FoundationProject team: The authors would like to recognize Matthew Schnupp, MSPH, BSN, RN for his assistance with the literature review and data collection activities.Study participants: We would also like to thank the local health departments and academic researchers who were interviewed as part of this study.
20 Study ObjectivesTo describe factors which contribute to successful translation of science to practice in public health agencies
21 Theoretical Framework Study utilized the Consolidated Framework for Implementation Research (CFIR)* which integrates 19 models of innovation, dissemination and implementation into five domains:Intervention CharacteristicsOuter SettingInner SettingIndividual CharacteristicsProcess of Implementation*Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science Aug 2009; 4 (50).
22 MethodsFour health departments with special knowledge or insight into the issue of interest were identified through discussions with key informants from PBRNs, PRCs, academic health departments, and the CDC.The research team conducted structured interviews with key informants in the four health departments and with four corresponding partners from academic institutions.Interviews were recorded and transcribed, and a thematic analysis of codes was conducted using Atlas TI
23 Description of Case Study Sites County A: Home to large state university housing a College of Medicine and a state-authority local public health agency with 48 million budget and 640 positions serving a southeastern city with more than 1 million residents.County B: Home to a large state university housing a College of Public Health and a local public health agency employing 45 individuals in a Midwestern city serving 240,000 residents. The agency has a 5 million dollar budget comprised of 67% local funding.
24 Description of Case Study Sites City C: Home to a local public health agency employing 258 individuals serving 600,000 residents in a metropolitan area of the Midwest. A large state university housing a School of Medicine and Public Health is located in another city. The agency has an annual budget of 26 million dollars, with 50% of funding from local taxes.County D: Home to a local public health agency employing 134 individuals serving 300,000 residents in a medium-size metropolitan area in the Northeast. A large private university housing a School of Public Health is located in an urban city approximately two hours from the health department. The agency’s annual budget is approximately 36 million.
25 FindingsEight faculty members from academic institutions and 14 public health executives and senior leaders were interviewed across the four sites. Several themes emerged that were consistent with the CFIR.
26 ThemesOuter setting:Health departments and academic partners were WIDELY NETWORKED with external organizations such as NACCHO, PBRNs, etc.Staff were given ample opportunities to assume BOUNDARY-SPANNING ROLES including adjunct appointments; faculty also assumed roles within health departmentsAcademic departments made INVESTMENTS in faculty engaging in practice-related activitiesDecisions to disseminate, adopt and implement EBP was directly related to MEETING COMMUNITY NEEDS and AVAILABILITY OF ADDITIONAL RESOURCES to meet those needsImplementation of EBP was also driven by EXTERNAL POLICIES AND INCENTIVES, such as federal and state program mandates, accreditation, etc.
27 ThemesInner Setting:Health departments established DEDICATED INTERNAL UNITS to provide data support for programs, identify grant opportunities, research evidence-based practices and provide evaluation services.Health departments hired EMPLOYEES TRAINED IN EPIDEMIOLOGY AND BIOSTATISTICS and extended this expertise to community-based organizations.Academic institutions funded FORMAL STRUCTURES within their schools to facilitate communication and collaborative work with local health departmentsHealth departments identified FUNDING FOR STAFF TRAINING AND COMPUTER TECHNOLOGY and allowed time for staff to pursue training.
28 Themes Process of Implementation: Health departments and academic partners emphasized the important of ENGAGING LEADERSHIP AND STAFF to implement evidence-based practiceSuccessful implementation was typically integrated with a QUALITY IMPROVEMENT APPROACH
29 Summary Seven Take-Aways: Link the evidence-based practice to a visible, high-priority community needMaintain strong networks with professional organizations and peersLeverage use of EBP through federal and state program mandates, funding, and accreditationBuild strong political support for application of science-driven approachesInvest in dedicated resources and staff for research and data capacityEstablish strong communication channels between researchers and practitioners and between agency staff and agency leadersIdentify funds for implementation of evidence-based policies and practices.
30 Where to Go from Here Make use of theory and frameworks Develop measures to track health department implementation of evidence-based practiceDevelop tracer conditions to measure and track over time, such as specific organizational, structural, financial, workforce and governance-related changesConduct systems research to identify where practitioners and researchers may make organizational changes to create cultures that facilitate implementation of evidence-based practice
32 DiscussionDo the themes from the case studies and project LEAD resonate with you?Think about health depts. that stand out as leaders in EBDM…..are there other characteristics or factors that seem to help them be high performers in this area? What has enabled you to utilize EBDM?What are the barriers to EBDM?How can we address these barriers?
33 Discussion What do you currently see as the deficits in training? How can we address these deficits?What are your preferred methods for training?And thinking about a successful training that you have been to, what would you say made that training successful?What ONE next thing might you do in your health agencies when you leave the conference to move your agency along in EBDM?
34 Using the Evidence Base to Improve Local Public Health Practice Katie Duggan, MPH, MS, RD, Manager of Special Projects, The Prevention Research Center in St. Louis, St. Louis, MO Dorothy Cilenti, DrPH, MPH, MSW, Assistant Professor UNC Gillings School of Global Public Health, Chapel Hill, NC