1. Building Capacity to Assess the Evidence for Health Policy Strategies Colleen Barbero American Evaluation Association October 19, 2013

2. Co-authors: Siobhan Gilchrist, Columbus Technologies Michael W. Schooley, Centers for Disease Control and Prevention Dr. Douglas A. Luke, Washington University in St. Louis Dr. Amy A. Eyler, Washington University in St. Louis Dr. Jamie F. Chriqui, University of Illinois at Chicago

3. What is Evidence-Based Public Health? Image Source: http://library.downstate.edu/EBM2/2100.htm. Accessed October 17, 2012.

4. How Evidence-Based Are Policies? Image Source: http://www.cdc.gov/dhdsp/pubs/docs/CHW_State_Laws.pdf. Accessed October 13, 2013.

5. Evidence-Based Policy Interventions

6. Project Goals

7. 1) Assess the strength of the evidence basis for chronic disease policy interventions

8. Project Goals 1) Assess the strength of the evidence basis for chronic disease policy interventions 2) Identify policy interventions with the most potential for public health impact

9. Presentation Outline Image Source: http://ucwbling.chicagolandwritingcenters.org/help-how-do-i-give-a-presentation-five-takeaways-from-the-cmwrs- workshop/. Accessed October 14, 2013.

10. Presentation Outline  Present approach for assessing policy evidence

11. Presentation Outline  Present approach for assessing policy evidence  Share results from field pilot

12. Presentation Outline  Present approach for assessing policy evidence  Share results from field pilot  Discuss next steps for translation and dissemination

13. Policy Evidence Assessment Approach Image Source: http://www.formula.com/services/mcsi.htm

14. Policy Evidence Assessment Approach

18. What Counts As Policy Evidence?

19. Assessing Policy Evidence Quality Image Source: http://www.cpredi.com/quality/. Accessed October 14, 2013.

20. Assessing Policy Evidence Quality Tool #1: Evidence Quality Assessment Tool

21. Assessing Policy Evidence Quality Tool #1: Evidence Quality Assessment Tool What it does: Rates the quality of an evidence base for a public health policy intervention

22. Evidence Quality Tool Domains

23.  Study Design - scientific rigor Evidence Quality Tool Domains

24.  Study Design - scientific rigor  Source - credibility Evidence Quality Tool Domains

25.  Study Design - scientific rigor  Source - credibility  Practice and Theory Basis - derived from practice and theory Evidence Quality Tool Domains

26.  Study Design - scientific rigor  Source - credibility  Practice and Theory Basis - derived from practice and theory  R esearch Basis - derived from research Evidence Quality Tool Domains

28. Assessing Evidence of Policy Public Health Impact Image Source: http://www.cloudave.com/10287/implementing-enterprise-2-0-at-penn-state-university-part-five-impact-future- plans-and-lessons/. Accessed October 14, 2013.

29. Assessing Evidence of Policy Public Health Impact Tool #2: Evidence of Public Health Impact Assessment Tool

30. Assessing Evidence of Policy Public Health Impact Tool #2: Evidence of Public Health Impact Assessment Tool What it does: Rates the potential public health impact of a policy intervention according to the evidence

31. Evidence of Public Health Impact Tool Domains

32.  Health Impact - health or health-related Evidence of Public Health Impact Tool Domains

33.  Health Impact - health or health-related  Reach - broad or narrow? Evidence of Public Health Impact Tool Domains

34.  Health Impact - health or health-related  Reach - broad or narrow?  Equity - impact on disparate groups Evidence of Public Health Impact Tool Domains

35.  Health Impact - health or health-related  Reach - broad or narrow?  Equity - impact on disparate groups  Efficiency - best use of resources? Evidence of Public Health Impact Tool Domains

36.  Health Impact - health or health-related  Reach - broad or narrow?  Equity - impact on disparate groups  Efficiency - best use of resources?  Transferability - effectiveness across settings Evidence of Public Health Impact Tool Domains

38. Evidence Quality

39. Evidence of Public Health Impact

40. Evidence Quality and Evidence of Public Health Impact

41. Emerging

42. Promising Impact

43. Promising Quality

44. Best

45. Evidence-Based Interventions

46. Public Access Defibrillation Defibrillation

47. Field Pilot Image Source: http://lisacullen.com/2012/11/12/i-sold-a-tv-pilot-heres-how-it-happened. Accessed October 16, 2013.

48. Field Pilot  Purpose = evaluate how usable and useful the approach is for primary and secondary intended users in the field

49. Field Pilot  Purpose = evaluate how usable and useful the approach is for primary and secondary intended users in the field  Primary users = public health policy researchers and evaluators

50. Field Pilot  Purpose = evaluate how usable and useful the approach is for primary and secondary users in the field  Primary users = public health policy researchers and evaluators  Secondary users = public health practitioners

51. Researcher/Evaluator Feedback Image Source: http://www.mphi.org/serviceofferingsubarea.aspx?id=45. Accessed October 14, 2013.

52. Researcher/Evaluator Feedback

58. Violence and Injury Prevention Results

59. Practitioner Feedback Image Source: http://www.achievecommunities.org/. Accessed October 14, 2013.

60. Practitioner Feedback

65. Image Source: http://mwerickson.files.wordpress.com/2011/05/taking-the-next-step-graphic.jpg. Accessed October 14, 2013.

66. Next steps  Publish approach

67. Next steps  Publish approach  Partner with practitioners to complete assessments

68. Next steps  Publish approach  Partner with practitioners to complete assessments  Host educational webinar

69. Next steps  Publish approach  Partner with practitioners to complete assessments  Host educational webinar  Develop web-based tool

70. Questions? For more information please contact: Colleen Barbero Telephone: 314-935-3783 E-mail: cbarbero@brownschool.wustl.educbarbero@brownschool.wustl.edu