1. Interpreting Safety Culture Survey Data and Using Results for Improvement Sallie J. Weaver, PhD

2. Roadmap 1.I have data….but now what? 2.Some food for thought regarding next steps and debriefing survey results Armstrong Institute for Patient Safety and Quality 2

3. Poll question Have you (or your team’s survey coordinator) downloaded or reviewed the HSOPS “aggregate report” for your work area? –Yes –No Armstrong Institute for Patient Safety and Quality 3

4. Overall Picture…usually I put the overall baseline scores in chart for a given project/cohort and show it here…is there a chart like this for VAP that you want to show? Armstrong Institute for Patient Safety and Quality 4

5. Remember: Culture is Local Armstrong Institute for Patient Safety and Quality 5

6. UNDERSTANDING THE HSOPS AGGREGATE REPORT Part I Armstrong Institute for Patient Safety and Quality 6

7. 7 Survey Coordinators can download HSOPS report(s) from: https://armstrongresearch.hopkinsmedicine.org Survey Coordinators can download HSOPS report(s) from: https://armstrongresearch.hopkinsmedicine.org

8. 8 Select the work area that you want to manage Pre-Op

9. 9 100 80 80%0

10. HSOPS Aggregate Report 10

11. 11

12. Who completed the survey: Pg. 2-4 Armstrong Institute for Patient Safety and Quality 12 80% (n = 80)

13. 13 Composite Score: Pg. 6-7 Scores = Percent positive responses Interpreting Composite Scores: The big picture view Higher is better

14. 14 Composite Score: Pg. 6-7 Scores = Percent positive responses Interpreting Composite Scores: The big picture view Higher is better

15. Questions: Pg. 8-25 Percent positive = Green Percent neutral = Yellow Percent negative = Red 15

16. Questions provide a deeper dive: For positively worded items, more green is better Armstrong Institute for Patient Safety and Quality 16

17. Questions: Pg. 8-25 17 *For negatively worded items, more RED is better

18. Questions provide a deeper dive: * For negatively worded items, more RED is better Armstrong Institute for Patient Safety and Quality 18

19. USING THE CUSP CULTURE CHECK- UP TOOL TO DEBRIEF SURVEY RESULTS Part II Armstrong Institute for Patient Safety and Quality 19

20. CUSP Culture Check-Up Tool What is the Purpose of this Tool? –Understand the culture of the unit –Use teammates’ feedback to predict barriers to change and avoid them –Use feedback to make the most of the team’s strengths Who Should Use this Tool? –Safety culture debriefing facilitators Use this tool to help guide the discussion and record group decisions Armstrong Institute for Patient Safety and Quality 20

21. How Do I Use this Tool? –Share culture results with everyone on the unit Bring together team members from your work area Follow your debriefing plan –Take notes and recognize recurring themes –Purpose = Open, honest discussion about ideas to make the culture of your work area the best it can be –Focus on identifying system issues that the group can work on improving together instead of individuals NOT used to point fingers at specific individuals –Use the tool to structure meetings and guide conversation –As a group, complete all steps in this worksheet Armstrong Institute for Patient Safety and Quality 21 CUSP Culture Check-Up Tool

22. Steps in CUSP Culture Check-Up Tool STEP 1: Your team identifies the general strengths and weaknesses of your unit culture. STEP 2: Your team identifies the specific behaviors and attitudes that make up those strengths and weaknesses. STEP 3: Debriefing facilitator encourages group reflection. Your team chooses opportunities for growth, understanding that cultural strengths can help fix cultural weaknesses. STEP 4: Your team identifies a strategy for fixing the opportunities selected in step three. –AHRQ recommends creating ‘safety briefings’ – short updates for frontline teammates about patient safety issues in the work are. For more ideas, go to: http://www.ahrq.gov/qual/patientsafetyculture/hospimpdim.htm. http://www.ahrq.gov/qual/patientsafetyculture/hospimpdim.htm STEP 5: Your team works out the details of putting strategy into action. STEP 6: Your team evaluates your plans. Be sure to meet again and check in on progress at your SUSP team meetings Armstrong Institute for Patient Safety and Quality 22

23. Armstrong Institute for Patient Safety and Quality 23 The “Culture Check Up Tool” = Word Document that Debriefing Facilitator can use to guide conversation & improvement planning

24. Armstrong Institute for Patient Safety and Quality 24

25. Next Steps: Implementing your team’s HSOPS Debriefing Plan Debriefing is… –A semi-structured conversation among frontline clinicians and staff that is usually led by a designated facilitator Purpose… 1.Encourage open communication, transparency, and interactive discussion about the survey results Across all levels 2.To engage clinicians and staff in generating and implementing their ideas about how to create an effective safety culture in their work area Armstrong Institute for Patient Safety and Quality 25

26. Some points to cover in your debriefing plan Armstrong Institute for Patient Safety and Quality 26

27. Recent Finding #2: CUSP teams that debrief around safety culture perform better Data is data –Debriefing turns data into information Debriefing accelerates improvement Units who used semi- structured debriefing of culture survey 10.2% Reduction in Infection Rates Units who did not debrief survey results 2.2% Reduction in Infection Rates Vigorito MC, McNicoll L, Adams L, Sexton B. Improving safety culture results in Rhode Island ICUs: lessons learned from the development of action-oriented plans. Jt Comm J Qual Patient Saf. 2011 Nov;37(11):509-14.

28. Changing Culture in Practice: National CLABSI Project Example Baseline HSOPS survey Target non-punitive response to error What did they do? –Clarified the language and definitions of events, errors, glitches with all unit clinicians & staff Education campaign to define and differentiate process errors (e.g., expected behavior not clear, not known) from intentional violations Created shared mental model about expected safety behavior, as well as what to report, when, and when/how to follow-up Follow up…hot off the presses! Non-punitive response, communication openness, supervisor support Armstrong Institute for Patient Safety and Quality 28

29. In Sum 1.Review the survey report for your unit 2.Can be helpful to distill the report down into 3-5 key slides 3.Decide when, how, and where to debrief your teammates (and leaders) on these results Be prepared to listen Ask for feedback Ask teammates to help come up with solutions 4.Gather a small group together and use the “culture debriefing tool” to examine the roots of problem areas and begin to formulate strategies for improvement 29

30. Thank you! 30