1. Dashboards and Reports Rachel S Dokholyan, MPH

2. Dashboards and Reports Nothing to disclose

3. Dashboards and Reports – Current Reports n ‘State-of-the-art’ statistical analyses n ‘Out-of-date’ report delivery and format: l Single PDF document l 100+ pages l Static content – not customizable l Quarterly and twice annual only

4. Demand for Customizable Reports – Survey 2014 Q 3.1 Are you or your institution interested in the ability to query the STS data yourself? Overall RespondentsSurgeon Respondents

5. Demand for customizable reports Likelihood of using and time commitment per quarter Q 3.3 How likely is it that you would use a query/customization tool to review your STS data? Q 3.4 If very likely or somewhat likely, how much time would you be willing/able to spend per quarter using this functionality?

6. Dashboards and Reports – Directions in 2016 n Web-based reporting n Daily updates (dashboard)

7. Dashboards and Reports – Web-based reporting n Username/password access l Same as currently used to download reports and sign in to data collection modules l Content access managed at the individual level n Tableau™ IT data visualization solution l Ability to customize table/figures l Ability to download PDF/Excel versions l Smartphone app available

8. Dashboards and Reports – Tableau example n Here

9. Dashboards and Reports – Patient drill-down n Ability to drill down to patient level n Click on number…. n List of patients with direct identifiers provided

10. Dashboards and Reports – Patient drill-down n Here

13. Dashboards and Reports – Customization n Ability to l Select parameters l Apply filters l Select time period

14. Customization

15. Customization

16. Expanded Graphics

17. Dashboards and Reports – Daily Updates n Participant dashboard to be updated nightly l Will include any new data submitted during that day Participant data only l National benchmarks updated: Quarterly (ACSD) Twice annually (CHSD and GTSD) l Complex (hierarchical) risk-adjustment (e.g. Star Rating) updated with national benchmarks

18. Dashboards and Reports – Daily Updates n Participant data we expect to provide to you nightly l Frequency of pre-op risk factors l Frequency of intraoperative variables l Observed rate of complications and mortality l Observed to expected ratio (O/E) for model outcomes n Participant data we will NOT provide nightly l Estimated odds ratios for endpoints (hierarchical) l Risk-adjusted endpoints that require estimated odds ratio

19. Dashboards and Reports – Training n Quick Reference Document: l An educational resource that will be available in a PDF format for e ‐ mail distribution and/or posting to the STS website. n Multi-media training module: l Designed to introduce users to the system and its functionality. Will be posted on STS website. n Frequently Asked Questions (FAQ): l A frequently asked questions resource about the on-line reporting environment.

20. Dashboards and Reports – Timeline n 2015: l Content selection begins n 2016: l Adult Cardiac Surgery Database n 2017: l Congenital Heart Surgery Database l General Thoracic Surgery Database

21. Dashboards and Reports – Report Content n 2014 Report Survey identified some content needs n Group of surgeons and core data managers will help select priority content and needed data visualization functionality

22. What is dashboard-worthy? Q 3.2 Which parameters would you like to be able to select for your reports/queries? (Select all that apply)

23. Best time interval for QI review? Q 3.2 Which parameters would you like to be able to select for your reports/queries? (Select all that apply) Answer% Rolling 6 months30% Rolling 12 months42% Calendar year20% Other8% One size definitely does not fit all….

24. Dashboards and Reports – Timeline n 2016: l January – June Pilot test: FeasibilityUsability Content selection l July – December Roll out to all ACSD participants Expand to include all ACSD report content

25. Dashboards and Reports – Timeline n 2017: l January – June Congenital Heart Surgery Database Pilot (possible) Rollout l July – December General Thoracic Heart Surgery Database Pilot (possible) Rollout

26. Dashboards and Reports – Future directions n On-line Data Quality Report n On-line Regional or 3 rd Party Reports