Presentation on theme: "Effectiveness of key indicators as instrument in detecting risks in healthcare Ine Borghans."— Presentation transcript:
Effectiveness of key indicators as instrument in detecting risks in healthcare Ine Borghans
2 Methods of Supervision Thematic Incidences Quality system Risk Indicators Suspicions criminal offenses
3 Methods of Supervision Thematic Incidences Quality system Risk Indicators Suspicions criminal offenses
4 Risk indicators Used in ‘Risk-based' supervision To render the risk of healthcare services measurable and transparent. Developed in cooperation with the health care providers.
6 Canary indicator of the coal mine
7 Hospital adverse events often result in a longer length of stay (see references on next slide) We developed a new indicator that uses the unexpectedly long length of stay (UL-LOS) as a potential risk factor for unsafe care.
References 1.Hoonhout LH, de Bruijne MC, Wagner C, Asscheman H, van der Wal G, van Tulder MW. Nature, occurrence and consequences of medication-related adverse events during hospitalization: a retrospective chart review in the Netherlands. Drug Saf /01;33(10): Hoonhout LH, de Bruijne MC, Wagner C, Zegers M, Waaijman R, Spreeuwenberg P, et al. Direct medical costs of adverse events in Dutch hospitals. BMC Health Serv.Res. 2009;9:27. 3.Sari AB, Sheldon TA, Cracknell A, Turnbull A, Dobson Y, Grant C, et al. Extent, nature and consequences of adverse events: results of a retrospective casenote review in a large NHS hospital. Qual.Saf Health Care ;16(6): Ehsani JP, Jackson T, Duckett SJ. The incidence and cost of adverse events in Victorian hospitals Med.J.Aust /05;184(11): Cho SH, Ketefian S, Barkauskas VH, Smith DG. The effects of nurse staffing on adverse events, morbidity, mortality, and medical costs. Nurs.Res ;52(2): Camp M, Chang DC, Zhang Y, Chrouser K, Colombani PM, Abdullah F. Risk factors and outcomes for foreign body left during a procedure: analysis of 413 incidents after operations in children. Arch.Surg ;145(11): Lotfipour S, Kaku SK, Vaca FE, Patel C, Anderson CL, Ahmed SS, et al. Factors associated with complications in older adults with isolated blunt chest trauma. West J.Emerg.Med ;10(2): Williams DJ, Olsen S, Crichton W, Witte K, Flin R, Ingram J, et al. Detection of adverse events in a Scottish hospital using a consensus-based methodology. Scott.Med.J ;53(4): Kaushal R, Bates DW, Franz C, Soukup JR, Rothschild JM. Costs of adverse events in intensive care units. Crit.Care Med ;35(11): Rice-Townsend S, Hall M, Jenkins KJ, Roberson DW, Rangel SJ. Analysis of adverse events in pediatric surgery using criteria validated from the adult population: justifying the need for pediatric-focused outcome measures. J.Pediatr.Surg ;45(6): Schioler T, Lipczak H, Pedersen BL, Mogensen TS, Bech KB, Stockmarr A, et al. Incidence of adverse events in hospitals. A retrospective study of medical records. Ugeskr.Laeger 2001 Sep 24;163(39): Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J, et al. The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ 2004 May 25;170(11): Davis P, Lay-Yee R, Briant R, Ali W, Scott A, Schug S. Adverse events in New Zealand public hospitals I: occurrence and impact. N.Z.Med.J Dec 13;115(1167):U271. 8
Indicator: Percentage of patients with an unexpectedly long length of stay (UL-LOS) Methods: Based on a prolonged length of stay of more than 50% Standardisation for patients’ age, primary diagnosis and main procedure Three strata of hospitals: 31 general hospitals 24 tertiary teaching hospitals 8 university medical centres 9
Why based on a prolonged length of stay of more than 50%? to include patients that stayed longer because of complications and adverse events and not patients that just stayed a little bit longer because of variations in the treatment, such as in logistics 10
Example - patient of 18 years old - appendicitis - appendectomy Expected LOS 3,4 dagen 3,4 + 1,7 = 5,1 days Actual LOS 6 days or more: UL-LOS 11
13 How does the Inspectorate use this indicator? Most important problem: hospitals without UL-LOS percentage Other hospitals: High percentage is an important signal Inspectors ask to inspect detailed information per specialism Patients with UL-LOS: record reviewing to learn what went wrong
15 PRO’s and CON’s of working with one key indicator Pro: Les administrative burden for caregivers Much easier for the inspector Contra: High demands regarding to this specific indicator: validity reliability comparability Outcomes are not compensated by other indicators!
16 Canary indicator of the coal mine
17 Aviation: dashboard with some key indicators
3 Indicators which may reveal risk of unsafe care 18