Evidence map›Paper›PMID 31501118›Full record

Observational studyBMJ open2019

Standardised mortality ratios as a user-friendly performance metric and trigger for quality improvement in a Flemish hospital network: multicentre retrospective study.

Wim Tambeur, Pieter Stijnen, Guy Vanden Boer, Pieter Maertens, Caroline Weltens, Frank Rademakers, Dirk De Ridder, Kris Vanhaecht, Luk Bruyneel

Abstract readMulticenter StudyObservational Study
In one paragraph

Observational study in BMJ open, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Wim TambeurUniversity Hospitals Leuven, Leuven, Belgium wim.tambeur@uzleuven.be.
Pieter StijnenManagement Information and Reporting, University Hospitals Leuven, Leuven, Belgium.
Guy Vanden BoerManagement Information and Reporting, University Hospitals Leuven, Leuven, Belgium.
Pieter MaertensManagement Information and Reporting, University Hospitals Leuven, Leuven, Belgium.
Caroline WeltensDepartment of Radiation Oncology, University Hospitals Leuven, Leuven, Belgium.
Frank RademakersUniversity Hospitals Leuven, Leuven, Belgium.
Dirk De RidderDepartment of Urology, University Hospitals Leuven, Leuven, Belgium.
Kris VanhaechtLeuven Insititute for Healthcare Policy, KU Leuven, Leuven, Belgium.
Luk BruyneelLeuven Insititute for Healthcare Policy, KU Leuven, Leuven, Belgium.ORCID 0000-0003-1209-692X

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveTo illustrate the development and use of standardised mortality rates (SMRs) as a trigger for quality improvement in a network of 27 hospitals.

designThis research was a retrospective observational study. The primary outcome was in-hospital mortality. SMRs were calculated for All Patient Refined-Diagnosis-Related Groups (APR-DRGs) that reflect 80% of the Flemish hospital network mortality. Hospital mortality was modelled using logistic regression. The metrics were communicated to the member hospitals using a custom-made R-Shiny web application showing results at the level of the hospital, patient groups and individual patients. Experiences with the metric and strategies for improvement were shared in chief medical officer meetings organised by the Flemish hospital network.

setting27 Belgian hospitals.

participants1 198 717 hospital admissions for registration years 2009-2016.

resultsPatient gender, age, comorbidity as well as admission source and type were important predictors of mortality. Altogether the SMR models had a C-statistic of 88%, indicating good discriminatory capability. Seven out of ten APR-DRGs with the highest percentage of hospitals statistically significantly deviating from the benchmark involved malignancy. The custom-built web application and the trusted environment of the Flemish hospital network created an interoperable strategy to get to work with SMR findings. Use of the web application increased over time, with peaks before and after key discussion meetings within the Flemish hospital network. A concomitant reduction in crude mortality for the selected APR-DRGs from 6.7% in 2009 to 5.9% in 2016 was observed.

conclusionsThis study reported on the phased approach for introducing SMR reporting to trigger quality improvement. Prerequisites for the successful use of quality metrics in hospital benchmarks are a collaborative approach based on trust among the participants and a reporting platform that allows stakeholders to interpret and analyse the results at multiple levels.

Indexed as

Information ServicesMobile ApplicationsAdultAged, 80 and overBelgiumDiagnosis-Related GroupsFemaleHospital Information SystemsHospitalizationHospital MortalityHumansInfant, NewbornMaleModels, StatisticalOutcome Assessment, Health CareQuality Improvementcollaborative improvementhospital mortalityquality assurancequality indicatorsstatistical models

Identifiers

PMID31501118
PMCPMC6738686

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.