Evidence map›Paper›PMID 33826589›Full record

ArticleSpine2021

Administrative Data Are Unreliable for Ranking Hospital Performance Based on Serious Complications After Spine Fusion.

Jacob K Greenberg, Margaret A Olsen, John Poe, Christopher F Dibble, Ken Yamaguchi, Michael P Kelly, Bruce L Hall, Wilson Z Ray

Abstract read
In one paragraph

Article in Spine, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Comparison of cost and complication rates for profiling hospital performance in lumbar fusion for spondylolisthesis.The spine journal : official journal of the North American Spine Society · 2021
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Jacob K GreenbergDepartment of Neurological Surgery, Washington University in St. Louis, St. Louis, MO.
Margaret A OlsenDepartment of Medicine, Washington University in St. Louis, St. Louis, MO.
John PoeDepartment of Internal Medicine, University of Michigan Medical School, Ann Arbor, MI.
Christopher F DibbleDepartment of Neurological Surgery, Washington University in St. Louis, St. Louis, MO.
Ken YamaguchiDepartment of Orthopaedic Surgery, Washington University in St. Louis, St. Louis, MO.
Michael P KellyDepartment of Orthopaedic Surgery, Washington University in St. Louis, St. Louis, MO.
Bruce L HallDepartment of Surgery, Washington University in St. Louis, St. Louis, MO.
Wilson Z RayDepartment of Neurological Surgery, Washington University in St. Louis, St. Louis, MO.

Funding

WU INSTITUTE OF CLINICAL AND TRANSLATIONAL SCIENCESUL1TR002345 · NCATS · WASHINGTON UNIVERSITY · PI William G. Powderly · 2017 to 2026
$97.8M
WASHINGTON UNIVERSITY COMPARATIVE EFFECTIVENESS ADMINISTRATIVE DATA REPOSITORYR24HS019455 · AHRQ · WASHINGTON UNIVERSITY · PI FRASER, VICTORIA J. · 2010 to 2010
$969k
Validation and Implementation of Clinical Decision Support for Managing Children with Mild Head Injuries and Intracranial InjuryF32HS027075 · AHRQ · WASHINGTON UNIVERSITY · PI GREENBERG, JACOB · 2020 to 2021
$88k
AHRQ HHS F32 HS027075AHRQ HHS R24 HS019455NCATS NIH HHS UL1 TR002345
6 · The paper itself

Abstract

STUDY

designRetrospective analysis of administrative billing data.

objectiveTo evaluate the extent to which a metric of serious complications determined from administrative data can reliably profile hospital performance in spine fusion surgery. SUMMARY OF BACKGROUND DATA: While payers are increasingly focused on implementing pay-for-performance measures, quality metrics must reliably reflect true differences in performance among the hospitals profiled.

methodsWe used State Inpatient Databases from nine states to characterize serious complications after elective cervical and thoracolumbar fusion. Hierarchical logistic regression was used to risk-adjust differences in case mix, along with variability from low case volumes. The reliability of this risk-stratified complication rate (RSCR) was assessed as the variation between hospitals that was not due to chance alone, calculated separately by fusion type and year. Finally, we estimated the proportion of hospitals that had sufficient case volumes to obtain reliable (>0.7) complication estimates.

resultsFrom 2010 to 2017 we identified 154,078 cervical and 213,133 thoracolumbar fusion surgeries. 4.2% of cervical fusion patients had a serious complication, and the median RSCR increased from 4.2% in 2010 to 5.5% in 2017. The reliability of the RSCR for cervical fusion was poor and varied substantially by year (range 0.04-0.28). Overall, 7.7% of thoracolumbar fusion patients experienced a serious complication, and the RSCR varied from 6.8% to 8.0% during the study period. Although still modest, the RSCR reliability was higher for thoracolumbar fusion (range 0.16-0.43). Depending on the study year, 0% to 4.5% of hospitals had sufficient cervical fusion case volume to report reliable (>0.7) estimates, whereas 15% to 36% of hospitals reached this threshold for thoracolumbar fusion.

conclusionA metric of serious complications was unreliable for benchmarking cervical fusion outcomes and only modestly reliable for thoracolumbar fusion. When assessed using administrative datasets, these measures appear inappropriate for high-stakes applications, such as public reporting or pay-for-performance.Level of Evidence: 3.

Indexed as

Reimbursement, IncentiveSpinal FusionHospitalsHumansPostoperative ComplicationsReproducibility of ResultsRetrospective Studies

Identifiers

PMID33826589
PMCPMC8363514

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.