Evidence map›Paper›PMID 34802876›Full record

Observational studyThe Journal of heart and lung transplantation : the official publication of the International Society for Heart Transplantation2022

Assessing the accuracy of the lung allocation score.

William F Parker, Nicole E Dussault, Renea Jablonski, Edward R Garrity, Matthew M Churpek

Abstract readMulticenter StudyObservational Study
In one paragraph

Observational study in The Journal of heart and lung transplantation : the official publication of the International Society for Heart Transplantation, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Review
  4. Article
  5. Article
  6. Review
  7. Review
  8. Review
  9. Observational
  10. Miscalibration of lung allocation models leads to inaccurate waitlist mortality predictions.American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons · 2023
    Article
  11. Article
  12. Is it too soon to abandon all hope of useful post-transplant predictions in thoracic transplantation? Reply to: Expecting the unexpected, and prioritizing the predictable.The Journal of heart and lung transplantation : the official publication of the International Society for Heart Transplantation · 2022
    Article
  13. The lung allocation score and other available models lack predictive accuracy for post-lung transplant survival.The Journal of heart and lung transplantation : the official publication of the International Society for Heart Transplantation · 2022
    Article
  14. Expecting the unexpected, and prioritizing the predictable.The Journal of heart and lung transplantation : the official publication of the International Society for Heart Transplantation · 2022
    Article
  15. Trends over Time in Practice and Outcomes of Lung Transplantation in Recipients With Human Immunodeficiency Virus.Transplant infectious disease : an official journal of the Transplantation Society
    Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

5 authors.

William F ParkerDepartment of Medicine, Section of Pulmonary and Critical Care Medicine, University of Chicago, Chicago, Illinois; MacLean Center for Clinical Medical Ethics, University of Chicago, Chicago, Illinois. Electronic address: wparker@uchicago.edu.
Nicole E DussaultPritzker School of Medicine, University of Chicago, Chicago, Illinois.
Renea JablonskiDepartment of Medicine, Section of Pulmonary and Critical Care Medicine, University of Chicago, Chicago, Illinois.
Edward R GarrityDepartment of Medicine, Section of Pulmonary and Critical Care Medicine, University of Chicago, Chicago, Illinois; MacLean Center for Clinical Medical Ethics, University of Chicago, Chicago, Illinois.
Matthew M ChurpekDepartment of Medicine, Division of Pulmonary and Critical Care Medicine, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin.

Funding

Sepsis Early Prediction and Subphenotype Illumination Study (SEPSIS)R01GM123193 · NIGMS · UNIVERSITY OF WISCONSIN-MADISON · PI CHURPEK, MATTHEW MICHAEL · 2017 to 2021
$1.9M
Mending a Broken Heart Allocation System with Machine LearningK08HL150291 · NHLBI · UNIVERSITY OF CHICAGO · PI PARKER, WILLIAM F · 2020 to 2024
$713k
NHLBI NIH HHS K08 HL150291NIGMS NIH HHS R01 GM123193
6 · The paper itself

Abstract

backgroundThe United States (US) Lung Allocation Score (LAS) relies on the performance of 2 survival models that estimate waitlist and post-transplant survival. These models were developed using data from 2005 to 2008, and it is unknown if they remain accurate.

methodsWe performed an observational cohort study of US lung transplantation candidates and recipients greater than 12 years of age between February 19, 2015 and February 19, 2019. We evaluated the LAS waitlist and post-transplant models with the concordance probability estimate and by comparing predicted vs observed 1-year restricted mean survival times by risk decile. We then compared a nonparametric estimate of the observed LAS with the predicted LAS for each percentile of recipients.

resultsThe waitlist model ranked candidates (N = 11,539) in the correct risk order 72% of the time (95% CI 71%-73%), and underestimated candidate one-year survival by 136 days for the highest risk decile (p < 0.001). The post-transplant model ranked recipients (N = 9,377) in the correct risk order 57% of the time (95% CI 55-58%), and underestimated recipient one-year survival by 70 days for the highest risk decile (p < 0.001). Overall, the LAS at transplant explained only 56% of the variation in observed outcomes, and was increasingly inaccurate at higher predicted values.

conclusionsThe waitlist and the post-transplant models that constitute the LAS are inaccurate, limiting the ability of the system to rank candidates on the waitlist in the correct order. The LAS should therefore be updated and the underlying models should be modernized.

Indexed as

RegistriesFemaleFollow-Up StudiesHumansLung TransplantationMaleMiddle AgedReproducibility of ResultsRetrospective StudiesSurvival RateTime FactorsTissue and Organ ProcurementTransplant RecipientsUnited StatesWaiting Listslung transplantorgan allocationSurvival analysistransplant ethics

Identifiers

PMID34802876
PMCPMC8799497

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.