Evidence map›Paper›PMID 35820692›Full record

SynthesisBMJ (Clinical research ed.)2022

Clinical prediction models for mortality in patients with covid-19: external validation and individual participant data meta-analysis.

Valentijn M T de Jong, Rebecca Z Rousset, Neftalí Eduardo Antonio-Villa, Arnoldus G Buenen, Ben Van Calster, Omar Yaxmehen Bello-Chavolla, Nigel J Brunskill, Vasa Curcin, Johanna A A Damen, Carlos A Fermín-Martínez and 28 more

Abstract readMeta-Analysis
In one paragraph

Synthesis in BMJ (Clinical research ed.), 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 40 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
40citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

40 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Article
  6. Observational
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Observational
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

38 authors.

Valentijn M T de JongJulius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, Netherlands V.M.T.deJong-2@umcutrecht.nl.ORCID 0000-0001-9921-3468
Rebecca Z RoussetJulius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, Netherlands.ORCID 0000-0001-9355-7286
Neftalí Eduardo Antonio-VillaDirección de Investigación, Instituto Nacional de Geriatría, Mexico City, Mexico.ORCID 0000-0002-6879-1078
Arnoldus G BuenenMaxima MC, Veldhoven, the Netherlands.ORCID 0000-0002-0948-1379
Ben Van CalsterDepartment of Development and Regeneration, KU Leuven, Leuven, Belgium.ORCID 0000-0003-1613-7450
Omar Yaxmehen Bello-ChavollaDirección de Investigación, Instituto Nacional de Geriatría, Mexico City, Mexico.ORCID 0000-0003-3093-937X
Nigel J BrunskillDepartment of Cardiovascular Sciences, College of Life Sciences, University of Leicester, Leicester, UK.
Vasa CurcinSchool of Population Health and Environmental Sciences, King's College London, London, UK.ORCID 0000-0002-8308-2886
Johanna A A DamenJulius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, Netherlands.ORCID 0000-0001-7401-4593
Carlos A Fermín-MartínezDirección de Investigación, Instituto Nacional de Geriatría, Mexico City, Mexico.ORCID 0000-0001-5627-8851
Luisa Fernández-ChirinoDirección de Investigación, Instituto Nacional de Geriatría, Mexico City, Mexico.ORCID 0000-0002-8326-1219
Davide FerrariSchool of Population Health and Environmental Sciences, King's College London, London, UK.ORCID 0000-0003-2365-4157
Robert C FreeDepartment of Respiratory Sciences, College of Life Sciences, University of Leicester, Leicester, UK.
Rishi K GuptaInstitute for Global Health, University College London, London, UK.ORCID 0000-0002-6257-1285
Pranabashis HaldarDepartment of Respiratory Sciences, College of Life Sciences, University of Leicester, Leicester, UK.
Pontus HedbergDepartment of Infectious Diseases, Karolinska University Hospital, Stockholm, Sweden.ORCID 0000-0003-3153-098X
Steven Kwasi KorangCopenhagen Trial Unit, Centre for Clinical Intervention Research, Department 7812, Rigshospitalet, Copenhagen University Hospital, Denmark.ORCID 0000-0002-6521-0928
Steef KurstjensLaboratory of Clinical Chemistry and Haematology, Jeroen Bosch Hospital, Den Bosch, Netherlands.
Ron KustersLaboratory of Clinical Chemistry and Haematology, Jeroen Bosch Hospital, Den Bosch, Netherlands.
Rupert W MajorDepartment of Cardiovascular Sciences, College of Life Sciences, University of Leicester, Leicester, UK.ORCID 0000-0003-4920-623X
Lauren MaxwellHeidelberger Institut für Global Health, Universitätsklinikum Heidelberg, Germany.
Rajeshwari NairUniversity of Iowa Carver College of Medicine, Iowa City, IA, USA.
Pontus NauclerDepartment of Infectious Diseases, Karolinska University Hospital, Stockholm, Sweden.ORCID 0000-0002-8185-2648
Tri-Long NguyenJulius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, Netherlands.ORCID 0000-0002-6376-7212
Mahdad NoursadeghiDivision of Infection and Immunity, University College London, London, UK.
Rossana RosaInfectious Diseases Service, UnityPoint Health-Des Moines, Des Moines, IA, USA.ORCID 0000-0002-3755-7780
Felipe SoaresIndustrial Engineering Department, Universidade Federal do Rio Grande do Sul, Porto Alegre, Brazil.ORCID 0000-0002-2837-1853
Toshihiko TakadaJulius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, Netherlands.ORCID 0000-0002-8032-6224
Florien S van RoyenJulius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, Netherlands.ORCID 0000-0002-6785-214X
Maarten van SmedenJulius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, Netherlands.ORCID 0000-0002-5529-1541
Laure WynantsBernhoven, Uden, Netherlands.ORCID 0000-0002-3037-122X
Martin ModrákInstitute of Microbiology of the Czech Academy of Sciences, Prague, Czech Republic.ORCID 0000-0002-8886-7797
CovidRetro collaboration
Folkert W AsselbergsDepartment of Cardiology, Division of Heart and Lungs, University Medical Centre Utrecht, Utrecht University, Utrecht, Netherlands.ORCID 0000-0002-1692-8669
Marijke LinschotenDepartment of Cardiology, Division of Heart and Lungs, University Medical Centre Utrecht, Utrecht University, Utrecht, Netherlands.ORCID 0000-0002-4541-080X
CAPACITY-COVID consortium
Karel G M MoonsJulius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, Netherlands.
Thomas P A DebrayJulius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, Netherlands.ORCID 0000-0002-1790-2719

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveTo externally validate various prognostic models and scoring rules for predicting short term mortality in patients admitted to hospital for covid-19.

designTwo stage individual participant data meta-analysis.

settingSecondary and tertiary care.

participants46 914 patients across 18 countries, admitted to a hospital with polymerase chain reaction confirmed covid-19 from November 2019 to April 2021. DATA SOURCES: Multiple (clustered) cohorts in Brazil, Belgium, China, Czech Republic, Egypt, France, Iran, Israel, Italy, Mexico, Netherlands, Portugal, Russia, Saudi Arabia, Spain, Sweden, United Kingdom, and United States previously identified by a living systematic review of covid-19 prediction models published in MODEL SELECTION AND ELIGIBILITY CRITERIA: Prognostic models identified by the living systematic review and through contacting experts. A priori models were excluded that had a high risk of bias in the participant domain of PROBAST (prediction model study risk of bias assessment tool) or for which the applicability was deemed poor.

methodsEight prognostic models with diverse predictors were identified and validated. A two stage individual participant data meta-analysis was performed of the estimated model concordance (C) statistic, calibration slope, calibration-in-the-large, and observed to expected ratio (O:E) across the included clusters.

main outcome measures30 day mortality or in-hospital mortality.

resultsDatasets included 27 clusters from 18 different countries and contained data on 46 914patients. The pooled estimates ranged from 0.67 to 0.80 (C statistic), 0.22 to 1.22 (calibration slope), and 0.18 to 2.59 (O:E ratio) and were prone to substantial between study heterogeneity. The 4C Mortality Score by Knight et al (pooled C statistic 0.80, 95% confidence interval 0.75 to 0.84, 95% prediction interval 0.72 to 0.86) and clinical model by Wang et al (0.77, 0.73 to 0.80, 0.63 to 0.87) had the highest discriminative ability. On average, 29% fewer deaths were observed than predicted by the 4C Mortality Score (pooled O:E 0.71, 95% confidence interval 0.45 to 1.11, 95% prediction interval 0.21 to 2.39), 35% fewer than predicted by the Wang clinical model (0.65, 0.52 to 0.82, 0.23 to 1.89), and 4% fewer than predicted by Xie et al's model (0.96, 0.59 to 1.55, 0.21 to 4.28).

conclusionThe prognostic value of the included models varied greatly between the data sources. Although the Knight 4C Mortality Score and Wang clinical model appeared most promising, recalibration (intercept and slope updates) is needed before implementation in routine care.

Indexed as

COVID-19Models, StatisticalData AnalysisHospital MortalityHumansPrognosis

Identifiers

PMID35820692
PMCPMC9273913

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.