Evidence map›Paper›PMID 36357420›Full record

ArticleNature communications2022

Development and validation of self-monitoring auto-updating prognostic models of survival for hospitalized COVID-19 patients.

Todd J Levy, Kevin Coppa, Jinxuan Cang, Douglas P Barnaby, Marc D Paradis, Stuart L Cohen, Alex Makhnevich, David van Klaveren, David M Kent, Karina W Davidson and 2 more

Abstract read
In one paragraph

Article in Nature communications, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Review
  3. Machine Learning Operations in Health Care: A Scoping Review.Mayo Clinic proceedings. Digital health · 2024
    Review
  4. Article
  5. Article
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Todd J LevyInstitute of Health System Science, Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, 11030, USA.ORCID 0000-0003-0440-7791
Kevin CoppaClinical Digital Solutions, Northwell Health, New Hyde Park, NY, 11042, USA.
Jinxuan CangInstitute of Health System Science, Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, 11030, USA.ORCID 0000-0003-3232-2998
Douglas P BarnabyInstitute of Health System Science, Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, 11030, USA.ORCID 0000-0002-2135-0224
Marc D ParadisNorthwell Holdings, Northwell Health, Manhasset, NY, 11030, USA.
Stuart L CohenInstitute of Health System Science, Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, 11030, USA.
Alex MakhnevichInstitute of Health System Science, Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, 11030, USA.ORCID 0000-0002-7217-8487
David van KlaverenDepartment of Public Health, Erasmus MC University Medical Center, Rotterdam, Netherlands.ORCID 0000-0002-2096-606X
David M KentPredictive Analytics and Comparative Effectiveness Center, Tufts Medical Center, Boston, MA, USA.
Karina W DavidsonInstitute of Health System Science, Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, 11030, USA.ORCID 0000-0002-9162-477X
Jamie S HirschInstitute of Health System Science, Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, 11030, USA.ORCID 0000-0001-9571-1275
Theodoros P ZanosInstitute of Health System Science, Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, 11030, USA. tzanos@northwell.edu.ORCID 0000-0002-9204-9551

Funding

Tufts Clinical and Translational Science Institute (Pilot Supplement)UL1TR002544 · NCATS · TUFTS UNIVERSITY BOSTON · PI SELKER, HARRY P. · 2018 to 2022
$50.2M
Re-engineering Precision Therapeutics Through N-of-1 TrialsR01LM012836 · NLM · FEINSTEIN INSTITUTE FOR MEDICAL RESEARCH · PI DAVIDSON, KARINA W. · 2017 to 2023
$7.6M
Supporting Roybal P30 Centers Through a Single DSMBFR24AG064191 · NIA · FEINSTEIN INSTITUTE FOR MEDICAL RESEARCH · PI Karina W. Davidson · 2019 to 2026
$6.0M
Nudging Provider Adoption of Clinical Decision SupportK23HL145114 · NHLBI · NEW YORK UNIVERSITY SCHOOL OF MEDICINE · PI RICHARDSON, SAFIYA · 2019 to 2023
$863k
NCATS NIH HHS UL1 TR002544NHLBI NIH HHS K23 HL145114NIA NIH HHS R24 AG064191NLM NIH HHS R01 LM012836
6 · The paper itself

Abstract

Clinical prognostic models can assist patient care decisions. However, their performance can drift over time and location, necessitating model monitoring and updating. Despite rapid and significant changes during the pandemic, prognostic models for COVID-19 patients do not currently account for these drifts. We develop a framework for continuously monitoring and updating prognostic models and apply it to predict 28-day survival in COVID-19 patients. We use demographic, laboratory, and clinical data from electronic health records of 34912 hospitalized COVID-19 patients from March 2020 until May 2022 and compare three modeling methods. Model calibration performance drift is immediately detected with minor fluctuations in discrimination. The overall calibration on the prospective validation cohort is significantly improved when comparing the dynamically updated models against their static counterparts. Our findings suggest that, using this framework, models remain accurate and well-calibrated across various waves, variants, race and sex and yield positive net-benefits.

Indexed as

COVID-19CalibrationCohort StudiesHumansPandemicsPrognosisRetrospective Studies

Identifiers

PMID36357420
PMCPMC9648888

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.