Evidence map›Paper›PMID 34599200›Full record

ArticleScientific reports2021

Budget constrained machine learning for early prediction of adverse outcomes for COVID-19 patients.

Sam Nguyen, Ryan Chan, Jose Cadena, Braden Soper, Paul Kiszka, Lucas Womack, Mark Work, Joan M Duggan, Steven T Haller, Jennifer A Hanrahan and 3 more

Abstract read
In one paragraph

Article in Scientific reports, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Dynamic modeling of hospitalized COVID-19 patients reveals disease state-dependent risk factors.Journal of the American Medical Informatics Association : JAMIA · 2022
    Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Sam NguyenLawrence Livermore National Laboratory, 7000 East Ave, Livermore, CA, 94550, USA.
Ryan ChanLawrence Livermore National Laboratory, 7000 East Ave, Livermore, CA, 94550, USA.
Jose CadenaLawrence Livermore National Laboratory, 7000 East Ave, Livermore, CA, 94550, USA.
Braden SoperLawrence Livermore National Laboratory, 7000 East Ave, Livermore, CA, 94550, USA.
Paul KiszkaProMedica Health System, Inc, 3103 Executive Pkwy, Toledo, OH, 43606, USA.
Lucas WomackProMedica Health System, Inc, 3103 Executive Pkwy, Toledo, OH, 43606, USA.
Mark WorkProMedica Health System, Inc, 3103 Executive Pkwy, Toledo, OH, 43606, USA.
Joan M DugganDepartment of Medicine, University of Toledo College of Medicine and Life Sciences, 3000 Arlington Ave, Toledo, OH, 43614, USA.
Steven T HallerDepartment of Medicine, University of Toledo College of Medicine and Life Sciences, 3000 Arlington Ave, Toledo, OH, 43614, USA.
Jennifer A HanrahanDepartment of Medicine, University of Toledo College of Medicine and Life Sciences, 3000 Arlington Ave, Toledo, OH, 43614, USA.
David J KennedyDepartment of Medicine, University of Toledo College of Medicine and Life Sciences, 3000 Arlington Ave, Toledo, OH, 43614, USA.
Deepa MukundanDepartment of Pediatrics, University of Toledo College of Medicine and Life Sciences, 3000 Arlington Ave, Toledo, OH, 43614, USA.
Priyadip RayLawrence Livermore National Laboratory, 7000 East Ave, Livermore, CA, 94550, USA. ray34@llnl.gov.

Funding

Laboratory Directed Research and Development 19-ERD-009
6 · The paper itself

Abstract

The combination of machine learning (ML) and electronic health records (EHR) data may be able to improve outcomes of hospitalized COVID-19 patients through improved risk stratification and patient outcome prediction. However, in resource constrained environments the clinical utility of such data-driven predictive tools may be limited by the cost or unavailability of certain laboratory tests. We leveraged EHR data to develop an ML-based tool for predicting adverse outcomes that optimizes clinical utility under a given cost structure. We further gained insights into the decision-making process of the ML models through an explainable AI tool. This cohort study was performed using deidentified EHR data from COVID-19 patients from ProMedica Health System in northwest Ohio and southeastern Michigan. We tested the performance of various ML approaches for predicting either increasing ventilatory support or mortality. We performed post hoc analysis to obtain optimal feature sets under various budget constraints. We demonstrate that it is possible to achieve a significant reduction in cost at the expense of a small reduction in predictive performance. For example, when predicting ventilation, it is possible to achieve a 43% reduction in cost with only a 3% reduction in performance. Similarly, when predicting mortality, it is possible to achieve a 50% reduction in cost with only a 1% reduction in performance. This study presents a quick, accurate, and cost-effective method to evaluate risk of deterioration for patients with SARS-CoV-2 infection at the time of clinical evaluation.

Indexed as

BudgetsMachine LearningOutcome Assessment, Health CareCOVID-19HumansSARS-CoV-2

Identifiers

PMID34599200
PMCPMC8486861

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.