Evidence map›Paper›PMID 34609319›Full record

ArticleJMIR medical informatics2021

Optimal Triage for COVID-19 Patients Under Limited Health Care Resources With a Parsimonious Machine Learning Prediction Model and Threshold Optimization Using Discrete-Event Simulation: Development Study.

Jeongmin Kim, Hakyung Lim, Jae-Hyeon Ahn, Kyoung Hwa Lee, Kwang Suk Lee, Kyo Chul Koo

Open access · goldAbstract read
In one paragraph

Article in JMIR medical informatics, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 1 pooled it
2.4field-weighted citation impact, top 11% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 1 synthesis or guideline pooled it, 21 citations in OpenAlex.

  1. Pooled it
  2. Review
  3. Review
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 2 institutions in 1 country.

Jeongmin Kim *College of Business, Korea Advanced Institute of Science and Technology, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0001-5864-662X
Hakyung Lim *College of Business, Korea Advanced Institute of Science and Technology, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0002-7703-7309
Jae-Hyeon AhnCollege of Business, Korea Advanced Institute of Science and Technology, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0002-0490-001X
Kyoung Hwa LeeDivision of Infectious Disease, Department of Internal Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0003-0033-1398
Kwang Suk Lee *Department of Urology, Yonsei University College of Medicine, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0002-7961-8393
Kyo Chul Koo *Department of Urology, Yonsei University College of Medicine, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0001-7303-6256
Korea Advanced Institute of Science and Technology · KRYonsei University · KR

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe COVID-19 pandemic has placed an unprecedented burden on health care systems.

objectiveWe aimed to effectively triage COVID-19 patients within situations of limited data availability and explore optimal thresholds to minimize mortality rates while maintaining health care system capacity.

methodsA nationwide sample of 5601 patients confirmed with COVID-19 until April 2020 was retrospectively reviewed. Extreme gradient boosting (XGBoost) and logistic regression analysis were used to develop prediction models for the maximum clinical severity during hospitalization, classified according to the World Health Organization Ordinal Scale for Clinical Improvement (OSCI). The recursive feature elimination technique was used to evaluate the maintenance of model performance when clinical and laboratory variables were eliminated. Using populations based on hypothetical patient influx scenarios, discrete-event simulation was performed to find an optimal threshold within limited resource environments that minimizes mortality rates.

resultsThe cross-validated area under the receiver operating characteristic curve (AUROC) of the baseline XGBoost model that utilized all 37 variables was 0.965 for OSCI ≥6. Compared to the baseline model's performance, the AUROC of the feature-eliminated model that utilized 17 variables was maintained at 0.963 with statistical insignificance. Optimal thresholds were found to minimize mortality rates in a hypothetical patient influx scenario. The benefit of utilizing an optimal triage threshold was clear, reducing mortality up to 18.1%, compared with the conventional Youden index.

conclusionsOur adaptive triage model and its threshold optimization capability revealed that COVID-19 management can be achieved via the cooperation of both the medical and health care management sectors for maximum treatment efficacy. The model is available online for clinical implementation.

Indexed as

COVID-19decision support techniquesmachine learningpredictiontriage

Identifiers

PMID34609319
PMCPMC8565604
OpenAlexW3203281044

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.