Evidence map›Paper›PMID 36117237›Full record

ArticleIntensive care medicine experimental2022

Development and validation of an early warning model for hospitalized COVID-19 patients: a multi-center retrospective cohort study.

Jim M Smit, Jesse H Krijthe, Andrei N Tintu, Henrik Endeman, Jeroen Ludikhuize, Michel E van Genderen, Shermarke Hassan, Rachida El Moussaoui, Peter E Westerweel, Robbert J Goekoop and 14 more

Abstract read
In one paragraph

Article in Intensive care medicine experimental, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

24 authors.

Jim M SmitDepartment of Intensive Care, Erasmus University Medical Center, Rotterdam, The Netherlands. j.smit@erasmusmc.nl.ORCID http://orcid.org/0000-0003-3716-1863
Jesse H KrijtheEEMCS, Pattern Recognition and Bio-Informatics Group, Delft University of Technology, Delft, The Netherlands.
Andrei N TintuDepartment of Clinical Chemistry, Erasmus University Medical Center, Rotterdam, The Netherlands.
Henrik EndemanDepartment of Intensive Care, Erasmus University Medical Center, Rotterdam, The Netherlands.
Jeroen LudikhuizeDepartment of Intensive Care, Haga Teaching Hospital, The Hague, The Netherlands.
Michel E van GenderenDepartment of Intensive Care, Erasmus University Medical Center, Rotterdam, The Netherlands.
Shermarke HassanDepartment of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands.
Rachida El MoussaouiDepartment of Internal Medicine, Maasstad Teaching Hospital, Rotterdam, The Netherlands.
Peter E WesterweelDepartment of Internal Medicine, Albert Schweitzer Teaching Hospital, Dordrecht, The Netherlands.
Robbert J GoekoopDepartment of Rheumatology, Haga Teaching Hospital, The Hague, The Netherlands.
Geeke WaverijnTeam Business Intelligence, Maasstad Teaching Hospital, Rotterdam, The Netherlands.
Tim VerheijenDepartment of Rheumatology, Leiden University Medical Center, Leiden, The Netherlands.
Jan G den HollanderDepartment of Internal Medicine, Maasstad Teaching Hospital, Rotterdam, The Netherlands.
Mark G J de BoerDepartment of Infectious Diseases, Leiden University Medical Center, Leiden, The Netherlands.
Diederik A M P J GommersDepartment of Intensive Care, Erasmus University Medical Center, Rotterdam, The Netherlands.
Robin van der VliesTeam Business Intelligence, Albert Schweitzer Teaching Hospital, Dordrecht, The Netherlands.
Mark SchellingsDepartment of Clinical Chemistry, MaasstadLab, Maasstad Teaching Hospital, Rotterdam, The Netherlands.
Regina A CarelsDepartment of Internal Medicine, Ikazia Teaching Hospital, Rotterdam, The Netherlands.
Cees van NieuwkoopDepartment of Internal Medicine, Haga Teaching Hospital, The Hague, The Netherlands.
Sesmu M ArbousDepartment of Intensive Care, Leiden University Medical Center, Leiden, The Netherlands.
Jasper van BommelDepartment of Intensive Care, Erasmus University Medical Center, Rotterdam, The Netherlands.
Rachel KnevelDepartment of Rheumatology, Leiden University Medical Center, Leiden, The Netherlands.
Yolanda B de RijkeDepartment of Clinical Chemistry, Erasmus University Medical Center, Rotterdam, The Netherlands.
Marcel J T ReindersEEMCS, Pattern Recognition and Bio-Informatics Group, Delft University of Technology, Delft, The Netherlands.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundTimely identification of deteriorating COVID-19 patients is needed to guide changes in clinical management and admission to intensive care units (ICUs). There is significant concern that widely used Early warning scores (EWSs) underestimate illness severity in COVID-19 patients and therefore, we developed an early warning model specifically for COVID-19 patients.

methodsWe retrospectively collected electronic medical record data to extract predictors and used these to fit a random forest model. To simulate the situation in which the model would have been developed after the first and implemented during the second COVID-19 'wave' in the Netherlands, we performed a temporal validation by splitting all included patients into groups admitted before and after August 1, 2020. Furthermore, we propose a method for dynamic model updating to retain model performance over time. We evaluated model discrimination and calibration, performed a decision curve analysis, and quantified the importance of predictors using SHapley Additive exPlanations values.

resultsWe included 3514 COVID-19 patient admissions from six Dutch hospitals between February 2020 and May 2021, and included a total of 18 predictors for model fitting. The model showed a higher discriminative performance in terms of partial area under the receiver operating characteristic curve (0.82 [0.80-0.84]) compared to the National early warning score (0.72 [0.69-0.74]) and the Modified early warning score (0.67 [0.65-0.69]), a greater net benefit over a range of clinically relevant model thresholds, and relatively good calibration (intercept = 0.03 [- 0.09 to 0.14], slope = 0.79 [0.73-0.86]).

conclusionsThis study shows the potential benefit of moving from early warning models for the general inpatient population to models for specific patient groups. Further (independent) validation of the model is needed.

Indexed as

Artificial intelligenceCOVID-19Dynamic model updatingEarly warning scoreIntensive careMachine learningMedical prediction model

Identifiers

PMID36117237
PMCPMC9482891

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.