Evidence map›Paper›PMID 37968001›Full record

ArticleBMJ open2023

Developing and externally validating a machine learning risk prediction model for 30-day mortality after stroke using national stroke registers in the UK and Sweden.

Wenjuan Wang, Josline A Otieno, Marie Eriksson, Charles D Wolfe, Vasa Curcin, Benjamin D Bray

Abstract read
In one paragraph

Article in BMJ open, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Wenjuan WangDepartment of Population Health Sciences, King's College London, London, UK wenjuan.wang@kcl.ac.uk.ORCID 0000-0002-1879-7332
Josline A OtienoDepartment of Statistics, Umeå University, Umea, Sweden.ORCID 0009-0006-1030-4237
Marie ErikssonDepartment of Statistics, Umeå University, Umea, Sweden.ORCID 0000-0003-3298-1555
Charles D WolfeDepartment of Population Health Sciences, King's College London, London, UK.ORCID 0000-0001-8264-0981
Vasa CurcinDepartment of Population Health Sciences, King's College London, London, UK.
Benjamin D BrayDepartment of Population Health Sciences, King's College London, London, UK.

Funding

Department of Health
6 · The paper itself

Abstract

objectivesWe aimed to develop and externally validate a generalisable risk prediction model for 30-day stroke mortality suitable for supporting quality improvement analytics in stroke care using large nationwide stroke registers in the UK and Sweden.

designRegistry-based cohort study.

settingStroke registries including the Sentinel Stroke National Audit Programme (SSNAP) in England, Wales and Northern Ireland (2013-2019) and the national Swedish stroke register (Riksstroke 2015-2020). PARTICIPANTS AND

methodsData from SSNAP were used for developing and temporally validating the model, and data from Riksstroke were used for external validation. Models were developed with the variables available in both registries using logistic regression (LR), LR with elastic net and interaction terms and eXtreme Gradient Boosting (XGBoost). Performances were evaluated with discrimination, calibration and decision curves. OUTCOME MEASURES: The primary outcome was all-cause 30-day in-hospital mortality after stroke.

resultsIn total, 488 497 patients who had a stroke with 12.4% 30-day in-hospital mortality were used for developing and temporally validating the model in the UK. A total of 128 360 patients who had a stroke with 10.8% 30-day in-hospital mortality and 13.1% all mortality were used for external validation in Sweden. In the SSNAP temporal validation set, the final XGBoost model achieved the highest area under the receiver operating characteristic curve (AUC) (0.852 (95% CI 0.848 to 0.855)) and was well calibrated. The performances on the external validation in Riksstroke were as good and achieved AUC at 0.861 (95% CI 0.858 to 0.865) for in-hospital mortality. For Riksstroke, the models slightly overestimated the risk for in-hospital mortality, while they were better calibrated at the risk for all mortality.

conclusionThe risk prediction model was accurate and externally validated using high quality registry data. This is potentially suitable to be deployed as part of quality improvement analytics in stroke care to enable the fair comparison of stroke mortality outcomes across hospitals and health systems across countries.

Indexed as

StrokeCohort StudiesHumansMachine LearningSwedenUnited KingdomNEUROLOGYQuality in health careSTATISTICS & RESEARCH METHODSStroke

Identifiers

PMID37968001
PMCPMC10660948

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.