Evidence map›Paper›PMID 32907855›Full record

Observational studyBMJ (Clinical research ed.)2020

Risk stratification of patients admitted to hospital with covid-19 using the ISARIC WHO Clinical Characterisation Protocol: development and validation of the 4C Mortality Score.

Stephen R Knight, Antonia Ho, Riinu Pius, Iain Buchan, Gail Carson, Thomas M Drake, Jake Dunning, Cameron J Fairfield, Carrol Gamble, Christopher A Green and 26 more

Erratum issued 2 registry-linked trialsAbstract readObservational Study
In one paragraph

Observational study in BMJ (Clinical research ed.), 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. It is linked to 2 registered trials, which are not on this map. Cited by 630 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
630citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04629183 completednot on this map

Risk Stratification of COVID-19 Patients Discharged From the Emergency Department

TypeobservationalSponsorA.O.U. Città della Salute e della ScienzaRan2020 to 2021Enrolled742ConditionsCovid19Armsintegrated clinical evaluation
NCT04812041 unknown statusnot on this mapstarted 2021, after this paper: background citation

Relationship Between Delirium Severity by CAM-ICU 7 and 4C Mortality Score of the COVID-19 Patients in ICU

Typeobservational_patient_registrySponsorAnkara City Hospital BilkentRan2021 to 2021Enrolled150ConditionsDelirium, Covid19, Intensive Care Unit DeliriumArmsCAM-ICU 7 score, 4C Mortality Score
3 · Its place in the literature

Who cites it

630 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. A Systematic Review of Predictor Composition, Outcomes, Risk of Bias, and Validation of COVID-19 Prognostic Scores.Clinical infectious diseases : an official publication of the Infectious Diseases Society of America · 2024
    Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Trial
  6. Effects of Losartan on Patients Hospitalized for Acute COVID-19: A Randomized Controlled Trial.Clinical infectious diseases : an official publication of the Infectious Diseases Society of America · 2024
    Trial
  7. Viral and Host Factors Are Associated With Mortality in Hospitalized Patients With COVID-19.Clinical infectious diseases : an official publication of the Infectious Diseases Society of America · 2024
    Trial
  8. Trial
  9. Trial
  10. Article
  11. Observational
  12. Article
  13. LongitudinalJournal of magnetic resonance imaging : JMRI · 2026
    Article
  14. Article
  15. Observational
  16. Article
  17. Article
  18. Article
  19. Article
  20. Observational

570 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

36 authors.

Stephen R KnightCentre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.
Antonia HoMedical Research Council, University of Glasgow Centre for Virus Research, Glasgow, UK.
Riinu PiusCentre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.
Iain BuchanInstitute of Population Health Sciences, University of Liverpool, Liverpool, UK.
Gail CarsonISARIC Global Support Centre, Centre for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, UK.
Thomas M DrakeCentre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.
Jake DunningNational Infection Service, Public Health England, London, UK.
Cameron J FairfieldCentre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.
Carrol GambleLiverpool Clinical Trials Centre, University of Liverpool, Liverpool, UK.
Christopher A GreenInstitute of Microbiology & Infection, University of Birmingham, Birmingham, UK.
Rishi GuptaInstitute of Global Health, University College London, London, UK.
Sophie HalpinLiverpool Clinical Trials Centre, University of Liverpool, Liverpool, UK.
Hayley E HardwickNIHR Health Protection Research Unit, Institute of Infection, Veterinary and Ecological Sciences, Faculty of Health and Life Sciences, University of Liverpool, Liverpool, UK.
Karl A HoldenNIHR Health Protection Research Unit, Institute of Infection, Veterinary and Ecological Sciences, Faculty of Health and Life Sciences, University of Liverpool, Liverpool, UK.
Peter W HorbyISARIC Global Support Centre, Centre for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, UK.
Clare JacksonLiverpool Clinical Trials Centre, University of Liverpool, Liverpool, UK.
Kenneth A McleanCentre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.
Laura MersonISARIC Global Support Centre, Centre for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, UK.
Jonathan S Nguyen-Van-TamDivision of Epidemiology and Public Health, University of Nottingham School of Medicine, Nottingham, UK.
Lisa NormanCentre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.
Mahdad NoursadeghiDivision of Infection and Immunity, University College London, London, UK.
Piero L OlliaroCentre for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, UK.
Mark G PritchardCentre for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, UK.
Clark D RussellQueen's Medical Research Institute, University of Edinburgh, Edinburgh, UK.
Catherine A ShawCentre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.
Aziz SheikhCentre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.
Tom SolomonNIHR Health Protection Research Unit, Institute of Infection, Veterinary and Ecological Sciences, Faculty of Health and Life Sciences, University of Liverpool, Liverpool, UK.
Cathie SudlowHealth Data Research UK, London, UK.
Olivia V SwannDepartment of Child Life and Health, University of Edinburgh, Edinburgh, UK.
Lance Cw TurtleNIHR Health Protection Research Unit, Institute of Infection, Veterinary and Ecological Sciences, Faculty of Health and Life Sciences, University of Liverpool, Liverpool, UK.
Peter Jm OpenshawNational Heart and Lung Institute, Imperial College London, London, UK.
J Kenneth BaillieRoslin Institute, University of Edinburgh, Edinburgh, UK.
Malcolm G SempleNIHR Health Protection Research Unit, Institute of Infection, Veterinary and Ecological Sciences, Faculty of Health and Life Sciences, University of Liverpool, Liverpool, UK m.g.semple@liverpool.ac.uk.ORCID 0000-0001-9700-0418
Annemarie B DochertyCentre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.
Ewen M HarrisonCentre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.
ISARIC4C investigators

Funding

Department of Health DRF-2018-11-ST2-004Department of Health IS-HPU-1112-10117Department of Health RP-2016-07-012Medical Research Council MC_PC_15001Medical Research Council MC_PC_19025Medical Research Council MC_PC_19026Medical Research Council MC_PC_19059Medical Research Council MC_UU_12014/9Medical Research Council MR/R005982/1Medical Research Council MR/S032304/1Medical Research Council MR/V033441/1Wellcome Trust 205228Wellcome Trust 207511Wellcome Trust 215091
6 · The paper itself

Abstract

objectiveTo develop and validate a pragmatic risk score to predict mortality in patients admitted to hospital with coronavirus disease 2019 (covid-19).

designProspective observational cohort study.

settingInternational Severe Acute Respiratory and emerging Infections Consortium (ISARIC) World Health Organization (WHO) Clinical Characterisation Protocol UK (CCP-UK) study (performed by the ISARIC Coronavirus Clinical Characterisation Consortium-ISARIC-4C) in 260 hospitals across England, Scotland, and Wales. Model training was performed on a cohort of patients recruited between 6 February and 20 May 2020, with validation conducted on a second cohort of patients recruited after model development between 21 May and 29 June 2020

main outcome measureIn-hospital mortality.

results35 463 patients were included in the derivation dataset (mortality rate 32.2%) and 22 361 in the validation dataset (mortality rate 30.1%). The final 4C Mortality Score included eight variables readily available at initial hospital assessment: age, sex, number of comorbidities, respiratory rate, peripheral oxygen saturation, level of consciousness, urea level, and C reactive protein (score range 0-21 points). The 4C Score showed high discrimination for mortality (derivation cohort: area under the receiver operating characteristic curve 0.79, 95% confidence interval 0.78 to 0.79; validation cohort: 0.77, 0.76 to 0.77) with excellent calibration (validation: calibration-in-the-large=0, slope=1.0). Patients with a score of at least 15 (n=4158, 19%) had a 62% mortality (positive predictive value 62%) compared with 1% mortality for those with a score of 3 or less (n=1650, 7%; negative predictive value 99%). Discriminatory performance was higher than 15 pre-existing risk stratification scores (area under the receiver operating characteristic curve range 0.61-0.76), with scores developed in other covid-19 cohorts often performing poorly (range 0.63-0.73).

conclusionsAn easy-to-use risk stratification score has been developed and validated based on commonly available parameters at hospital presentation. The 4C Mortality Score outperformed existing scores, showed utility to directly inform clinical decision making, and can be used to stratify patients admitted to hospital with covid-19 into different management groups. The score should be further validated to determine its applicability in other populations. STUDY REGISTRATION: ISRCTN66726260.

Indexed as

BetacoronavirusHospitalizationAgedAged, 80 and overClinical ProtocolsCohort StudiesCoronavirus InfectionsCOVID-19FemaleHospital MortalityHumansMaleMiddle AgedPandemicsPneumonia, ViralPredictive Value of Tests

Identifiers

PMID32907855
PMCPMC7116472

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.