Evidence map›Paper›PMID 34919691›Full record

ArticleInternational journal of epidemiology2022

Lessons learnt when accounting for competing events in the external validation of time-to-event prognostic models.

Chava L Ramspek, Lucy Teece, Kym I E Snell, Marie Evans, Richard D Riley, Maarten van Smeden, Nan van Geloven, Merel van Diepen

Open access · hybridAbstract read
In one paragraph

Article in International journal of epidemiology, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers.

0numbers the graph read from it
0cells of the map it votes in
27citing papers in PubMed
4.3field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

27 citing papers in PubMed, 45 citations in OpenAlex.

  1. Article
  2. The kidney failure risk equation in people with CKD and multimorbidity: the effect of competing mortality risks.Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association · 2026
    Observational
  3. Article
  4. Article
  5. Changing from the CKD-EPI to the EKFC creatinine equation to estimate glomerular filtration rate in adults in a Northern European health system.Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association · 2026
    Article
  6. Article
  7. Risk-based referral model to nephrologist specialist care in Stockholm.Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association · 2025
    Observational
  8. Article
  9. Article
  10. Article
  11. Article
  12. Frailty in Adults with CKD and Validation of the Kidney Failure Risk Equation in Frailty Subgroups.Clinical journal of the American Society of Nephrology : CJASN · 2025
    Article
  13. Article
  14. Competing and Noncompeting Risk Models for Predicting Kidney Allograft Failure.Journal of the American Society of Nephrology : JASN · 2025
    Article
  15. Article
  16. A tool to predict the risk of lower extremity amputation in patients starting dialysis.Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association · 2024
    Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 5 institutions in 3 countries.

Chava L RamspekDepartment of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands.ORCID 0000-0002-7883-5927
Lucy TeeceBiostatistics Research Group, Department of Health Sciences, University of Leicester, Leicester, UK.
Kym I E SnellCentre for Prognosis Research, School of Medicine, Keele University, Keele, UK.
Marie EvansDivision of Renal Medicine, Department of Clinical Science, Intervention and Technology, Karolinska Institutet and Karolinska University hospital, Stockholm, Sweden.ORCID 0000-0001-8650-5795
Richard D RileyCentre for Prognosis Research, School of Medicine, Keele University, Keele, UK.
Maarten van SmedenJulius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, The Netherlands.ORCID 0000-0002-5529-1541
Nan van GelovenDepartment of Biomedical Data Sciences, Leiden University Medical Center, Leiden, The Netherlands.
Merel van DiepenDepartment of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands.
Leiden University Medical Center · NLKeele University · GBKarolinska University Hospital · SEUniversity of Leicester · GBUtrecht University · NL

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundExternal validation of prognostic models is necessary to assess the accuracy and generalizability of the model to new patients. If models are validated in a setting in which competing events occur, these competing risks should be accounted for when comparing predicted risks to observed outcomes.

methodsWe discuss existing measures of calibration and discrimination that incorporate competing events for time-to-event models. These methods are illustrated using a clinical-data example concerning the prediction of kidney failure in a population with advanced chronic kidney disease (CKD), using the guideline-recommended Kidney Failure Risk Equation (KFRE). The KFRE was developed using Cox regression in a diverse population of CKD patients and has been proposed for use in patients with advanced CKD in whom death is a frequent competing event.

resultsWhen validating the 5-year KFRE with methods that account for competing events, it becomes apparent that the 5-year KFRE considerably overestimates the real-world risk of kidney failure. The absolute overestimation was 10%age points on average and 29%age points in older high-risk patients.

conclusionsIt is crucial that competing events are accounted for during external validation to provide a more reliable assessment the performance of a model in clinical settings in which competing risks occur.

Indexed as

Renal InsufficiencyRenal Insufficiency, ChronicAgedFemaleHumansMalePrognosisRisk Assessmentcalibrationcompeting risksdiscriminationexternal validationPredictionprognostic model

Identifiers

PMID34919691
PMCPMC9082803
OpenAlexW4200105996

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.