Evidence map›Paper›PMID 27401013›Full record

ArticleBMC medicine2016

An external validation of models to predict the onset of chronic kidney disease using population-based electronic health records from Salford, UK.

Paolo Fraccaro, Sabine van der Veer, Benjamin Brown, Mattia Prosperi, Donal O'Donoghue, Gary S Collins, Iain Buchan, Niels Peek

Open access · goldAbstract readValidation Study
In one paragraph

Article in BMC medicine, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed, 2 pooled it
1.4field-weighted citation impact, top 19% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 2 syntheses or guidelines pooled it, 35 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 4 institutions in 2 countries.

Paolo FraccaroNIHR Greater Manchester Primary Care Patient Safety Translational Research Centre, Institute of Population Health, The University of Manchester, Manchester, UK.
Sabine van der VeerHealth eResearch Centre, Farr Institute for Health Informatics Research, Manchester, UK.
Benjamin BrownNIHR Greater Manchester Primary Care Patient Safety Translational Research Centre, Institute of Population Health, The University of Manchester, Manchester, UK.
Mattia ProsperiHealth eResearch Centre, Farr Institute for Health Informatics Research, Manchester, UK.
Donal O'DonoghueRenal Clinic, Salford Royal NHS Trust, Salford, UK.
Gary S CollinsCentre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology & Musculoskeletal Sciences, University of Oxford, Oxford, UK.
Iain BuchanNIHR Greater Manchester Primary Care Patient Safety Translational Research Centre, Institute of Population Health, The University of Manchester, Manchester, UK.
Niels PeekNIHR Greater Manchester Primary Care Patient Safety Translational Research Centre, Institute of Population Health, The University of Manchester, Manchester, UK. niels.peek@manchester.ac.uk.
Farr Institute · GBManchester Academic Health Science Centre · GBUniversity of Manchester · GBUniversity of Oxford · GB

Funding

Medical Research Council MC_PC_13042Medical Research Council MR/K006665/1
6 · The paper itself

Abstract

backgroundChronic kidney disease (CKD) is a major and increasing constituent of disease burdens worldwide. Early identification of patients at increased risk of developing CKD can guide interventions to slow disease progression, initiate timely referral to appropriate kidney care services, and support targeting of care resources. Risk prediction models can extend laboratory-based CKD screening to earlier stages of disease; however, to date, only a few of them have been externally validated or directly compared outside development populations. Our objective was to validate published CKD prediction models applicable in primary care.

methodsWe synthesised two recent systematic reviews of CKD risk prediction models and externally validated selected models for a 5-year horizon of disease onset. We used linked, anonymised, structured (coded) primary and secondary care data from patients resident in Salford (population ~234 k), UK. All adult patients with at least one record in 2009 were followed-up until the end of 2014, death, or CKD onset (n = 178,399). CKD onset was defined as repeated impaired eGFR measures over a period of at least 3 months, or physician diagnosis of CKD Stage 3-5. For each model, we assessed discrimination, calibration, and decision curve analysis.

resultsSeven relevant CKD risk prediction models were identified. Five models also had an associated simplified scoring system. All models discriminated well between patients developing CKD or not, with c-statistics around 0.90. Most of the models were poorly calibrated to our population, substantially over-predicting risk. The two models that did not require recalibration were also the ones that had the best performance in the decision curve analysis.

conclusionsIncluded CKD prediction models showed good discriminative ability but over-predicted the actual 5-year CKD risk in English primary care patients. QKidney, the only UK-developed model, outperformed the others. Clinical prediction models should be (re)calibrated for their intended uses.

Indexed as

Early DiagnosisElectronic Health RecordsModels, TheoreticalAdultDecision Support TechniquesHumansMaleMiddle AgedRenal Insufficiency, ChronicRisk AssessmentRisk FactorsUnited KingdomChronic kidney diseaseClinical prediction modelsDecision supporteGFRElectronic health recordsModel calibrationModel validation

Identifiers

PMID27401013
PMCPMC4940699
OpenAlexW2473050697

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.