Evidence map›Paper›PMID 30241973›Full record

ReviewEuropean urology2018

Reporting and Interpreting Decision Curve Analysis: A Guide for Investigators.

Ben Van Calster, Laure Wynants, Jan F M Verbeek, Jan Y Verbakel, Evangelia Christodoulou, Andrew J Vickers, Monique J Roobol, Ewout W Steyerberg

Open access · greenAbstract readReview
In one paragraph

Review in European urology, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 846 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
846citing papers in PubMed, 1 pooled it
44.2field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

846 citing papers in PubMed, 1 synthesis or guideline pooled it, 1,241 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Review
  6. Article
  7. Review
  8. Site-Specific Characterization and Quantification of Facial Corticosteroid Addiction Dermatitis: A Multimodal Nomogram Integrating High-Frequency Ultrasonography and Transepidermal Water Loss.Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging (ISSI) · 2026
    Article
  9. Article
  10. Article
  11. Observational
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

786 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 5 institutions in 5 countries.

Ben Van CalsterDepartment of Development and Regeneration, KU Leuven, Leuven, Belgium; Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, The Netherlands. Electronic address: Ben.vancalster@kuleuven.be.
Laure WynantsDepartment of Development and Regeneration, KU Leuven, Leuven, Belgium.
Jan F M VerbeekDepartment of Urology, Erasmus MC, Rotterdam, The Netherlands.
Jan Y VerbakelDepartment of Public Health and Primary Care, KU Leuven, Leuven, Belgium; Nuffield Department of Primary Care Health Sciences, University of Oxford, UK.
Evangelia ChristodoulouDepartment of Development and Regeneration, KU Leuven, Leuven, Belgium.
Andrew J VickersDepartment of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
Monique J RoobolDepartment of Urology, Erasmus MC, Rotterdam, The Netherlands.
Ewout W SteyerbergDepartment of Biomedical Data Sciences, Leiden University Medical Center, Leiden, The Netherlands; Department of Public Health, Erasmus MC, Rotterdam, The Netherlands.
Erasmus MC · NLKU Leuven · BELeiden University Medical Center · NLMemorial Sloan Kettering Cancer Center · USUniversity of Oxford · GB

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Nicholas D Socci · 1985 to 2026
$347.4M
SPORE In Prostate CancerP50CA092629 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Yu Chen, MICHAEL J MORRIS · 2001 to 2026
$63.0M
Value of Personalized Risk InformationU01NS086294 · NINDS · TUFTS MEDICAL CENTER · PI KENT, DAVID M, NEUMANN, PETER · 2013 to 2017
$2.6M
Dynamic, multi-cohort prediction modeling of prostate biopsy outcomeR01CA179115 · NCI · SLOAN-KETTERING INST CAN RESEARCH · PI ANKERST, DONNA PAULER, VICKERS, ANDREW J · 2014 to 2018
$2.3M
NCI NIH HHS P30 CA008748NCI NIH HHS P50 CA092629NCI NIH HHS R01 CA179115NINDS NIH HHS U01 NS086294
6 · The paper itself

Abstract

contextUrologists regularly develop clinical risk prediction models to support clinical decisions. In contrast to traditional performance measures, decision curve analysis (DCA) can assess the utility of models for decision making. DCA plots net benefit (NB) at a range of clinically reasonable risk thresholds.

objectiveTo provide recommendations on interpreting and reporting DCA when evaluating prediction models. EVIDENCE ACQUISITION: We informally reviewed the urological literature to determine investigators' understanding of DCA. To illustrate, we use data from 3616 patients to develop risk models for high-grade prostate cancer (n=313, 9%) to decide who should undergo a biopsy. The baseline model includes prostate-specific antigen and digital rectal examination; the extended model adds two predictors based on transrectal ultrasound (TRUS). EVIDENCE SYNTHESIS: We explain risk thresholds, NB, default strategies (treat all, treat no one), and test tradeoff. To use DCA, first determine whether a model is superior to all other strategies across the range of reasonable risk thresholds. If so, that model appears to improve decisions irrespective of threshold. Second, consider if there are important extra costs to using the model. If so, obtain the test tradeoff to check whether the increase in NB versus the best other strategy is worth the additional cost. In our case study, addition of TRUS improved NB by 0.0114, equivalent to 1.1 more detected high-grade prostate cancers per 100 patients. Hence, adding TRUS would be worthwhile if we accept subjecting 88 patients to TRUS to find one additional high-grade prostate cancer or, alternatively, subjecting 10 patients to TRUS to avoid one unnecessary biopsy.

conclusionsThe proposed guidelines can help researchers understand DCA and improve application and reporting. PATIENT SUMMARY: Decision curve analysis can identify risk models that can help us make better clinical decisions. We illustrate appropriate reporting and interpretation of decision curve analysis.

Indexed as

Decision Support TechniquesUrologistsAttitude of Health PersonnelBiopsyClinical Decision-MakingComprehensionDigital Rectal ExaminationHealth Knowledge, Attitudes, PracticeHumansKallikreinsMaleNeoplasm GradingPatient SelectionPredictive Value of TestsProstate-Specific AntigenProstatic NeoplasmsKallikreinsKLK3 protein, humanProstate-Specific AntigenClinical utilityDecision curve analysisNet benefitRisk prediction modelsRisk thresholdTest tradeoff

Identifiers

PMID30241973
PMCPMC6261531
OpenAlexW2890840903

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.