Evidence map›Paper›PMID 31651317›Full record

ArticleBMC medicine2019

Three myths about risk thresholds for prediction models.

Laure Wynants, Maarten van Smeden, David J McLernon, Dirk Timmerman, Ewout W Steyerberg, Ben Van Calster, Topic Group ‘Evaluating diagnostic tests and prediction models’ of the STRATOS initiative

Abstract read
In one paragraph

Article in BMC medicine, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 97 papers, 7 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
97citing papers in PubMed, 7 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

97 citing papers in PubMed, 7 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Article
  9. From trees to graphs: rethinking phylogeny in microbiome prediction.Applied and environmental microbiology · 2026
    Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

37 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Laure WynantsKU Leuven Department of Development and Regeneration, Leuven, Belgium. laure.wynants@maastrichtuniversity.nl.ORCID http://orcid.org/0000-0002-3037-122X
Maarten van SmedenDepartment of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands.
David J McLernonMedical Statistics Team, Institute of Applied Health Sciences, School of Medicine, Medical Sciences and Nutrition, University of Aberdeen, Aberdeen, UK.
Dirk TimmermanKU Leuven Department of Development and Regeneration, Leuven, Belgium.
Ewout W SteyerbergDepartment of Biomedical Data Sciences, Leiden University Medical Center, Leiden, The Netherlands.
Ben Van CalsterKU Leuven Department of Development and Regeneration, Leuven, Belgium.
Topic Group ‘Evaluating diagnostic tests and prediction models’ of the STRATOS initiative

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundClinical prediction models are useful in estimating a patient's risk of having a certain disease or experiencing an event in the future based on their current characteristics. Defining an appropriate risk threshold to recommend intervention is a key challenge in bringing a risk prediction model to clinical application; such risk thresholds are often defined in an ad hoc way. This is problematic because tacitly assumed costs of false positive and false negative classifications may not be clinically sensible. For example, when choosing the risk threshold that maximizes the proportion of patients correctly classified, false positives and false negatives are assumed equally costly. Furthermore, small to moderate sample sizes may lead to unstable optimal thresholds, which requires a particularly cautious interpretation of results. MAIN TEXT: We discuss how three common myths about risk thresholds often lead to inappropriate risk stratification of patients. First, we point out the contexts of counseling and shared decision-making in which a continuous risk estimate is more useful than risk stratification. Second, we argue that threshold selection should reflect the consequences of the decisions made following risk stratification. Third, we emphasize that there is usually no universally optimal threshold but rather that a plausible risk threshold depends on the clinical context. Consequently, we recommend to present results for multiple risk thresholds when developing or validating a prediction model.

conclusionBearing in mind these three considerations can avoid inappropriate allocation (and non-allocation) of interventions. Using discriminating and well-calibrated models will generate better clinical outcomes if context-dependent thresholds are used.

Indexed as

Data Interpretation, StatisticalModels, StatisticalForecastingHumansLongitudinal StudiesModels, TheoreticalMythologyRisk AssessmentClinical risk prediction modelData scienceDecision support techniquesDiagnosisPrognosisRiskThreshold

Identifiers

PMID31651317
PMCPMC6814132

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.