Evidence map›Paper›PMID 21726217›Full record

ArticleEuropean journal of clinical investigation2012

Assessing the incremental value of diagnostic and prognostic markers: a review and illustration.

Ewout W Steyerberg, Michael J Pencina, Hester F Lingsma, Michael W Kattan, Andrew J Vickers, Ben Van Calster

Abstract read
In one paragraph

Article in European journal of clinical investigation, 2012. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 89 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
89citing papers in PubMed, 5 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

89 citing papers in PubMed, 5 syntheses or guidelines pooled it.

  1. Pooled it
  2. A systematic review of the status and methodological considerations for estimating risk of first ever stroke in the general population.Neurological sciences : official journal of the Italian Neurological Society and of the Italian Society of Clinical Neurophysiology · 2021
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Guideline
  6. Trial
  7. Validation and simplification of the MR PREDICTS @24H model for outcome prediction after endovascular thrombectomy for acute ischemic stroke.International journal of stroke : official journal of the International Stroke Society · 2026
    Observational
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Endometrial immune dysregulation shapes CD8Frontiers in immunology · 2026
    Article
  16. Article
  17. Article
  18. Article
  19. Biomarker Panels for Predicting Progression of Kidney Disease in Acute Kidney Injury Survivors.Clinical journal of the American Society of Nephrology : CJASN · 2025
    Article
  20. Article

29 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Ewout W SteyerbergDepartment of Public Health, Erasmus MC, Rotterdam, The Netherlands. e.steyerberg@erasmusmc.nl
Michael J Pencina
Hester F Lingsma
Michael W Kattan
Andrew J Vickers
Ben Van Calster

Funding

SPORE In Prostate CancerP50CA092629 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Yu Chen, MICHAEL J MORRIS · 2001 to 2026
$63.0M
Long-term prediction of prostate cancer death from kallikreins measured in bloodR33CA127768 · NCI · SLOAN-KETTERING INST CAN RESEARCH · PI LILJA, HANS GÖSTA · 2010 to 2011
$692k
NCI NIH HHS P50 CA092629NCI NIH HHS R33 CA127768
6 · The paper itself

Abstract

backgroundNew markers may improve prediction of diagnostic and prognostic outcomes. We review various measures to quantify the incremental value of markers over standard, readily available characteristics.

methodsWidely used traditional measures include the improvement in model fit or in the area under the receiver operating characteristic (ROC) curve (AUC). New measures include the net reclassification index (NRI) and decision-analytic measures, such as the fraction of true-positive classifications penalized for false-positive classifications [net benefit (NB)]. For illustration, we discuss a case study on the presence of residual tumour vs. benign tissue in 544 patients with testicular cancer. We assessed three tumour markers [Alpha-fetoprotein (AFP), Human chorionic gonadotropin (HCG) and Lactate dehydrogenase (LDH)] for their incremental value over currently standard clinical predictors.

resultsAUC and R(2) values suggested adding continuous LDH and AFP whereas NB only favoured HCG as a potentially promising marker at a clinically defendable decision threshold of 20% risk. The NRI suggested reclassification potential of all three markers.

conclusionsThe improvement in standard discrimination measures, which focus on finding variables that might be promising across all decision thresholds, may not detect the most informative markers at a specific threshold of particular clinical relevance. When a marker is intended to support decision-making, calculation of the improvement in a decision-analytic measure, such as NB, is preferable over an overall judgment as obtained from the AUC in ROC analysis.

Indexed as

Models, StatisticalBiomarkers, TumorHumansMaleNeoplasms, Germ Cell and EmbryonalPredictive Value of TestsPrognosisReproducibility of ResultsTesticular NeoplasmsBiomarkers, Tumor

Identifiers

PMID21726217
PMCPMC3587963

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.