Evidence map›Paper›PMID 22875756›Full record

ArticleAmerican journal of epidemiology2012

Further insight into the incremental value of new markers: the interpretation of performance measures and the importance of clinical context.

Kathleen F Kerr, Aasthaa Bansal, Margaret S Pepe

Abstract readComment
In one paragraph

Article in American journal of epidemiology, 2012. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed.

  1. Trial
  2. Review
  3. Article
  4. Observational
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Interpretable Deep Models for ICU Outcome Prediction.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2016
    Article
  11. Article
  12. Article
  13. Recent BRCAPRO upgrades significantly improve calibration.Cancer epidemiology, biomarkers & prevention : a publication of the American Association for Cancer Research, cosponsored by the American Society of Preventive Oncology · 2014
    Article
  14. Review
  15. Review
  16. Clinical utility in evaluation of risk models.American journal of epidemiology · 2012
    Article
  17. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

3 authors.

Kathleen F KerrDepartment of Biostatistics, University of Washington, Seattle, USA. katiek@u.washington.edu
Aasthaa Bansal
Margaret S Pepe

Funding

The Early Detection Research Network: Data Management and Coordinating CenterU24CA086368 · NCI · FRED HUTCHINSON CANCER RESEARCH CENTER · PI RUTH D ETZIONI, Ziding Feng · 2010 to 2026
$75.7M
EDRN--DATA MANAGEMENT AND COORDINATING CENTERU01CA086368 · NCI · FRED HUTCHINSON CANCER RESEARCH CENTER · PI FENG, ZIDING · 2000 to 2010
$16.9M
Statistical Methods for Medical Tests and BiomarkersR01GM054438 · NIGMS · UNIVERSITY OF WASHINGTON · PI PEPE, MARGARET S. · 1996 to 2015
$4.7M
Statistical Methods for Evaluating Markers for Treatment SelectionR01CA152089 · NCI · FRED HUTCHINSON CANCER RESEARCH CENTER · PI JANES, HOLLY · 2010 to 2021
$3.8M
NCI NIH HHS R01 CA152089NCI NIH HHS U01 CA086368NCI NIH HHS U24 CA086368NCI NIH HHS U24-CA086368NIGMS NIH HHS R01 GM054438NIGMS NIH HHS R01-GM054438
6 · The paper itself

Abstract

In this issue of the Journal, Pencina and et al. (Am J Epidemiol. 2012;176(6):492-494) examine the operating characteristics of measures of incremental value. Their goal is to provide benchmarks for the measures that can help identify the most promising markers among multiple candidates. They consider a setting in which new predictors are conditionally independent of established predictors. In the present article, the authors consider more general settings. Their results indicate that some of the conclusions made by Pencina et al. are limited to the specific scenarios the authors considered. For example, Pencina et al. observed that continuous net reclassification improvement was invariant to the strength of the baseline model, but the authors of the present study show this invariance does not hold generally. Further, they disagree with the suggestion that such invariance would be desirable for a measure of incremental value. They also do not see evidence to support the claim that the measures provide complementary information. In addition, they show that correlation with baseline predictors can lead to much bigger gains in performance than the conditional independence scenario studied by Pencina et al. Finally, the authors note that the motivation of providing benchmarks actually reinforces previous observations that the problem with these measures is they do not have useful clinical interpretations. If they did, researchers could use the measures directly and benchmarks would not be needed.

Indexed as

Data Interpretation, StatisticalLogistic ModelsROC CurveBiomarkersHumansRisk AssessmentBiomarkers

Identifiers

PMID22875756
PMCPMC3530353

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.