Evidence map›Paper›PMID 26109106›Full record

ArticleJournal of the National Cancer Institute2015

The Fundamental Difficulty With Evaluating the Accuracy of Biomarkers for Guiding Treatment.

Holly Janes, Margaret S Pepe, Lisa M McShane, Daniel J Sargent, Patrick J Heagerty

Abstract read
In one paragraph

Article in Journal of the National Cancer Institute, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Trial
  4. Trial
  5. Review
  6. Review
  7. Review
  8. Article
  9. Article
  10. Review
  11. Article
  12. Review
  13. Review
  14. Review
  15. Evaluating Markers for Guiding Treatment.Journal of the National Cancer Institute · 2016
    Article
  16. Review
  17. On the quantitative assessment of predictive biomarkers.Journal of the National Cancer Institute · 2015
    Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

5 authors.

Holly JanesDivisions of Vaccine and Infectious Disease and Public Health Sciences, Fred Hutchinson Cancer Research Center, Seattle, Washington (HJ, MSP); Department of Biostatistics, University of Washington, Seattle, Washington (HJ, MSP, PJH); Biometric Research Branch, Division of Cancer Treatment and Diagnosis, National Cancer Institute, National Institutes of Health, Rockville, Maryland (LMM); Department of Health Science Research, Mayo Clinic, Rochester, Minnesota (DJS). hjanes@fhcrc.org.
Margaret S PepeDivisions of Vaccine and Infectious Disease and Public Health Sciences, Fred Hutchinson Cancer Research Center, Seattle, Washington (HJ, MSP); Department of Biostatistics, University of Washington, Seattle, Washington (HJ, MSP, PJH); Biometric Research Branch, Division of Cancer Treatment and Diagnosis, National Cancer Institute, National Institutes of Health, Rockville, Maryland (LMM); Department of Health Science Research, Mayo Clinic, Rochester, Minnesota (DJS).
Lisa M McShaneDivisions of Vaccine and Infectious Disease and Public Health Sciences, Fred Hutchinson Cancer Research Center, Seattle, Washington (HJ, MSP); Department of Biostatistics, University of Washington, Seattle, Washington (HJ, MSP, PJH); Biometric Research Branch, Division of Cancer Treatment and Diagnosis, National Cancer Institute, National Institutes of Health, Rockville, Maryland (LMM); Department of Health Science Research, Mayo Clinic, Rochester, Minnesota (DJS).
Daniel J SargentDivisions of Vaccine and Infectious Disease and Public Health Sciences, Fred Hutchinson Cancer Research Center, Seattle, Washington (HJ, MSP); Department of Biostatistics, University of Washington, Seattle, Washington (HJ, MSP, PJH); Biometric Research Branch, Division of Cancer Treatment and Diagnosis, National Cancer Institute, National Institutes of Health, Rockville, Maryland (LMM); Department of Health Science Research, Mayo Clinic, Rochester, Minnesota (DJS).
Patrick J HeagertyDivisions of Vaccine and Infectious Disease and Public Health Sciences, Fred Hutchinson Cancer Research Center, Seattle, Washington (HJ, MSP); Department of Biostatistics, University of Washington, Seattle, Washington (HJ, MSP, PJH); Biometric Research Branch, Division of Cancer Treatment and Diagnosis, National Cancer Institute, National Institutes of Health, Rockville, Maryland (LMM); Department of Health Science Research, Mayo Clinic, Rochester, Minnesota (DJS).

Funding

Transform Dissemination and Implementation Science in CTSA ProgramsUL1TR002319 · NCATS · UNIVERSITY OF WASHINGTON · PI John K. Amory · 2017 to 2026
$100.0M
Institute of Translational Health SciencesUL1TR000423 · NCATS · UNIVERSITY OF WASHINGTON · PI DISIS, MARY L. · 2012 to 2016
$49.4M
Statistical Methods for Medical Tests and BiomarkersR01GM054438 · NIGMS · UNIVERSITY OF WASHINGTON · PI PEPE, MARGARET S. · 1996 to 2015
$4.7M
Statistical Methods for Evaluating Markers for Treatment SelectionR01CA152089 · NCI · FRED HUTCHINSON CANCER RESEARCH CENTER · PI JANES, HOLLY · 2010 to 2021
$3.8M
Statistical Methods for Longitudinal StudiesR01HL072966 · NHLBI · UNIVERSITY OF WASHINGTON · PI HEAGERTY, PATRICK J · 2003 to 2014
$1.9M
Methodology for development, validation, and use of novel endpoints in oncologyR01CA174779 · NCI · MAYO CLINIC ROCHESTER · PI MANDREKAR, SUMITHRA JAY · 2014 to 2017
$1.2M
NCATS NIH HHS UL1 TR000423NCATS NIH HHS UL1TR000423NCATS NIH HHS UL1 TR002319NCI NIH HHS R01 CA152089NCI NIH HHS R01 CA174779NHLBI NIH HHS R01 HL072966NIGMS NIH HHS R01 GM054438NIGMS NIH HHS R01 GM54438
6 · The paper itself

Abstract

Developing biomarkers that can predict whether patients are likely to benefit from an intervention is a pressing objective in many areas of medicine. Recent guidance documents have recommended that the accuracy of predictive biomarkers, ie, sensitivity, specificity, and positive and negative predictive values, should be assessed. We clarify the meanings of these entities for predictive markers and demonstrate that generally they cannot be estimated from data without making strong untestable assumptions. Language suggesting that predictive biomarkers can identify patients who benefit from an intervention is also widespread. We show that in general one cannot estimate the chance that a patient will benefit from treatment. We recommend instead that predictive biomarkers be evaluated with respect to their ability to predict clinical outcomes among patients treated and among patients receiving standard of care, and the population impact of treatment rules based on those predictions. Ideally these entities are estimated from a randomized trial comparing the experimental intervention with standard of care.

Indexed as

Biomarkers, TumorMolecular Targeted TherapyPredictive Value of TestsSensitivity and SpecificityAntineoplastic AgentsConcept FormationHumansRandomized Controlled Trials as TopicReproducibility of ResultsTreatment OutcomeAntineoplastic AgentsBiomarkers, Tumor

Identifiers

PMID26109106
PMCPMC4609557

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.