Evidence map›Paper›PMID 29514787›Full record

Observational studyBMJ (Clinical research ed.)2018

Frequency and level of evidence used in recommendations by the National Comprehensive Cancer Network guidelines beyond approvals of the US Food and Drug Administration: retrospective observational study.

Jeffrey Wagner, John Marquart, Julia Ruby, Austin Lammers, Sham Mailankody, Victoria Kaestner, Vinay Prasad

Abstract readComparative StudyObservational Study
In one paragraph

Observational study in BMJ (Clinical research ed.), 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Guideline
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Observational
  7. Article
  8. Article
  9. An urgent call to raise the bar in oncology.British journal of cancer · 2021
    Review
  10. Article
  11. Observational
  12. Article
  13. Article
  14. Status Update on Data Required to Build a Learning Health System.Journal of clinical oncology : official journal of the American Society of Clinical Oncology · 2020
    Article
  15. Article
  16. When is off-label off-road?Annals of oncology : official journal of the European Society for Medical Oncology · 2019
    Article
  17. Article
  18. Article
  19. Cancer drug development: The missing links.Experimental biology and medicine (Maywood, N.J.) · 2019
    Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Jeffrey WagnerSchool of Medicine, Oregon Health & Science University, Portland, OR 97239, USA.
John MarquartSchool of Medicine, Oregon Health & Science University, Portland, OR 97239, USA.
Julia RubySchool of Medicine, Oregon Health & Science University, Portland, OR 97239, USA.
Austin LammersDivison of Hematology Oncology, Knight Cancer Institute, Oregon Health & Science University, Portland, OR, USA.
Sham MailankodyDivision of Myeloma, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
Victoria KaestnerDivison of Hematology Oncology, Knight Cancer Institute, Oregon Health & Science University, Portland, OR, USA.
Vinay PrasadDivison of Hematology Oncology, Knight Cancer Institute, Oregon Health & Science University, Portland, OR, USA prasad@ohsu.edu.

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Hongbiao Carl Lekaye · 1985 to 2026
$347.4M
NCI NIH HHS P30 CA008748
6 · The paper itself

Abstract

objectiveTo determine the differences between recommendations by the National Comprehensive Cancer Network (NCNN) guidelines and Food and Drug Administration approvals of anticancer drugs, and the evidence cited by the NCCN to justify recommendations where differences exist.

designRetrospective observational study.

settingNational Comprehensive Cancer Network and FDA.

participants47 new molecular entities approved by the FDA between 2011 and 2015.

main outcome measuresComparison of all FDA approved indications (new and supplemental) with all NCCN recommendations as of 25 March 2016. When the NCCN made recommendations beyond the FDA's approvals, the recommendation was classified and the cited evidence noted.

results47 drugs initially approved by the FDA between 2011 and 2015 for adult hematologic or solid cancers were examined. These 47 drugs were authorized for 69 FDA approved indications, whereas the NCCN recommended these drugs for 113 indications, of which 69 (62%) overlapped with the 69 FDA approved indications and 44 (39%) were additional recommendations. The average number of recommendations beyond the FDA approved indications was 0.92. 23% (n=10) of the additional recommendations were based on evidence from randomized controlled trials, and 16% (n=7) were based on evidence from phase III studies. During 21 months of follow-up, the FDA granted approval to 14% (n=6) of the additional recommendations.

conclusionThe NCCN frequently recommends beyond the FDA approved indications even for newer, branded drugs. The strength of the evidence cited by the NCCN supporting such recommendations is weak. Our findings raise concern that the NCCN justifies the coverage of costly, toxic cancer drugs based on weak evidence.

Indexed as

Antineoplastic AgentsDrug ApprovalEvidence-Based MedicineHumansOncology Service, HospitalOrganizations, NonprofitPatient Care ManagementRetrospective StudiesUnited StatesUnited States Food and Drug AdministrationAntineoplastic Agents

Identifiers

PMID29514787
PMCPMC5838851

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.