Evidence map›Paper›PMID 27294570›Full record

ArticleAnnals of internal medicine2016

ClinicalTrials.gov and Drugs@FDA: A Comparison of Results Reporting for New Drug Approval Trials.

Lisa M Schwartz, Steven Woloshin, Eugene Zheng, Tony Tse, Deborah A Zarin

Abstract readComparative StudyValidation Study
In one paragraph

Article in Annals of internal medicine, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 39 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
39citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

39 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Industry sponsorship and research outcome.The Cochrane database of systematic reviews · 2017
    Pooled it
  2. Trial
  3. Trial
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. INTEDE 2.0: the metabolic roadmap of drugs.Nucleic acids research · 2024
    Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Lisa M SchwartzFrom The Dartmouth Institute for Health Policy and Clinical Practice, Dartmouth Hitchcock, and Informulary, Lebanon, New Hampshire, and the National Library of Medicine, Bethesda, Maryland.
Steven WoloshinFrom The Dartmouth Institute for Health Policy and Clinical Practice, Dartmouth Hitchcock, and Informulary, Lebanon, New Hampshire, and the National Library of Medicine, Bethesda, Maryland.
Eugene ZhengFrom The Dartmouth Institute for Health Policy and Clinical Practice, Dartmouth Hitchcock, and Informulary, Lebanon, New Hampshire, and the National Library of Medicine, Bethesda, Maryland.
Tony TseFrom The Dartmouth Institute for Health Policy and Clinical Practice, Dartmouth Hitchcock, and Informulary, Lebanon, New Hampshire, and the National Library of Medicine, Bethesda, Maryland.
Deborah A ZarinFrom The Dartmouth Institute for Health Policy and Clinical Practice, Dartmouth Hitchcock, and Informulary, Lebanon, New Hampshire, and the National Library of Medicine, Bethesda, Maryland.

Funding

Translational Engineering in Cancer (TEC)P30CA023108 · NCI · DARTMOUTH COLLEGE · PI Steven D Leach · 1985 to 2026
$91.3M
Intramural NIH HHS Z99 LM999999NCI NIH HHS P30 CA023108
6 · The paper itself

Abstract

backgroundPharmaceutical companies and other trial sponsors must submit certain trial results to ClinicalTrials.gov. The validity of these results is unclear. PURPOSE: To validate results posted on ClinicalTrials.gov against publicly available U.S. Food and Drug Administration (FDA) reviews on Drugs@FDA. DATA SOURCES: ClinicalTrials.gov (registry and results database) and Drugs@FDA (medical and statistical reviews). STUDY SELECTION: 100 parallel-group, randomized trials for new drug approvals (January 2013 to July 2014) with results posted on ClinicalTrials.gov (15 March 2015). DATA EXTRACTION: 2 assessors extracted, and another verified, the trial design, primary and secondary outcomes, adverse events, and deaths.

resultsMost trials were phase 3 (90%), double-blind (92%), and placebo-controlled (73%) and involved 32 drugs from 24 companies. Of 137 primary outcomes identified from ClinicalTrials.gov, 134 (98%) had corresponding data at Drugs@FDA, 130 (95%) had concordant definitions, and 107 (78%) had concordant results. Most differences were nominal (that is, relative difference <10%). Primary outcome results in 14 trials could not be validated. Of 1927 secondary outcomes from ClinicalTrials.gov, Drugs@FDA mentioned 1061 (55%) and included results data for 367 (19%). Of 96 trials with 1 or more serious adverse events in either source, 14 could be compared and 7 had discordant numbers of persons experiencing the adverse events. Of 62 trials with 1 or more deaths in either source, 25 could be compared and 17 were discordant. LIMITATION: Unknown generalizability to uncontrolled or crossover trial results.

conclusionPrimary outcome definitions and results were largely concordant between ClinicalTrials.gov and Drugs@FDA. Half the secondary outcomes, as well as serious events and deaths, could not be validated because Drugs@FDA includes only "key outcomes" for regulatory decision making and frequently includes only adverse event results aggregated across multiple trials. PRIMARY FUNDING SOURCE: National Library of Medicine.

Indexed as

Drug ApprovalNational Library of Medicine (U.S.)United States Food and Drug AdministrationClinical Trials as TopicDatabases, FactualDrug-Related Side Effects and Adverse ReactionsHumansUnited States

Identifiers

PMID27294570
PMCPMC5028264

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.