Evidence map›Paper›PMID 30134950›Full record

ArticleTrials2018

Adherence to the International Committee of Medical Journal Editors' (ICMJE) prospective registration policy and implications for outcome integrity: a cross-sectional analysis of trials published in high-impact specialty society journals.

Anand D Gopal, Joshua D Wallach, Jenerius A Aminawung, Gregg Gonsalves, Rafael Dal-Ré, Jennifer E Miller, Joseph S Ross

Abstract readComparative Study
In one paragraph

Article in Trials, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 36 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
36citing papers in PubMed, 5 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

36 citing papers in PubMed, 5 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Article
  7. Review
  8. Article
  9. Article
  10. Trends in Israeli clinical trials registration "MyTrial".Israel journal of health policy research · 2024
    Article
  11. Pedagogic Strategies and Contents in Medical Writing/Publishing Education: A Comprehensive Systematic Survey.European journal of investigation in health, psychology and education · 2024
    Review
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Observational
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Anand D GopalYale University School of Medicine, Harkness Hall, 367 Cedar Street, Box #415, New Haven, CT, 06510, USA. anand.gopal@yale.edu.ORCID http://orcid.org/0000-0002-5386-5396
Joshua D WallachCenter for Outcomes Research and Evaluation (CORE), Yale-New Haven Hospital and Collaboration for Research Integrity and Transparency, Yale University, New Haven, CT, USA.
Jenerius A AminawungYale University School of Medicine, Harkness Hall, 367 Cedar Street, Box #415, New Haven, CT, 06510, USA.
Gregg GonsalvesYale School of Public Health, New Haven, CT, USA.
Rafael Dal-RéEpidemiology Unit, Health Research Institute-Fundación Jiménez Díaz University Hospital, Universidad Autónoma de Madrid, Madrid, Spain.
Jennifer E MillerDivision of Medical Ethics, Department of Population Health, NYU School of Medicine, New York, NY, USA.
Joseph S RossCenter for Outcomes Research and Evaluation (CORE), Yale-New Haven Hospital and Collaboration for Research Integrity and Transparency, Yale University, New Haven, CT, USA.

Funding

Yale Clinical and Translational Science Award (U Component)UL1TR001863 · NCATS · YALE UNIVERSITY · PI John H. Krystal, LUCILA OHNO-MACHADO · 2016 to 2026
$102.9M
6 · The paper itself

Abstract

backgroundRegistration of clinical trials is critical for promoting transparency and integrity in medical research; however, trials must be registered in a prospective fashion to deter unaccounted protocol modifications or selection of alternate outcomes that may enhance favorability of reported findings. We assessed adherence to the International Committee of Medical Journal Editors' (ICMJE) prospective registration policy and identified the frequency of registrations occurring after potential observation of primary outcome data among trials published in the highest-impact journals associated with US professional medical societies. Additionally, we examined whether trials that are unregistered or registered after potential observation of primary outcome data were more likely to report favorable findings.

methodsWe conducted a retrospective, cross-sectional analysis of the 50 most recently published clinical trials that reported primary results in each of the ten highest-impact US medical specialty society journals between 1 January 2010 and 31 December 2015. We used descriptive statistics to characterize the proportions of trials that were: registered; registered retrospectively; registered retrospectively potentially after initial ascertainment of primary outcomes; and reporting favorable findings, overall and stratified by journal and trial characteristics. Chi-squared analyses were performed to assess differences in registration by journal and trial characteristics.

resultsWe reviewed 6869 original research reports published between 1 January 2010 and 31 December 2015 to identify a total of 486 trials across 472 publications. Of these 486 trials, 47 (10%) were unregistered. Among 439 registered trials, 340 (77%) were registered prospectively and 99 (23%) retrospectively. Sixty-seven (68%) of these 99 retrospectively registered trials, or 15% of all 439 registered trials, were registered after potential observation of primary outcome data ascertained among participants enrolled at inception. Industry-funded trials, those with enrollment sites in the US, as well as those assessing FDA-regulated interventions each had lower rates of retrospective registration. Unregistered trials were more likely to report favorable findings than were registered trials (89% vs. 64%; relative risk (RR) = 1.38, 95% confidence interval (CI) = 1.20-1.58; p = 0.004), irrespective of registration timing.

conclusionsAdherence to the ICMJE's prospective registration policy remains sub-standard, even in the highest-impact journals associated with US professional medical societies. These journals frequently published unregistered trials and trials registered after potential observation of primary outcome data.

Indexed as

Guidelines as TopicBibliometricsCross-Sectional StudiesGuideline AdherenceHumansJournal Impact FactorPeriodicals as TopicRandomized Controlled Trials as TopicResearch DesignRetrospective StudiesTime FactorsICMJESelective reportingTrial registration

Identifiers

PMID30134950
PMCPMC6106722

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.