Evidence map›Paper›PMID 35476675›Full record

ArticlePLoS medicine2022

Nonregistration, discontinuation, and nonpublication of randomized trials: A repeated metaresearch analysis.

Benjamin Speich, Dmitry Gryaznov, Jason W Busse, Viktoria L Gloy, Szimonetta Lohner, Katharina Klatte, Ala Taji Heravi, Nilabh Ghosh, Hopin Lee, Anita Mansouri and 32 more

Abstract read
In one paragraph

Article in PLoS medicine, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 33 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
33citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

33 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Time to publication for results of clinical trials.The Cochrane database of systematic reviews · 2024
    Pooled it
  3. Pooled it
  4. Surgery for the treatment of obesity in children and adolescents.The Cochrane database of systematic reviews · 2022
    Pooled it
  5. Trial
  6. Trial
  7. Trial
  8. Article
  9. Article
  10. Observational
  11. Review
  12. Article
  13. Article
  14. Determinants of publication likelihood and timeliness for clinical studies.Journal of clinical and translational science · 2026
    Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

42 authors.

Benjamin SpeichMeta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.ORCID 0000-0002-3301-8085
Dmitry GryaznovMeta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.ORCID 0000-0002-2361-6794
Jason W BusseDepartment of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada.ORCID 0000-0002-0178-8712
Viktoria L GloyMeta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.
Szimonetta LohnerCochrane Hungary, Clinical Centre of the University of Pécs, Medical School, University of Pécs, Pécs, Hungary.ORCID 0000-0002-6292-4802
Katharina KlatteClinical Trial Unit, Department of Clinical Research, University of Basel and University Hospital Basel, Basel, Switzerland.
Ala Taji HeraviMeta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.ORCID 0000-0003-3752-1611
Nilabh GhoshMeta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.
Hopin LeeOxford Clinical Trials Research Unit / Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.ORCID 0000-0001-5692-0314
Anita MansouriOxford Clinical Trials Research Unit / Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.ORCID 0000-0002-7500-1636
Ioana R MarianOxford Clinical Trials Research Unit / Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.ORCID 0000-0002-0692-8112
Ramon SaccilottoClinical Trial Unit, Department of Clinical Research, University of Basel and University Hospital Basel, Basel, Switzerland.
Edris NuryInstitute for Evidence in Medicine (for Cochrane Germany Foundation), Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany.ORCID 0000-0001-5098-0375
Benjamin KasendaDepartment of Medical Oncology, University of Basel and University Hospital Basel, Basel, Switzerland.ORCID 0000-0003-0110-8585
Elena Ojeda-RuizMeta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.ORCID 0000-0002-4620-7010
Stefan SchandelmaierMeta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.ORCID 0000-0002-8429-0337
Yuki TomonagaEpidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland.
Alain AmstutzMeta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.ORCID 0000-0003-1716-993X
Christiane Pauli-MagnusClinical Trial Unit, Department of Clinical Research, University of Basel and University Hospital Basel, Basel, Switzerland.
Karin BischoffInstitute for Evidence in Medicine, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany.
Katharina WollmannCochrane Germany, Cochrane Germany Foundation, Freiburg, Germany.ORCID 0000-0001-7853-4967
Laura RehnerInstitute for Evidence in Medicine, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany.ORCID 0000-0003-1710-5450
Joerg J MeerpohlInstitute for Evidence in Medicine, Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany.ORCID 0000-0002-1333-5403
Alain NordmannMeta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.
Jacqueline WongDepartment of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada.ORCID 0000-0002-7583-8137
Ngai ChowDepartment of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada.
Patrick Jiho HongDepartment of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada.
Kimberly Mc Cord-De IacoMeta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.ORCID 0000-0002-2147-3160
Sirintip SricharoenchaiMeta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.ORCID 0000-0002-4438-4961
Arnav AgarwalDepartment of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada.ORCID 0000-0002-0931-7851
Matthias SchwenkglenksEpidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland.ORCID 0000-0001-7217-1173
Lars G HemkensMeta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.ORCID 0000-0002-3444-1432
Erik von ElmCochrane Switzerland, Centre for Primary Care and Public Health (Unisanté), University of Lausanne, Lausanne, Switzerland.ORCID 0000-0002-7412-0406
Bethan CopseyOxford Clinical Trials Research Unit / Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.ORCID 0000-0001-9783-6549
Alexandra N GriessbachMeta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.ORCID 0000-0003-3726-1856
Christof SchönenbergerMeta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.ORCID 0000-0002-9856-3500
Dominik MertzDepartment of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada.ORCID 0000-0003-4337-1613
Anette BlümleSwiss Tropical and Public Health Institute, Basel, Switzerland.ORCID 0000-0003-2877-1029
Belinda von NiederhäusernDepartment of Public Health Medicine, Medical School, University of Pécs, Pécs, Hungary.
Sally HopewellOxford Clinical Trials Research Unit / Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.
Ayodele OdutayoOxford Clinical Trials Research Unit / Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.
Matthias BrielMeta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.ORCID 0000-0002-2070-5230

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundWe previously found that 25% of 1,017 randomized clinical trials (RCTs) approved between 2000 and 2003 were discontinued prematurely, and 44% remained unpublished at a median of 12 years follow-up. We aimed to assess a decade later (1) whether rates of completion and publication have increased; (2) the extent to which nonpublished RCTs can be identified in trial registries; and (3) the association between reporting quality of protocols and premature discontinuation or nonpublication of RCTs. METHODS AND

findingsWe included 326 RCT protocols approved in 2012 by research ethics committees in Switzerland, the United Kingdom, Germany, and Canada in this metaresearch study. Pilot, feasibility, and phase 1 studies were excluded. We extracted trial characteristics from each study protocol and systematically searched for corresponding trial registration (if not reported in the protocol) and full text publications until February 2022. For trial registrations, we searched the (i) World Health Organization: International Clinical Trial Registry Platform (ICTRP); (ii) US National Library of Medicine (ClinicalTrials.gov); (iii) European Union Drug Regulating Authorities Clinical Trials Database (EUCTR); (iv) ISRCTN registry; and (v) Google. For full text publications, we searched PubMed, Google Scholar, and Scopus. We recorded whether RCTs were registered, discontinued (including reason for discontinuation), and published. The reporting quality of RCT protocols was assessed with the 33-item SPIRIT checklist. We used multivariable logistic regression to examine the association between the independent variables protocol reporting quality, planned sample size, type of control (placebo versus other), reporting of any recruitment projection, single-center versus multicenter trials, and industry versus investigator sponsoring, with the 2 dependent variables: (1) publication of RCT results; and (2) trial discontinuation due to poor recruitment. Of the 326 included trials, 19 (6%) were unregistered. Ninety-eight trials (30%) were discontinued prematurely, most often due to poor recruitment (37%; 36/98). One in 5 trials (21%; 70/326) remained unpublished at 10 years follow-up, and 21% of unpublished trials (15/70) were unregistered. Twenty-three of 147 investigator-sponsored trials (16%) reported their results in a trial registry in contrast to 150 of 179 industry-sponsored trials (84%). The median proportion of reported SPIRIT items in included RCT protocols was 69% (interquartile range 61% to 77%). We found no variables associated with trial discontinuation; however, lower reporting quality of trial protocols was associated with nonpublication (odds ratio, 0.71 for each 10% increment in the proportion of SPIRIT items met; 95% confidence interval, 0.55 to 0.92; p = 0.009). Study limitations include that the moderate sample size may have limited the ability of our regression models to identify significant associations.

conclusionsWe have observed that rates of premature trial discontinuation have not changed in the past decade. Nonpublication of RCTs has declined but remains common; 21% of unpublished trials could not be identified in registries. Only 16% of investigator-sponsored trials reported results in a trial registry. Higher reporting quality of RCT protocols was associated with publication of results. Further efforts from all stakeholders are needed to improve efficiency and transparency of clinical research.

Indexed as

Research PersonnelGermanyHumansOdds RatioRandomized Controlled Trials as TopicRegistries

Identifiers

PMID35476675
PMCPMC9094518

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.