Evidence map›Paper›PMID 28296925›Full record

ArticlePloS one2017

Worldwide trends in volume and quality of published protocols of randomized controlled trials.

Belle V van Rosmalen, Ingo Alldinger, Kasia P Cieslak, Roos Wennink, Mike Clarke, Usama Ahmed Ali, Marc G H Besselink

Erratum issuedAbstract read
In one paragraph

Article in PloS one, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 14 papers.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed.

  1. How can we make sound replication decisions?Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

7 authors.

Belle V van RosmalenDepartment of Surgery, Academic Medical Centre, Amsterdam, The Netherlands.ORCID 0000-0002-4507-7189
Ingo AlldingerDepartment of General, Visceral and Transplantation Surgery, University of Heidelberg, Heidelberg, Germany.
Kasia P CieslakDepartment of Surgery, Academic Medical Centre, Amsterdam, The Netherlands.
Roos WenninkDepartment of Surgery, University Medical Centre Utrecht, Utrecht, The Netherlands.
Mike ClarkeNorthern Ireland Network for Trials Methodology Research, Queen's University Belfast, Belfast, Northern Ireland.
Usama Ahmed AliDepartment of Surgery, University Medical Centre Utrecht, Utrecht, The Netherlands.
Marc G H BesselinkDepartment of Surgery, Academic Medical Centre, Amsterdam, The Netherlands.

Funding

Medical Research Council G0901530
6 · The paper itself

Abstract

introductionPublishing protocols of randomized controlled trials (RCT) facilitates a more detailed description of study rational, design, and related ethical and safety issues, which should promote transparency. Little is known about how the practice of publishing protocols developed over time. Therefore, this study describes the worldwide trends in volume and methodological quality of published RCT protocols.

methodsA systematic search was performed in PubMed and EMBASE, identifying RCT protocols published over a decade from 1 September 2001. Data were extracted on quality characteristics of RCT protocols. The primary outcome, methodological quality, was assessed by individual methodological characteristics (adequate generation of allocation, concealment of allocation and intention-to-treat analysis). A comparison was made by publication period (First, September 2001- December 2004; Second, January 2005-May 2008; Third, June 2008-September 2011), geographical region and medical specialty.

resultsThe number of published RCT protocols increased from 69 in the first, to 390 in the third period (p<0.0001). Internal medicine and paediatrics were the most common specialty topics. Whereas most published RCT protocols in the first period originated from North America (n = 30, 44%), in the second and third period this was Europe (respectively, n = 65, 47% and n = 190, 48%, p = 0.02). Quality of RCT protocols was higher in Europe and Australasia, compared to North America (OR = 0.63, CI = 0.40-0.99, p = 0.04). Adequate generation of allocation improved with time (44%, 58%, 67%, p = 0.001), as did concealment of allocation (38%, 53%, 55%, p = 0.03). Surgical protocols had the highest quality among the three specialty topics used in this study (OR = 1.94, CI = 1.09-3.45, p = 0.02).

conclusionPublishing RCT protocols has become popular, with a five-fold increase in the past decade. The quality of published RCT protocols also improved, although variation between geographical regions and across medical specialties was seen. This emphasizes the importance of international standards of comprehensive training in RCT methodology.

Indexed as

Clinical ProtocolsPublicationsRandomized Controlled Trials as Topic

Identifiers

PMID28296925
PMCPMC5351864

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.