Evidence map›Paper›PMID 37294569›Full record

ArticleJAMA network open2023

Reminding Peer Reviewers of Reporting Guideline Items to Improve Completeness in Published Articles: Primary Results of 2 Randomized Trials.

Benjamin Speich, Erika Mann, Christof M Schönenberger, Katie Mellor, Alexandra N Griessbach, Paula Dhiman, Pooja Gandhi, Szimonetta Lohner, Arnav Agarwal, Ayodele Odutayo and 10 more

2 registry-linked trialsAbstract read
In one paragraph

Article in JAMA network open, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 2 registered trials, which are not on this map. Cited by 14 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05820971 nacompletednot on this map

Impact of a Short Form of the CONSORT Checklist for Peer Reviewers to Improve the Reporting of Randomised Controlled Trials Published in Biomedical Journals: a Randomised Controlled Trial

TypeinterventionalSponsorUniversity of OxfordRan2019 to 2022Enrolled243ConditionsAdequate Reporting in Randomized Controlled TrialsArmsC-short plus usual practice
NCT05820984 nacompletednot on this map

Impact of a Short Form of the SPIRIT Checklist for Peer Reviewers to Improve the Reporting of Protocols for Randomised Controlled Trials Published in Biomedical Journals: a Randomised Controlled Trial (SPIRIT-PR)

TypeinterventionalSponsorUniversity of OxfordRan2020 to 2022Enrolled178ConditionsAdequate Reporting in Published Study Protocols of Randomized Controlled TrialsArmsSPIRIT checklist plus usual practice, Usual practice
3 · Its place in the literature

Who cites it

14 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. The present and future of peer review: Ideas, interventions, and evidence.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  9. Article
  10. Article
  11. Article
  12. Reviewer training for improving grant and journal peer review.The Cochrane database of systematic reviews · 2023
    Article
  13. Article
  14. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

20 authors.

Benjamin SpeichCentre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.
Erika MannPLOS, Public Library of Science, San Francisco, California.
Christof M SchönenbergerCLEAR Methods Center, Division of Clinical Epidemiology, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.
Katie MellorCentre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.
Alexandra N GriessbachCLEAR Methods Center, Division of Clinical Epidemiology, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.
Paula DhimanCentre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.
Pooja GandhiRehabilitation Sciences Institute, University of Toronto, Toronto, Ontario, Canada.
Szimonetta LohnerCochrane Hungary, Clinical Centre of the University of Pécs, Medical School, University of Pécs, Pécs, Hungary.
Arnav AgarwalDepartment of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada.
Ayodele OdutayoCentre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.
Iratxe PueblaPLOS, Public Library of Science, San Francisco, California.
Alejandra ClarkPLOS, Public Library of Science, San Francisco, California.
An-Wen ChanDepartment of Medicine, Women's College Research Institute, Women's College Hospital, University of Toronto, Toronto, Ontario, Canada.
Michael M SchlusselCentre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.
Philippe RavaudCentre d'Épidémiologie Clinique, Hôpital Hôtel-Dieu, Assistance Publique Hôpitaux de Paris, Paris, France.
David MoherCentre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.
Matthias BrielCLEAR Methods Center, Division of Clinical Epidemiology, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.
Isabelle BoutronCentre d'Épidémiologie Clinique, Hôpital Hôtel-Dieu, Assistance Publique Hôpitaux de Paris, Paris, France.
Sara SchroterThe BMJ , London, United Kingdom.
Sally HopewellCentre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, United Kingdom.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Importance: Numerous studies have shown that adherence to reporting guidelines is suboptimal. Objective: To evaluate whether asking peer reviewers to check if specific reporting guideline items were adequately reported would improve adherence to reporting guidelines in published articles. Design, Setting, and Participants: Two parallel-group, superiority randomized trials were performed using manuscripts submitted to 7 biomedical journals (5 from the BMJ Publishing Group and 2 from the Public Library of Science) as the unit of randomization, with peer reviewers allocated to the intervention or control group. Interventions: The first trial (CONSORT-PR) focused on manuscripts that presented randomized clinical trial (RCT) results and reported following the Consolidated Standards of Reporting Trials (CONSORT) guideline, and the second trial (SPIRIT-PR) focused on manuscripts that presented RCT protocols and reported following the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guideline. The CONSORT-PR trial included manuscripts that described RCT primary results (submitted July 2019 to July 2021). The SPIRIT-PR trial included manuscripts that contained RCT protocols (submitted June 2020 to May 2021). Manuscripts in both trials were randomized (1:1) to the intervention or control group; the control group received usual journal practice. In the intervention group of both trials, peer reviewers received an email from the journal that asked them to check whether the 10 most important and poorly reported CONSORT (for CONSORT-PR) or SPIRIT (for SPIRIT-PR) items were adequately reported in the manuscript. Peer reviewers and authors were not informed of the purpose of the study, and outcome assessors were blinded. Main Outcomes and Measures: The difference in the mean proportion of adequately reported 10 CONSORT or SPIRIT items between the intervention and control groups in published articles. Results: In the CONSORT-PR trial, 510 manuscripts were randomized. Of those, 243 were published (122 in the intervention group and 121 in the control group). A mean proportion of 69.3% (95% CI, 66.0%-72.7%) of the 10 CONSORT items were adequately reported in the intervention group and 66.6% (95% CI, 62.5%-70.7%) in the control group (mean difference, 2.7%; 95% CI, -2.6% to 8.0%). In the SPIRIT-PR trial, of the 244 randomized manuscripts, 178 were published (90 in the intervention group and 88 in the control group). A mean proportion of 46.1% (95% CI, 41.8%-50.4%) of the 10 SPIRIT items were adequately reported in the intervention group and 45.6% (95% CI, 41.7% to 49.4%) in the control group (mean difference, 0.5%; 95% CI, -5.2% to 6.3%). Conclusions and Relevance: These 2 randomized trials found that it was not useful to implement the tested intervention to increase reporting completeness in published articles. Other interventions should be assessed and considered in the future. Trial Registration: ClinicalTrials.gov Identifiers: NCT05820971 (CONSORT-PR) and NCT05820984 (SPIRIT-PR).

Indexed as

PublicationsControl GroupsGuidelines as TopicHumansRandomized Controlled Trials as TopicReference Standards

Identifiers

PMID37294569
PMCPMC10257091

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.