Evidence map›Paper›PMID 36154932›Full record

ArticleBMC medicine2022

Transparency and reporting characteristics of COVID-19 randomized controlled trials.

Philipp Kapp, Laura Esmail, Lina Ghosn, Philippe Ravaud, Isabelle Boutron

Abstract read
In one paragraph

Article in BMC medicine, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Philipp KappUniversité Paris Cité, Inserm, INRAE, Centre of Research in Epidemiology and Statistics (CRESS), F-75004, Paris, France.
Laura EsmailUniversité Paris Cité, Inserm, INRAE, Centre of Research in Epidemiology and Statistics (CRESS), F-75004, Paris, France.
Lina GhosnUniversité Paris Cité, Inserm, INRAE, Centre of Research in Epidemiology and Statistics (CRESS), F-75004, Paris, France.
Philippe RavaudUniversité Paris Cité, Inserm, INRAE, Centre of Research in Epidemiology and Statistics (CRESS), F-75004, Paris, France.
Isabelle BoutronUniversité Paris Cité, Inserm, INRAE, Centre of Research in Epidemiology and Statistics (CRESS), F-75004, Paris, France. isabelle.boutron@aphp.fr.ORCID 0000-0002-5263-6241

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundIn the context of the COVID-19 pandemic, randomized controlled trials (RCTs) are essential to support clinical decision-making. We aimed (1) to assess and compare the reporting characteristics of RCTs between preprints and peer-reviewed publications and (2) to assess whether reporting improves after the peer review process for all preprints subsequently published in peer-reviewed journals.

methodsWe searched the Cochrane COVID-19 Study Register and L·OVE COVID-19 platform to identify all reports of RCTs assessing pharmacological treatments of COVID-19, up to May 2021. We extracted indicators of transparency (e.g., trial registration, data sharing intentions) and assessed the completeness of reporting (i.e., some important CONSORT items, conflict of interest, ethical approval) using a standardized data extraction form. We also identified paired reports published in preprint and peer-reviewed publications.

resultsWe identified 251 trial reports: 121 (48%) were first published in peer-reviewed journals, and 130 (52%) were first published as preprints. Transparency was poor. About half of trials were prospectively registered (n = 140, 56%); 38% (n = 95) made their full protocols available, and 29% (n = 72) provided access to their statistical analysis plan report. A data sharing statement was reported in 68% (n = 170) of the reports of which 91% stated their willingness to share. Completeness of reporting was low: only 32% (n = 81) of trials completely defined the pre-specified primary outcome measures; 57% (n = 143) reported the process of allocation concealment. Overall, 51% (n = 127) adequately reported the results for the primary outcomes while only 14% (n = 36) of trials adequately described harms. Primary outcome(s) reported in trial registries and published reports were inconsistent in 49% (n = 104) of trials; of them, only 15% (n = 16) disclosed outcome switching in the report. There were no major differences between preprints and peer-reviewed publications. Of the 130 RCTs published as preprints, 78 were subsequently published in a peer-reviewed journal. There was no major improvement after the journal peer review process for most items.

conclusionsTransparency, completeness, and consistency of reporting of COVID-19 clinical trials were insufficient both in preprints and peer-reviewed publications. A comparison of paired reports published in preprint and peer-reviewed publication did not indicate major improvement.

Indexed as

COVID-19HumansInformation DisseminationPeer ReviewRandomized Controlled Trials as TopicResearch ReportCONSORTCOVID-19Peer review; Completeness of reportingQuality of reportingRandomized controlled trialSelection biasSelective outcome reportingTransparency

Identifiers

PMID36154932
PMCPMC9510360

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.