Evidence map›Paper›PMID 39724369›Full record

SynthesisJAMA network open2024

Discordant Information on Blinding in Trial Registries and Published Research: A Systematic Review.

Fengying Zhang, Yi Zhu, Shengmin Zhao, Qian Zhang, Huan Tao, Yunhong Wu, Pengli Jia

Abstract readSystematic Review
In one paragraph

Synthesis in JAMA network open, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Fengying ZhangTibet Autonomous Region Clinical Research Center for High-Altitude Stress, Endocrinology and Metabolism Disease, Hospital of Chengdu Office of People's Government of Tibetan Autonomous Region (Hospital.C.T.), Chengdu, China.
Yi ZhuProof of Concept Center, Eastern Hepatobiliary Surgery Hospital, Third Affiliated Hospital, Second Military Medical University, Naval Medical University, Shanghai, China.
Shengmin ZhaoClinical Epidemiology and Evidence-based Medicine Research Center, West China Hospital, Sichuan University, Chengdu, Sichuan, China.
Qian ZhangDepartment of Environmental and Occupational Health, Sichuan University West China School of Public Health, West China Fourth Hospital, Chengdu, Sichuan, China.
Huan TaoDepartment of Hematology, West China Hospital, Sichuan University, Chengdu, Sichuan, China.
Yunhong WuTibet Autonomous Region Clinical Research Center for High-Altitude Stress, Endocrinology and Metabolism Disease, Hospital of Chengdu Office of People's Government of Tibetan Autonomous Region (Hospital.C.T.), Chengdu, China.
Pengli JiaSchool of Management, Shanxi Medical University, Taiyuan, China.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Importance: Blinding of individuals involved in randomized clinical trials (RCTs) can be used to protect against performance and biases, but discrepancies in the reporting of methodological features between registered protocols and subsequent trial publications may lead to inconsistencies, thereby reintroducing bias. Objective: To investigate inconsistency in blinding as reported in trial registries and publications. Data Sources: An exploratory dataset and a validation dataset were created. The exploratory dataset consisted of RCTs included in systematic reviews of adverse events from the SMART Safety database published between January 1, 2015, to January 1, 2020. The validation dataset was based on a literature search on PubMed for all registered RCTs published within the same time frame. Study Selection: Eligible RCTs for the exploratory dataset included were those that specified drug safety as the exclusive outcome and included at least 1 pairwise meta-analysis involving 5 or more RCTs of health care interventions. The validation dataset included a random selection of RCTs without restriction on outcome. Data Extraction and Synthesis: Preferred Reporting Items for Systematic Reviews and Meta-Analyses reporting guidelines were followed during data extraction. RCTs were matched to their registries and information on blinding was extracted from both the journal publication and trial registry. Extraction was performed by 1 author and cross-checked by 2 additional authors, with discrepancies resolved via consensus. The data analysis was conducted between July 2023 and January 2024. Main Outcomes and Measures: The primary outcome was inconsistency in blinding reports in the publication and the associated trial registry. Factors associated with the inconsistency were further investigated using multivariable logistic regression. The results were then compared with the validation dataset. Results: A total of 1340 RCTs were included, with a median (IQR) sample size of 338 (152-772) participants. Of these, 749 (55.90%) were multiregional, 1220 (91.04%) were multicenter, and 835 (62.31%) were prospectively registered. The most frequently studied condition was cancer, representing 472 trials (35.22%). In the exploratory dataset, 1080 trials (80.60%) had inconsistent reporting of blinding in their published trial registry. Higher odds of inconsistency were associated with trials conducted as single-center (OR, 2.84; 95% CI, 1.24-7.74; P = .02) or those focused on cancer (OR, 3.26; 95% CI, 2.04-5.38; P < .001). Evaluation of the 98 RCTs in the validation dataset revealed that 70 (71.43%) had inconsistencies between the published trial and its registries. The occurrence of inconsistencies was significantly higher in the exploratory dataset than the validation dataset (P = .03). Conclusions and Relevance: In this systematic review of RCTs, there were significant inconsistencies in the reporting of blinding between trial publications and their corresponding registries. These findings underscore the importance of maintaining consistency between registered protocols and published trial reports to ensure methodological transparency and minimize bias.

Indexed as

Randomized Controlled Trials as TopicRegistriesDouble-Blind MethodHumansResearch Design

Identifiers

PMID39724369
PMCPMC11672156

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.