Evidence map›Paper›PMID 36936564›Full record

ArticleBMJ medicine2022

Vibration of effect in more than 16 000 pooled analyses of individual participant data from 12 randomised controlled trials comparing canagliflozin and placebo for type 2 diabetes mellitus: multiverse analysis.

Henri Gouraud, Joshua D Wallach, Rémy Boussageon, Joseph S Ross, Florian Naudet

Open access · goldAbstract read
In one paragraph

Article in BMJ medicine, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
1.0field-weighted citation impact, top 23% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 8 citations in OpenAlex.

  1. Article
  2. What is the vibration of effects?BMJ evidence-based medicine · 2025
    Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 3 institutions in 2 countries.

Henri GouraudInserm, CIC 1414 (Centre d'Investigation Clinique de Rennes), Rennes 1 University, Rennes, France.ORCID 0000-0003-3882-3160
Joshua D WallachDepartment of Environmental Health Sciences, Yale University School of Public Health, New Haven, CT, USA.ORCID 0000-0002-2816-6905
Rémy BoussageonUCBL, CNRS, UMR 5558, LBBE, EMET, University Claude Bernard Lyon 1, Villeurbanne, France.ORCID 0000-0002-8918-3186
Joseph S RossDepartment of Internal Medicine, Yale School of Medicine, New Haven, CT, USA.ORCID 0000-0002-9218-3320
Florian NaudetInserm, CIC 1414 (Centre d'Investigation Clinique de Rennes), Rennes 1 University, Rennes, France.ORCID 0000-0003-3760-3801
Inserm · FRYale University · USUniversité Claude Bernard Lyon 1 · FR

Funding

Leveraging Physician Networks to Improve Care and Outcomes for Low-Income PopulationsR01HL144644 · NHLBI · YALE UNIVERSITY · PI NDUMELE, CHIMA · 2019 to 2021
$1.6M
Identifying Patient Subgroups That Are Most Likely To Benefit From Medications Used To Treat Alcohol Use DisorderK01AA028258 · NIAAA · YALE UNIVERSITY · PI WALLACH, JOSHUA DAVID · 2021 to 2025
$892k
AHRQ HHS R01 HS022882AHRQ HHS R01 HS025164FDA HHS U01 FD005938NHLBI NIH HHS R01 HL144644NIAAA NIH HHS K01 AA028258
6 · The paper itself

Abstract

Objective: To evaluate the impact of conducting all possible pooled analyses across different combinations of randomised controlled trials and endpoints. Design: Multiverse analysis, consisting of numerous pooled analyses of individual participant data. Setting: Individual patient data from 12 randomised controlled trials comparing canagliflozin treatment with placebo, shared on the Yale University Open Data Access project (https://yoda.yale.edu/) platform, up to 16 April 2021. Participants: 15 094 people with type 2 diabetes mellitus. Main outcome measures: Pooled analyses estimated changes in serum glycated haemoglobin (HbA1c), major adverse cardiovascular events, and serious adverse events at weeks 12, 18, 26, and 52. The distribution of effect estimates was calculated for all possible combinations, and the direction and magnitude of the first and 99th centiles of effect estimates were compared. Results: Across 16 332 distinct pooled analyses comparing canagliflozin with placebo for changes in HbA1c, standardised effect estimates were in favour of canagliflozin treatment at both the first centile (-0.75%) and 99th centile (-0.48%); 15 994 (97.93%) analyses showed significant results (P<0.05) in favour of canagliflozin. For major adverse cardiovascular events, estimated hazard ratios were 0.20 at the first centile and 0.90 at the 99th centile; 2705 of 8144 analyses (33.21%) were significant, all of which were in favour of canagliflozin treatment. For serious adverse events, estimated hazard ratios were 0.59 at the first centile and 1.14 at the 99th centile; 5793 of 16 332 (35.47%) analyses were significant, with 5754 in favour of canagliflozin and 39 in favour of placebo. Conclusion: Results from pooled analyses can be subject to vibration of effects and should be critically appraised, especially regarding the risk for selection and availability bias in individual participant data retrieved.

Indexed as

Diabetes mellitusDrug therapyStatisticsTherapeutics

Identifiers

PMID36936564
PMCPMC9978683
OpenAlexW4295681414

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.