Evidence map›Paper›PMID 27884869›Full record

SynthesisBMJ (Clinical research ed.)2016

Sex based subgroup differences in randomized controlled trials: empirical evidence from Cochrane meta-analyses.

Joshua D Wallach, Patrick G Sullivan, John F Trepanowski, Ewout W Steyerberg, John P A Ioannidis

Open access · hybridAbstract readMeta-Analysis
In one paragraph

Synthesis in BMJ (Clinical research ed.), 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 48 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
48citing papers in PubMed, 6 pooled it
6.7field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

48 citing papers in PubMed, 6 syntheses or guidelines pooled it, 87 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Trial
  8. Trial
  9. Trial
  10. Trial
  11. Article
  12. Claims of sex-dependent effects in the behavioral and brain sciences are infrequently supported by valid statistical comparisons.Proceedings of the National Academy of Sciences of the United States of America · 2026
    Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

5 authors at 2 institutions in 2 countries.

Joshua D WallachDepartment of Health Research and Policy, and Meta-Research Innovation Center at Stanford (METRICS), Stanford, CA, USA.
Patrick G SullivanDepartment of Health Research and Policy, and Meta-Research Innovation Center at Stanford (METRICS), Stanford, CA, USA.
John F TrepanowskiStanford Prevention Research Center, Stanford University, Stanford, CA, USA.
Ewout W SteyerbergDepartment of Public Health, Erasmus MC, Rotterdam, Netherlands.
John P A IoannidisDepartments of Medicine, Health Research and Policy, and Statistics, and Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, California, CA 94305, USA jioannid@stanford.edu.
Stanford University · USErasmus University Rotterdam · NL

Funding

CARDIOVASCULAR DISEASE PREVENTION TRAINING PROGRAMT32HL007034 · NHLBI · STANFORD UNIVERSITY · PI GARDNER, CHRISTOPHER D · 1985 to 2020
$8.7M
NHLBI NIH HHS T32 HL007034
6 · The paper itself

Abstract

objectiveTo evaluate the frequency, validity, and relevance of statistically significant (P<0.05) sex-treatment interactions in randomized controlled trials in Cochrane meta-analyses.

designMeta-epidemiological study. DATA SOURCES: Cochrane Database of Systematic Reviews (CDSR) and PubMed. ELIGIBILITY CRITERIA FOR STUDY SELECTION: Reviews published in the CDSR with sex-treatment subgroup analyses in the forest plots, using data from randomized controlled trials. DATA EXTRACTION: Information on the study design and sex subgroup data were extracted from reviews and forest plots that met inclusion criteria. For each statistically significant sex-treatment interaction, the potential for biological plausibility and clinical significance was considered.

resultsAmong the 41 reviews with relevant data, there were 109 separate treatment-outcome analyses ("topics"). Among the 109 topics, eight (7%) had a statistically significant sex-treatment interaction. The 109 topics included 311 randomized controlled trials (162 with both sexes, 46 with males only, 103 with females only). Of the 162 individual randomized controlled trials that included both sexes, 15 (9%) had a statistically significant sex-treatment interaction. Of four topics where the first published randomized controlled trial had a statistically significant sex-treatment interaction, no meta-analyses that included other randomized controlled trials retained the statistical significance and no meta-analyses showed statistical significance when data from the first published randomized controlled trial were excluded. Of the eight statistically significant sex-treatment interactions from the overall analyses, only three were discussed by the CDSR reviewers for a potential impact on different clinical management for males compared with females. None of these topics had a sex-treatment interaction that influenced treatment recommendations in recent guidelines. UpToDate, an online physician-authored clinical decision support resource, suggested differential management of men and women for one of these sex-treatment interactions.

conclusionStatistically significant sex-treatment interactions are only slightly more frequent than what would be expected by chance and there is little evidence of subsequent corroboration or clinical relevance of sex-treatment interactions.

Indexed as

BenzodiazepinesBiasCarotid StenosisEndarterectomy, CarotidFemaleHumansHyperprolactinemiaIncidenceLung NeoplasmsMaleOlanzapineOutcome Assessment, Health CareProlactinRandomized Controlled Trials as TopicRisperidoneSex FactorsBenzodiazepinesOlanzapineProlactinRisperidone

Identifiers

PMID27884869
PMCPMC5122320
OpenAlexW2554898265

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.