Evidence map›Paper›PMID 39256834›Full record

ReviewBMC medicine2024

Addressing the credibility crisis in Mendelian randomization.

Stephen Burgess, Benjamin Woolf, Amy M Mason, Mika Ala-Korpela, Dipender Gill

Abstract readReview
In one paragraph

Review in BMC medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 66 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
66citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

66 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Observational
  11. Review
  12. Review
  13. Article
  14. Article
  15. Review
  16. Review
  17. Article
  18. Article
  19. Review
  20. Article

6 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Stephen BurgessMedical Research Council Biostatistics Unit, University of Cambridge, Cambridge, UK. sb452@medschl.cam.ac.uk.
Benjamin WoolfMedical Research Council Biostatistics Unit, University of Cambridge, Cambridge, UK.
Amy M MasonCardiovascular Epidemiology Unit, Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK.
Mika Ala-KorpelaSystems Epidemiology, Faculty of Medicine, Research Unit of Population Health, University of Oulu and Biocenter Oulu, Oulu, Finland.
Dipender GillDepartment of Epidemiology and Biostatistics, School of Public Health, Imperial College London, London, UK.

Funding

Wellcome Trust 225790
6 · The paper itself

Abstract

backgroundGenome-wide association studies have enabled Mendelian randomization analyses to be performed at an industrial scale. Two-sample summary data Mendelian randomization analyses can be performed using publicly available data by anyone who has access to the internet. While this has led to many insightful papers, it has also fuelled an explosion of poor-quality Mendelian randomization publications, which threatens to undermine the credibility of the whole approach.

findingsWe detail five pitfalls in conducting a reliable Mendelian randomization investigation: (1) inappropriate research question, (2) inappropriate choice of variants as instruments, (3) insufficient interrogation of findings, (4) inappropriate interpretation of findings, and (5) lack of engagement with previous work. We have provided a brief checklist of key points to consider when performing a Mendelian randomization investigation; this does not replace previous guidance, but highlights critical analysis choices. Journal editors should be able to identify many low-quality submissions and reject papers without requiring peer review. Peer reviewers should focus initially on key indicators of validity; if a paper does not satisfy these, then the paper may be meaningless even if it is technically flawless.

conclusionsPerforming an informative Mendelian randomization investigation requires critical thought and collaboration between different specialties and fields of research.

Indexed as

Mendelian Randomization AnalysisGenome-Wide Association StudyHumansBias evaluationCausal inferenceEvidence synthesisGenetic epidemiologyInstrumental variablesRisk of bias

Identifiers

PMID39256834
PMCPMC11389083

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.