Evidence map›Paper›PMID 34954645›Full record

ArticleEnvironment international2022

How to report E-values for meta-analyses: Recommended improvements and additions to the new GRADE approach.

Maya B Mathur, Tyler J VanderWeele

Abstract readLetterComment
In one paragraph

Article in Environment international, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

2 authors.

Maya B MathurQuantitative Sciences Unit and Department of Pediatrics, Stanford University, United States. Electronic address: mmathur@stanford.edu.
Tyler J VanderWeeleDepartment of Epidemiology, Harvard University, United States.

Funding

Translational Oncology Research Program (Project-005)P30CA124435 · NCI · STANFORD UNIVERSITY · PI Melinda L. Telli · 2007 to 2026
$71.4M
Stanford Center for Clinical & Translational Education and Research (Spectrum)UL1TR003142 · NCATS · STANFORD UNIVERSITY · PI O'HARA, RUTH M · 2019 to 2023
$45.0M
Stanford Islet Research CoreP30DK116074 · NIDDK · STANFORD UNIVERSITY · PI Seung K Kim · 2017 to 2026
$19.5M
Theory and methods for mediation and interactionR01CA222147 · NCI · HARVARD SCHOOL OF PUBLIC HEALTH · PI TCHETGEN TCHETGEN, ERIC JOEL, VANDERWEELE, TYLER · 2018 to 2022
$2.1M
Statistical Methods for Modern Evidence Syntheses with Multiple BiasesR01LM013866 · NLM · STANFORD UNIVERSITY · PI MATHUR, MAYA · 2021 to 2024
$1.3M
NCATS NIH HHS UL1 TR003142NCI NIH HHS P30 CA124435NCI NIH HHS R01 CA222147NIDDK NIH HHS P30 DK116074NLM NIH HHS R01 LM013866
6 · The paper itself

Abstract

In a recent concept paper (Verbeek et al., 2021), the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group provides a preliminary proposal to improve its existing guidelines for assessing sensitivity to uncontrolled confounding in meta-analyses of nonrandomized studies. The new proposal centers on reporting the E-value for the meta-analytic mean and on comparing this E-value to a measured "reference confounder" to determine whether residual uncontrolled confounding in the meta-analyzed studies could or could not plausibly explain away the meta-analytic mean. Although we agree that E-value analogs for meta-analyses could be an informative addition to future GRADE guidelines, we suggest improvements to the Verbeek et al. (2021)'s specific proposal regarding: (1) their interpretation of comparisons between the E-value and the strengths of associations of a reference confounder; (2) their characterization of evidence strength in meta-analyses in terms of only the meta-analytic mean; and (3) the possibility of confounding bias that is heterogeneous across studies.

Indexed as

GRADE ApproachBiasBiasConfoundingMeta-analysisObservational studiesSensitivity analysis

Identifiers

PMID34954645
PMCPMC8959014

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.