Evidence map›Paper›PMID 32424987›Full record

ArticleResearch synthesis methods2020

A Bayesian approach to assessing small-study effects in meta-analysis of a binary outcome with controlled false positive rate.

Linyu Shi, Haitao Chu, Lifeng Lin

Abstract read
In one paragraph

Article in Research synthesis methods, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 6 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 6 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Article
  8. Article
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Linyu ShiDepartment of Statistics, Florida State University, Tallahassee, Florida, USA.
Haitao ChuDivision of Biostatistics, University of Minnesota, Minneapolis, Minnesota, USA.ORCID https://orcid.org/0000-0003-0932-598X
Lifeng LinDepartment of Statistics, Florida State University, Tallahassee, Florida, USA.ORCID https://orcid.org/0000-0002-3562-9816

Funding

Using social networks to map and evaluate team science across CTSA hubsUL1TR001427 · NCATS · UNIVERSITY OF FLORIDA · PI MITCHELL, DUANE A. · 2015 to 2024
$37.2M
Statistical Methods and Software for Multivariate Meta-analysisR01LM012982 · NLM · UNIVERSITY OF MINNESOTA · PI LIN, LIFENG, SIEGEL, LIANNE · 2019 to 2022
$1.3M
NCATS NIH HHS UL1 TR001427NLM NIH HHS R01 LM012982
6 · The paper itself

Abstract

Publication bias threatens meta-analysis validity. It is often assessed via the funnel plot; an asymmetric plot implies small-study effects, and publication bias is one cause of the asymmetry. Egger's regression test is a widely used tool to quantitatively assess such asymmetry. It examines the association between the observed effect sizes and their sample SEs; a strong association indicates small-study effects. However, its false positive rates may be inflated if such an association intrinsically exists even if no small-study effects appear, particularly in meta-analyses of odds ratios (ORs). Various alternatives are available to address this problem. They usually replace Egger's regression predictor or response with different measures; consequently, they are powerful only in specific cases. We propose a Bayesian approach to assessing small-study effects in meta-analyses of ORs. It controls false positive rates by using latent "true" SEs, rather than sample SEs, in the Egger-type regression to avoid the intrinsic association between ORs and their SEs. Although "true" SEs are unknown in practice, they can be modeled under the Bayesian framework. We use simulated and real data to compare various methods. When ORs are away from 1, the proposed method may have high powers with controlled false positive rates, while Egger's test has seriously inflated false positive rates; nevertheless, in other situations, some other methods may be superior. In general, the proposed method may serve as an alternative to rule out potential confounding effects caused by the intrinsic association between ORs and their SEs in the assessment of small-study effects.

Indexed as

Bayes TheoremFalse Positive ReactionsPublication BiasTreatment OutcomeHumansMeta-Analysis as TopicOdds RatioRegression AnalysisReproducibility of ResultsResearch DesignBayesian analysisfalse positive ratemeta-analysispublication biassmall-study effectstatistical power

Identifiers

PMID32424987
PMCPMC7343620

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.