Evidence map›Paper›PMID 36914304›Full record

ArticleThe journal of evidence-based dental practice2023

THE EFFECT DIRECTION SHOULD BE TAKEN INTO ACCOUNT WHEN ASSESSING SMALL-STUDY EFFECTS.

Zhuo Meng, Chong Wu, Lifeng Lin

Abstract read
In one paragraph

Article in The journal of evidence-based dental practice, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Zhuo MengDepartment of Statistics, Florida State University, Tallahassee, United States of America.
Chong WuDepartment of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, United States of America. Electronic address: cwu18@mdanderson.org.
Lifeng LinDepartment of Epidemiology and Biostatistics, University of Arizona, Tucson, United States of America. Electronic address: lifenglin@arizona.edu.

Funding

Uncovering causal protein markers to improve prostate cancer etiology understanding and risk prediction in Africans and EuropeansR01CA263494 · NCI · UNIVERSITY OF HAWAII AT MANOA · PI Chong Wu, Lang Wu · 2022 to 2026
$3.5M
Statistical Methods and Software for Multivariate Meta-analysisR01LM012982 · NLM · UNIVERSITY OF MINNESOTA · PI LIN, LIFENG, SIEGEL, LIANNE · 2019 to 2022
$1.3M
Novel Statistical Methods for Multi-omics Data Integration in Alzheimer's DiseaseR03AG070669 · NIA · FLORIDA STATE UNIVERSITY · PI BRADLEY, JONATHAN RAY, WU, CHONG · 2021 to 2022
$296k
Joint modeling of continuous and binary data in meta-analysisR03MH128727 · NIMH · UNIVERSITY OF ARIZONA · PI LIN, LIFENG · 2022 to 2023
$146k
NCI NIH HHS R01 CA263494NIA NIH HHS R03 AG070669NIMH NIH HHS R03 MH128727NLM NIH HHS R01 LM012982
6 · The paper itself

Abstract

objectiveStudies with statistically significant results are frequently more likely to be published than those with non-significant results. This phenomenon leads to publication bias or small-study effects and can seriously affect the validity of the conclusion from systematic reviews and meta-analyses. Small-study effects typically appear in a specific direction, depending on whether the outcome of interest is beneficial or harmful, but this direction is rarely taken into account in conventional methods.

methodsWe propose to use directional tests to assess potential small-study effects. The tests are built on a one-sided testing framework based on the existing Egger's regression test. We performed simulation studies to compare the proposed one-sided regression tests, conventional two-sided regression tests, as well as two other competitive methods (Begg's rank test and the trim-and-fill method). Their performance was measured by type I error rates and statistical power. Three real-world meta-analyses on measurements of infrabony periodontal defects were also used to examine the various methods' performance.

resultsBased on simulation studies, the one-sided tests could have considerably higher statistical power than competing methods, particularly their two-sided counterparts. Their type I error rates were generally controlled well. In the case study of the three real-world meta-analyses, by accounting for the favored direction of effects, the one-sided tests could rule out potential false-positive conclusions about small-study effects. They also are more powerful in assessing small-study effects than the conventional two-sided tests when true small-study effects likely exist.

conclusionWe recommend researchers incorporate the potential favored direction of effects into the assessment of small-study effects.

Indexed as

DentistryPublication BiasResearch DesignHumansDirectionMeta-analysisPublication biasRegression testSmall-study effectsStatistical power

Identifiers

PMID36914304
PMCPMC10014930

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.