Evidence map›Paper›PMID 34315697›Full record

ArticleJournal of medical Internet research2021

Stepwise-Hierarchical Pooled Analysis for Synergistic Interpretation of Meta-analyses Involving Randomized and Observational Studies: Methodology Development.

In-Soo Shin, Chai Hong Rim

Erratum issuedAbstract read
In one paragraph

Article in Journal of medical Internet research, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 3 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

2 authors.

In-Soo ShinGraduate School of Education, Dongguk University, Seoul, Republic of Korea.ORCID 0000-0001-7535-3511
Chai Hong RimDepartment of Radiation Oncology, Ansan Hospital, Korea University, Gyeonggido, Republic of Korea.ORCID 0000-0001-7431-4588

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe necessity of including observational studies in meta-analyses has been discussed in the literature, but a synergistic analysis method for combining randomized and observational studies has not been reported. Observational studies differ in validity depending on the degree of the confounders' influence. Combining interpretations may be challenging, especially if the statistical directions are similar but the magnitude of the pooled results are different between randomized and observational studies (the "gray zone").

objectiveTo overcome these hindrances, in this study, we aim to introduce a logical method for clinical interpretation of randomized and observational studies.

methodsWe designed a stepwise-hierarchical pooled analysis method to analyze both distribution trends and individual pooled results by dividing the included studies into at least three stages (eg, all studies, balanced studies, and randomized studies).

resultsAccording to the model, the validity of a hypothesis is mostly based on the pooled results of randomized studies (the highest stage). Ascending patterns in which effect size and statistical significance increase gradually with stage strengthen the validity of the hypothesis; in this case, the effect size of the observational studies is lower than that of the true effect (eg, because of the uncontrolled effect of negative confounders). Descending patterns in which decreasing effect size and statistical significance gradually weaken the validity of the hypothesis suggest that the effect size and statistical significance of the observational studies is larger than the true effect (eg, because of researchers' bias).

conclusionsWe recommend using the stepwise-hierarchical pooled analysis approach for meta-analyses involving randomized and observational studies.

Indexed as

Meta-Analysis as TopicResearch DesignBiasHumansObservational Studies as TopicRandomized Controlled Trials as Topiccombinationhypothesisinterpretationmeta-analysismethodologyobservational studyrandomized studystatisticssynergyvalidity

Identifiers

PMID34315697
PMCPMC8446840

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.