Evidence map›Paper›PMID 33258698›Full record

SynthesisClinical trials (London, England)2021

Meta-analysis of rare adverse events in randomized clinical trials: Bayesian and frequentist methods.

Hwanhee Hong, Chenguang Wang, Gary L Rosner

Open access · greenAbstract readMeta-Analysis
In one paragraph

Synthesis in Clinical trials (London, England), 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed, 6 pooled it
2.3field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed, 6 syntheses or guidelines pooled it, 32 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Bayesian Methods for Meta-Analyses of Binary Outcomes: Implementations, Examples, and Impact of Priors.International journal of environmental research and public health · 2021
    Pooled it
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors at 2 institutions in 1 country.

Hwanhee HongDepartment of Biostatistics & Bioinformatics, School of Medicine, Duke University, Durham, NC, USA.ORCID 0000-0002-3736-6327
Chenguang WangThe Sidney Kimmel Comprehensive Cancer Center, Johns Hopkins University, Baltimore, MD, USA.
Gary L RosnerThe Sidney Kimmel Comprehensive Cancer Center, Johns Hopkins University, Baltimore, MD, USA.
Johns Hopkins University · USDuke University · US

Funding

Translational Research Central ServicesP30CA006973 · NCI · JOHNS HOPKINS UNIVERSITY · PI WILLIAM George NELSON · 1985 to 2026
$208.6M
ENHANCING REGULATORY SCIENCE THROUGH A UNIQUE FDA-ACADEMIC PARTNERSHIPU01FD004977 · FDA · JOHNS HOPKINS UNIVERSITY · PI ALEXANDER, G. CALEB · 2014 to 2015
$1.2M
Estimating Population Effects in Mental Health Research Using Meta-AnalysisR00MH111807 · NIMH · DUKE UNIVERSITY · PI HONG, HWANHEE · 2018 to 2020
$747k
FDA HHS U01 FD004977NCI NIH HHS P30 CA006973NIMH NIH HHS R00 MH111807
6 · The paper itself

Abstract

BACKGROUND/

aimsRegulatory approval of a drug or device involves an assessment of not only the benefits but also the risks of adverse events associated with the therapeutic agent. Although randomized controlled trials (RCTs) are the gold standard for evaluating effectiveness, the number of treated patients in a single RCT may not be enough to detect a rare but serious side effect of the treatment. Meta-analysis plays an important role in the evaluation of the safety of medical products and has advantage over analyzing a single RCT when estimating the rate of adverse events.

methodsIn this article, we compare 15 widely used meta-analysis models under both Bayesian and frequentist frameworks when outcomes are extremely infrequent or rare. We present extensive simulation study results and then apply these methods to a real meta-analysis that considers RCTs investigating the effect of rosiglitazone on the risks of myocardial infarction and of death from cardiovascular causes.

resultsOur simulation studies suggest that the beta hyperprior method modeling treatment group-specific parameters and accounting for heterogeneity performs the best. Most models ignoring between-study heterogeneity give poor coverage probability when such heterogeneity exists. In the data analysis, different methods provide a wide range of log odds ratio estimates between rosiglitazone and control treatments with a mixed conclusion on their statistical significance based on 95% confidence (or credible) intervals.

conclusionIn the rare event setting, treatment effect estimates obtained from traditional meta-analytic methods may be biased and provide poor coverage probability. This trend worsens when the data have large between-study heterogeneity. In general, we recommend methods that first estimate the summaries of treatment-specific risks across studies and then relative treatment effects based on the summaries when appropriate. Furthermore, we recommend fitting various methods, comparing the results and model performance, and investigating any significant discrepancies among them.

Indexed as

Drug-Related Side Effects and Adverse ReactionsRandomized Controlled Trials as TopicHumansOdds RatioBayesian analysisMeta-analysisrandomized controlled trialsrare eventregulatory sciencerosiglitazone

Identifiers

PMID33258698
PMCPMC8041270
OpenAlexW3109326355

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.