Evidence map›Paper›PMID 35648746›Full record

ArticlePloS one2022

Assessing and visualizing fragility of clinical results with binary outcomes in R using the fragility package.

Lifeng Lin, Haitao Chu

Abstract read
In one paragraph

Article in PloS one, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 18 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
18citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

18 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. A systematic review of the methodological quality of randomised trials in IBD surgery.Colorectal disease : the official journal of the Association of Coloproctology of Great Britain and Ireland · 2026
    Pooled it
  3. Pooled it
  4. Article
  5. Article
  6. Fragility of Evidence for the Efficacy of Anti-Fracture Medications.The Journal of clinical endocrinology and metabolism · 2025
    Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors.

Lifeng LinDepartment of Statistics, Florida State University, Tallahassee, FL, United States of America.ORCID 0000-0002-3562-9816
Haitao ChuStatistical Research and Innovation, Global Biometrics and Data Management, Pfizer Inc., New York, NY, United States of America.

Funding

Using social networks to map and evaluate team science across CTSA hubsUL1TR001427 · NCATS · UNIVERSITY OF FLORIDA · PI MITCHELL, DUANE A. · 2015 to 2024
$37.2M
Statistical Methods and Software for Multivariate Meta-analysisR01LM012982 · NLM · UNIVERSITY OF MINNESOTA · PI LIN, LIFENG, SIEGEL, LIANNE · 2019 to 2022
$1.3M
Joint modeling of continuous and binary data in meta-analysisR03MH128727 · NIMH · UNIVERSITY OF ARIZONA · PI LIN, LIFENG · 2022 to 2023
$146k
NCATS NIH HHS UL1 TR001427NIMH NIH HHS R03 MH128727NLM NIH HHS R01 LM012982
6 · The paper itself

Abstract

With the growing concerns about research reproducibility and replicability, the assessment of scientific results' fragility (or robustness) has been of increasing interest. The fragility index was proposed to quantify the robustness of statistical significance of clinical studies with binary outcomes. It is defined as the minimal event status modifications that can alter statistical significance. It helps clinicians evaluate the reliability of the conclusions. Many factors may affect the fragility index, including the treatment groups in which event status is modified, the statistical methods used for testing for the association between treatments and outcomes, and the pre-specified significance level. In addition to assessing the fragility of individual studies, the fragility index was recently extended to both conventional pairwise meta-analyses and network meta-analyses of multiple treatment comparisons. It is not straightforward for clinicians to calculate these measures and visualize the results. We have developed an R package called "fragility" to offer user-friendly functions for such purposes. This article provides an overview of methods for assessing and visualizing the fragility of individual studies as well as pairwise and network meta-analyses, introduces the usage of the "fragility" package, and illustrates the implementations with several worked examples.

Indexed as

Drug PackagingNetwork Meta-Analysis as TopicReproducibility of Results

Identifiers

PMID35648746
PMCPMC9159630

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.