Evidence map›Paper›PMID 36322140›Full record

ArticleJournal of evaluation in clinical practice2023

Empirical assessment of fragility index based on a large database of clinical studies in the Cochrane Library.

Aiwen Xing, Lifeng Lin

Abstract read
In one paragraph

Article in Journal of evaluation in clinical practice, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Review
  5. Article
  6. Assessing robustness of results of randomised clinical trials using Fragility Index.European archives of paediatric dentistry : official journal of the European Academy of Paediatric Dentistry · 2024
    Article
  7. Article
  8. Beyond the Fragility Index.Pharmaceutical statistics
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors.

Aiwen XingBiostatistics and Research Decision Sciences, Merck & Co., Inc., Rahway, New Jersey, USA.
Lifeng LinDepartment of Epidemiology and Biostatistics, University of Arizona, Tucson, Arizona, USA.

Funding

Statistical Methods and Software for Multivariate Meta-analysisR01LM012982 · NLM · UNIVERSITY OF MINNESOTA · PI LIN, LIFENG, SIEGEL, LIANNE · 2019 to 2022
$1.3M
Joint modeling of continuous and binary data in meta-analysisR03MH128727 · NIMH · UNIVERSITY OF ARIZONA · PI LIN, LIFENG · 2022 to 2023
$146k
NIMH NIH HHS R03 MH128727NLM NIH HHS R01 LM012982
6 · The paper itself

Abstract

RATIONALE AIMS AND

objectivesThe fragility index (FI) and fragility quotient (FQ) are increasingly used measures for assessing the robustness of clinical studies with binary outcomes in terms of statistical significance. The FI is the minimum number of event status modifications that can alter a study result's statistical significance (or nonsignificance), and the FQ is calculated as the FI divided by the study's total sample size. The literature has no widely recognized criteria for interpreting the fragility measures' magnitudes. This article aims to provide an empirical assessment for the FI and FQ based on a large database of clinical studies in the Cochrane Library.

methodsWe explored the overall empirical distributions of the FI and FQ based on five common methods (Fisher's exact test, χ

resultsFor about 20% of studies with significant results, the statistical significance was changed after modifying the event status of only one participant. Studies with significant results were considered slightly fragile if the significance hinged on the statuses of about five events. Studies were extremely fragile if FI

conclusionsThe statistical significance of clinical studies could be changed after modifying a few events' statuses. Many studies' findings are fairly fragile. The distributions of the FI and FQ provide insights for appraising the robustness of evidence in clinical decision-making.

Indexed as

Clinical Studies as TopicSample SizeHumansCochrane Libraryfragility indexhealthcarerobustnesssensitivity analysis

Identifiers

PMID36322140
PMCPMC9928801

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.