Evidence map›Paper›PMID 36894031›Full record

ArticleUrology2023

What's in a P-Value? A Fragility Analysis of RCTs in the AUA Guidelines for Benign Prostatic Hyperplasia.

Reece M Anderson, Andriana Peña, Bradley S Johnson, Ross Nowlin, Tillman Hudson, Matt Vassar

Abstract read
PubMed Publisher
In one paragraph

Article in Urology, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

6 authors.

Reece M AndersonOffice of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK.
Andriana PeñaOffice of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK.
Bradley S JohnsonOffice of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK; Department of Urology, Sparrow Hospital, Lansing, MI; Michigan State Urology, Michigan State University, East Lansing, MI.
Ross NowlinOffice of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK.
Tillman HudsonDepartment of Urology, St. Francis Health System, Tulsa, OK.
Matt VassarOffice of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK; Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveTo use the fragility index (FI) and fragility quotient (FQ) to assess the strength of statistically significant findings for randomized controlled trials (RCTs) cited in the American Urological Association (AUA) guidelines for benign prostatic hyperplasia.

methodsTwo investigators independently screened the AUA guidelines for management of benign prostatic hyperplasia for RCTs cited as evidence for recommendations. Investigators extracted data related to event rate per group and loss to follow-up which was compared against the FI. Stata 17.0 was used to calculate the FI and FQ which was then summarized and reported according to primary or secondary endpoints.

resultsAmong the 373 citations in the AUA guidelines, 24 RCTs met inclusion criteria with 29 distinct outcomes analyzed. The median fragility index was 12 (IQR = 4-38), indicating that twelve alternative events to either study arm would nullify statistical significance. Six studies had a FI of ≤2, indicating that only 1-2 outcomes would need to be changed in order to render nonsignificance of results. In 10/24 RCTs, the number of patients lost to follow-up was greater than the FI.

conclusionThe AUA Clinical Practice Guidelines for management of benign prostatic hyperplasia cite RCTs with more robust findings when compared to previous studies assessing fragility in the field of Urology. While several included studies had high fragility, the median FI in our analysis was approximately 4-5 times higher than comparable studies of urologic RCTs. However, there are areas where improvement is necessary to support the highest quality of evidence-based medicine.

Indexed as

Prostatic HyperplasiaUrologyEvidence-Based MedicineHumansMaleResearch DesignSample Size

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.