Evidence map›Paper›PMID 34404344›Full record

ArticleBMC medical research methodology2021

Bayesian Hodges-Lehmann tests for statistical equivalence in the two-sample setting: Power analysis, type I error rates and equivalence boundary selection in biomedical research.

Riko Kelter

Registry-linked trialAbstract read
In one paragraph

Article in BMC medical research methodology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT05508009 (Phase 1b/2a Trial of Allogeneic Hematopoietic Stem Cell Transplantation), which is not on this map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05508009 phase1 / phase2recruitingnot on this mapstarted 2023, after this paper: background citation

Phase 1b/2a Trial of Allogeneic Hematopoietic Stem Cell Transplantation (HSCT) From an HLA-partially Matched Related or Unrelated Donor After TCRαβ+ T-cell/CD19+ B-cell Depletion for Patients Who Will Receive a Kidney Transplant (KT) From the Same HSCT/KT Donor

TypeinterventionalSponsorAlice BertainaRan2023 to 2034Enrolled12ConditionsSIOD, Cystinosis, FSGS, SLE NephritisArmsCyclophosphamide 1200 mg/Kg, Fludarabine, Cyclophosphamide 100 mg/Kg, Total Body Irradiation, ATG
3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

1 author.

Riko KelterDepartment of Mathematics, University of Siegen, Walter-Flex-Str. 3, Siegen, Germany. riko.kelter@uni-siegen.de.ORCID 0000-0001-9068-5696

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundNull hypothesis significance testing (NHST) is among the most frequently employed methods in the biomedical sciences. However, the problems of NHST and p-values have been discussed widely and various Bayesian alternatives have been proposed. Some proposals focus on equivalence testing, which aims at testing an interval hypothesis instead of a precise hypothesis. An interval hypothesis includes a small range of parameter values instead of a single null value and the idea goes back to Hodges and Lehmann. As researchers can always expect to observe some (although often negligibly small) effect size, interval hypotheses are more realistic for biomedical research. However, the selection of an equivalence region (the interval boundaries) often seems arbitrary and several Bayesian approaches to equivalence testing coexist.

methodsA new proposal is made how to determine the equivalence region for Bayesian equivalence tests based on objective criteria like type I error rate and power. Existing approaches to Bayesian equivalence testing in the two-sample setting are discussed with a focus on the Bayes factor and the region of practical equivalence (ROPE). A simulation study derives the necessary results to make use of the new method in the two-sample setting, which is among the most frequently carried out procedures in biomedical research.

resultsBayesian Hodges-Lehmann tests for statistical equivalence differ in their sensitivity to the prior modeling, power, and the associated type I error rates. The relationship between type I error rates, power and sample sizes for existing Bayesian equivalence tests is identified in the two-sample setting. Results allow to determine the equivalence region based on the new method by incorporating such objective criteria. Importantly, results show that not only can prior selection influence the type I error rate and power, but the relationship is even reverse for the Bayes factor and ROPE based equivalence tests.

conclusionBased on the results, researchers can select between the existing Bayesian Hodges-Lehmann tests for statistical equivalence and determine the equivalence region based on objective criteria, thus improving the reproducibility of biomedical research.

Indexed as

Biomedical ResearchBayes TheoremHumansReproducibility of ResultsResearch DesignSample SizeBayes factorBayesian BiostatisticsBayesian equivalence testingBayesian testingRegion of practical equivalence (ROPE)Student’s t-test

Identifiers

PMID34404344
PMCPMC8369333

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.