Evidence map›Paper›PMID 35093646›Full record

Trial reportComputer methods and programs in biomedicine2022

Evaluation of the type I error rate when using parametric bootstrap analysis of a cluster randomized controlled trial with binary outcomes and a small number of clusters.

Lilian Golzarri-Arroyo, Stephanie L Dickinson, Yasaman Jamshidi-Naeini, Roger S Zoh, Andrew W Brown, Arthur H Owora, Peng Li, J Michael Oakes, David B Allison

Abstract readRandomized Controlled Trial
In one paragraph

Trial report in Computer methods and programs in biomedicine, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Trial
  2. Article
  3. Article
  4. Causal models and causal modelling in obesity: foundations, methods and evidence.Philosophical transactions of the Royal Society of London. Series B, Biological sciences · 2023
    Review
  5. Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Lilian Golzarri-ArroyoDepartment of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington USA. Electronic address: lgolzarr@indiana.edu.
Stephanie L DickinsonDepartment of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington USA.
Yasaman Jamshidi-NaeiniDepartment of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington USA.
Roger S ZohDepartment of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington USA.
Andrew W BrownDepartment of Applied Health Science, Indiana University School of Public Health-Bloomington USA.
Arthur H OworaDepartment of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington USA.
Peng LiSchool of Nursing, University of Alabama at Birmingham USA.
J Michael OakesSchool of Public Health, University of Minnesota USA.
David B AllisonDepartment of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington USA.

Funding

Sex hormones and arthritis in a long lived animal modelP30AG050886 · NIA · UNIVERSITY OF ALABAMA AT BIRMINGHAM · PI Thomas W Buford · 2015 to 2026
$11.3M
Nathan Shock Centers Coordinating CenterU24AG056053 · NIA · AMERICAN FEDERATION FOR AGING RESEARCH · PI STEVEN N. AUSTAD, Stephanie Lederman · 2017 to 2026
$6.1M
Leveraging Infrastructure to train investigators in patient centered outcomes research in the learning health system (LITI-PCORLHS)K12HS026390 · AHRQ · INDIANA UNIVERSITY INDIANAPOLIS · PI CARROLL, AARON E., EMBI, PETER J. · 2018 to 2022
$3.4M
Strengthening Causal Inference in Behavioral Obesity ResearchR25HL124208 · NHLBI · UNIVERSITY OF ALABAMA AT BIRMINGHAM · PI ALLISON, DAVID B, BROWN, ANDREW W · 2014 to 2023
$1.8M
The Mathematical Sciences in Obesity ResearchR25DK099080 · NIDDK · UNIVERSITY OF ALABAMA AT BIRMINGHAM · PI DAVID B ALLISON, Andrew W Brown · 2013 to 2026
$1.2M
Removing Barriers to Better Data Practices through Capacity, Opportunity, and MotivationR25GM141507 · NIGMS · TRUSTEES OF INDIANA UNIVERSITY · PI BROWN, ANDREW W · 2021 to 2023
$270k
AHRQ HHS K12 HS026390NHLBI NIH HHS R25 HL124208NIA NIH HHS P30 AG050886NIA NIH HHS U24 AG056053NIDDK NIH HHS R25 DK099080NIGMS NIH HHS R25 GM141507
6 · The paper itself

Abstract

backgroundCluster randomized controlled trials (cRCTs) are increasingly used but must be analyzed carefully. We conducted a simulation study to evaluate the validity of a parametric bootstrap (PB) approach with respect to the empirical type I error rate for a cRCT with binary outcomes and a small number of clusters.

methodsWe simulated a case study with a binary (0/1) outcome, four clusters, and 100 subjects per cluster. To compare the validity of the test with respect to error rate, we simulated the same experiment with K=10, 20, and 30 clusters, each with 2,000 simulated datasets. To test the null hypothesis, we used a generalized linear mixed model including a random intercept for clusters and obtained p-values based on likelihood ratio tests (LRTs) using the parametric bootstrap method as implemented in the R package "pbkrtest".

resultsThe PB test produced error rates of 9.1%, 5.5%, 4.9%, and 5.0% on average across all ICC values for K=4, K=10, K=20, and K=30, respectively. The error rates were higher, ranging from 9.1% to 36.5% for K=4, in the models with singular fits (i.e., ignoring clustering) because the ICC was estimated to be zero.

conclusionUsing the parametric bootstrap for cRCTs with a small number of clusters results in inflated error rates and is not valid.

Indexed as

Research DesignCluster AnalysisComputer SimulationHumansLinear ModelsSample Size

Identifiers

PMID35093646
PMCPMC8847311

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.