Evidence map›Paper›PMID 31072299›Full record

ArticleBMC medical research methodology2019

The relationship between statistical power and predictor distribution in multilevel logistic regression: a simulation-based approach.

Oscar L Olvera Astivia, Anne Gadermann, Martin Guhn

Abstract read
In one paragraph

Article in BMC medical research methodology, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers.

0numbers the graph read from it
0cells of the map it votes in
27citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

27 citing papers in PubMed.

  1. Trial
  2. Article
  3. Article
  4. Reply to Koplenig and Wolfer: Global language analyses must account for relationships, location, and unbalanced binary data.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Observational
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Critically Important Antimicrobial Resistance Trends inPathogens (Basel, Switzerland) · 2022
    Article
  18. Article
  19. Article
  20. Determinants of Total End-of-Life Health Care Costs of Medicare Beneficiaries: A Quantile Regression Forests Analysis.The journals of gerontology. Series A, Biological sciences and medical sciences · 2022
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Oscar L Olvera AstiviaHuman Early Learning Partnership, The University of British Columbia, 2206 East Mall, Vancouver, British Columbia, V6T 1Z4, Canada. oolvera@mail.ubc.ca.ORCID 0000-0002-5744-2403
Anne GadermannHuman Early Learning Partnership, The University of British Columbia, 2206 East Mall, Vancouver, British Columbia, V6T 1Z4, Canada.
Martin GuhnHuman Early Learning Partnership, The University of British Columbia, 2206 East Mall, Vancouver, British Columbia, V6T 1Z4, Canada.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundDespite its popularity, issues concerning the estimation of power in multilevel logistic regression models are prevalent because of the complexity involved in its calculation (i.e., computer-simulation-based approaches). These issues are further compounded by the fact that the distribution of the predictors can play a role in the power to estimate these effects. To address both matters, we present a sample of cases documenting the influence that predictor distribution have on statistical power as well as a user-friendly, web-based application to conduct power analysis for multilevel logistic regression.

methodComputer simulations are implemented to estimate statistical power in multilevel logistic regression with varying numbers of clusters, varying cluster sample sizes, and non-normal and non-symmetrical distributions of the Level 1/2 predictors. Power curves were simulated to see in what ways non-normal/unbalanced distributions of a binary predictor and a continuous predictor affect the detection of population effect sizes for main effects, a cross-level interaction and the variance of the random effects.

resultsSkewed continuous predictors and unbalanced binary ones require larger sample sizes at both levels than balanced binary predictors and normally-distributed continuous ones. In the most extreme case of imbalance (10% incidence) and skewness of a chi-square distribution with 1 degree of freedom, even 110 Level 2 units and 100 Level 1 units were not sufficient for all predictors to reach power of 80%, mostly hovering at around 50% with the exception of the skewed, continuous Level 2 predictor.

conclusionsGiven the complex interactive influence among sample sizes, effect sizes and predictor distribution characteristics, it seems unwarranted to make generic rule-of-thumb sample size recommendations for multilevel logistic regression, aside from the fact that larger sample sizes are required when the distributions of the predictors are not symmetric or balanced. The more skewed or imbalanced the predictor is, the larger the sample size requirements. To assist researchers in planning research studies, a user-friendly web application that conducts power analysis via computer simulations in the R programming language is provided. With this web application, users can conduct simulations, tailored to their study design, to estimate statistical power for multilevel logistic regression models.

Indexed as

Data Interpretation, StatisticalLogistic ModelsModels, StatisticalComputer SimulationHumansSample Size

Identifiers

PMID31072299
PMCPMC6507150

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.