Evidence map›Paper›PMID 31852625›Full record

ArticleNeuroImage2020

Cluster failure or power failure? Evaluating sensitivity in cluster-level inference.

Stephanie Noble, Dustin Scheinost, R Todd Constable

Abstract read
In one paragraph

Article in NeuroImage, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 59 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
59citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

59 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. The effects of childhood adversity: Two specific neural patterns.Neuroscience and biobehavioral reviews · 2025
    Pooled it
  2. Pooled it
  3. Trial
  4. Article
  5. Article
  6. Article
  7. Article
  8. The Hidden Landscape of Missed Effects in Human Functional Neuroimaging.bioRxiv : the preprint server for biology · 2026
    Article
  9. Article
  10. Article
  11. Article
  12. Dissociable effects of LSD and MDMA on striato-cortical connectivity in healthy subjects.Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology · 2026
    Article
  13. Article
  14. Neural correlates of inattention in adults with ADHD.European archives of psychiatry and clinical neuroscience · 2025
    Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Stephanie NobleInterdepartmental Neuroscience Program, Yale University, USA; Department of Radiology and Biomedical Imaging, Yale School of Medicine, USA. Electronic address: stephanie.noble@yale.edu.
Dustin ScheinostInterdepartmental Neuroscience Program, Yale University, USA; Department of Radiology and Biomedical Imaging, Yale School of Medicine, USA; Department of Statistics and Data Science, Yale University, USA; Child Study Center, Yale School of Medicine, USA.
R Todd ConstableInterdepartmental Neuroscience Program, Yale University, USA; Department of Radiology and Biomedical Imaging, Yale School of Medicine, USA; Department of Neurosurgery, Yale School of Medicine, USA.

Funding

Yale Clinical and Translational Science Award (U Component)UL1TR001863 · NCATS · YALE UNIVERSITY · PI John H. Krystal, LUCILA OHNO-MACHADO · 2016 to 2026
$102.9M
Constrained Network-Based Multiple Comparison CorrectionK00MH122372 · NIMH · YALE UNIVERSITY · PI NOBLE, STEPHANIE MARIE · 2019 to 2021
$242k
Improving Reliability and Validity of fMRI Statistical MethodsF99NS108557 · NINDS · YALE UNIVERSITY · PI NOBLE, STEPHANIE MARIE · 2018 to 2018
$43k
NCATS NIH HHS UL1 TR001863NIMH NIH HHS K00 MH122372NINDS NIH HHS F99 NS108557
6 · The paper itself

Abstract

Pioneering work in human neuroscience has relied on the ability to map brain function using task-based fMRI, but the empirical validity of these inferential methods is still being characterized. A recent landmark study by Eklund and colleagues showed that popular multiple comparison corrections based on cluster extent suffer from unexpectedly low specificity (i.e., high false positive rate). Yet that study's focus on specificity, while important, is incomplete. The validity of a method depends also on its sensitivity (i.e., true positive rate or power), yet the sensitivity of cluster correction remains poorly understood. Here, we assessed the sensitivity of gold-standard nonparametric cluster correction by resampling real data from five tasks in the Human Connectome Project and comparing results with those from the full "ground truth" datasets (n ​= ​480-493). Critically, we found that sensitivity after correction is lower than may be practical for many fMRI applications. In particular, sensitivity to medium-sized effects (|Cohen's d| ​= ​0.5) was less than 20% across tasks on average, about three times smaller than without any correction. Furthermore, cluster extent correction exhibited a spatial bias in sensitivity that was independent of effect size. In comparison, correction based on the Threshold-Free Cluster Enhancement (TFCE) statistic approximately doubled sensitivity across tasks but increased spatial bias. These results suggest that we have, until now, only measured the tip of the iceberg in the activation-mapping literature due to our goal of limiting the familywise error rate through cluster extent-based inference. There is a need to revise our practices to improve sensitivity; we therefore conclude with a list of modern strategies to boost sensitivity while maintaining respectable specificity in future investigations.

Indexed as

Data Interpretation, StatisticalAdultBrainCluster AnalysisConnectomeFunctional NeuroimagingHumansMagnetic Resonance ImagingNeuropsychological TestsReproducibility of ResultsSensitivity and SpecificityActivationEmpiricalfMRIHCPPowerResamplingSensitivity

Identifiers

PMID31852625
PMCPMC8061745

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.