Evidence map›Paper›PMID 30318709›Full record

ArticleHuman brain mapping2019

Cluster failure revisited: Impact of first level design and physiological noise on cluster false positive rates.

Anders Eklund, Hans Knutsson, Thomas E Nichols

Abstract read
In one paragraph

Article in Human brain mapping, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 38 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
38citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

38 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. The roles of emotional responding and regulation in adolescent friendship stability: A multimethod functional magnetic resonance imaging study.Journal of research on adolescence : the official journal of the Society for Research on Adolescence · 2026
    Article
  3. Article
  4. Article
  5. Learning to Program "Recycles" Preexisting Frontoparietal Population Codes of Logical Algorithms.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2025
    Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Reading Braille by Touch Recruits Posterior Parietal Cortex.Journal of cognitive neuroscience · 2023
    Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

3 authors.

Anders EklundDivision of Medical Informatics, Department of Biomedical Engineering, Linköping University, Linköping, Sweden.ORCID 0000-0001-7061-7995
Hans KnutssonDivision of Medical Informatics, Department of Biomedical Engineering, Linköping University, Linköping, Sweden.
Thomas E NicholsBig Data Institute, University of Oxford, Oxford, United Kingdom.

Funding

SOLAR-Eclipse Computational Tools for Imaging GeneticsR01EB015611 · NIBIB · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI KOCHUNOV, PETER V. · 2012 to 2024
$5.0M
Hybrid GPU/CPU Computing Resource to Support Connectomic and GenomicsS10OD023696 · OD · UNIVERSITY OF MARYLAND BALTIMORE · PI KOCHUNOV, PETER V. · 2018 to 2018
$593k
Center for Industrial Information Technology (CENIIT)Knut och Alice Wallenbergs StiftelseLinköping UniversityNIBIB NIH HHS R01 EB015611NIH HHS S10 OD023696Swedish research council 2013-5229 and 2017-04889Wellcome TrustWellcome Trust 100309/Z/12/Z
6 · The paper itself

Abstract

Methodological research rarely generates a broad interest, yet our work on the validity of cluster inference methods for functional magnetic resonance imaging (fMRI) created intense discussion on both the minutia of our approach and its implications for the discipline. In the present work, we take on various critiques of our work and further explore the limitations of our original work. We address issues about the particular event-related designs we used, considering multiple event types and randomization of events between subjects. We consider the lack of validity found with one-sample permutation (sign flipping) tests, investigating a number of approaches to improve the false positive control of this widely used procedure. We found that the combination of a two-sided test and cleaning the data using ICA FIX resulted in nominal false positive rates for all data sets, meaning that data cleaning is not only important for resting state fMRI, but also for task fMRI. Finally, we discuss the implications of our work on the fMRI literature as a whole, estimating that at least 10% of the fMRI studies have used the most problematic cluster inference method (p = .01 cluster defining threshold), and how individual studies can be interpreted in light of our findings. These additional results underscore our original conclusions, on the importance of data sharing and thorough evaluation of statistical methods on realistic null data.

Indexed as

ArtifactsBrainBrain MappingCluster AnalysisElectricityHumansMagnetic Resonance Imagingcluster inferencefalse positivesfunctional magnetic resonance imagingICA FIXpermutationphysiological noise

Identifiers

PMID30318709
PMCPMC6445744

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.