Evidence map›Paper›PMID 32996635›Full record

ArticleHuman brain mapping2021

Influence of sample size and analytic approach on stability and interpretation of brain-behavior correlations in task-related fMRI data.

Cheryl L Grady, Jenny R Rieck, Daniel Nichol, Karen M Rodrigue, Kristen M Kennedy

Registry-linked trialAbstract read
In one paragraph

Article in Human brain mapping, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT06606925 (Determining Which Regions of the Brain Are Active During Flight Simulation at Separate Timepoints During Training), which is not on this map. Cited by 96 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
96citing papers in PubMed, 5 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06606925 nacompletednot on this mapstarted 2023, after this paper: background citation

Determining Which Regions of the Brain Are Active During Flight Simulation at Separate Timepoints During Training

TypeinterventionalSponsorThe Geneva FoundationRan2023 to 2026Enrolled35ConditionsCognitive PerformanceArmsfMRI with virtual reality flight simulator
3 · Its place in the literature

Who cites it

96 citing papers in PubMed, 5 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Neuroimaging correlates and predictors of response to repeated-dose intravenous ketamine in PTSD: preliminary evidence.Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology · 2021
    Trial
  7. Trial
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Review
  15. Article
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article

36 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Cheryl L GradyRotman Research Institute at Baycrest, Toronto, Ontario, Canada.ORCID 0000-0001-9533-8802
Jenny R RieckRotman Research Institute at Baycrest, Toronto, Ontario, Canada.ORCID 0000-0002-3242-6407
Daniel NicholRotman Research Institute at Baycrest, Toronto, Ontario, Canada.
Karen M RodrigueCenter for Vital Longevity, School of Behavioral and Brain Sciences, The University of Texas at Dallas, Dallas, Texas, USA.
Kristen M KennedyCenter for Vital Longevity, School of Behavioral and Brain Sciences, The University of Texas at Dallas, Dallas, Texas, USA.ORCID 0000-0001-5373-9026

Funding

Mapping the Human Connectome: Structure, Function, and HeritabilityU54MH091657 · NIMH · WASHINGTON UNIVERSITY · PI UGURBIL, KAMIL, VAN ESSEN, DAVID C · 2010 to 2014
$34.7M
Dopaminergic and Neuroplastic Influences on Longitudinal Change in Cognitive and Brain AgingR01AG056535 · NIA · UNIVERSITY OF TEXAS DALLAS · PI Kristen M. Kennedy, Karen M Rodrigue · 2017 to 2026
$4.8M
Role of White Matter Integrity in Age-Related Functional ReorganizationR00AG036818 · NIA · UNIVERSITY OF TEXAS DALLAS · PI KENNEDY, KRISTEN M. · 2012 to 2014
$733k
CIHR MOP143311NIA NIH HHS R00 AG036818NIA NIH HHS R01 AG056535NIH HHS 1U54MH091657NIH HHS R00 AG-036848NIMH NIH HHS U54 MH091657
6 · The paper itself

Abstract

Limited statistical power due to small sample sizes is a problem in fMRI research. Most of the work to date has examined the impact of sample size on task-related activation, with less attention paid to the influence of sample size on brain-behavior correlations, especially in actual experimental fMRI data. We addressed this issue using two large data sets (a working memory task, N = 171, and a relational processing task, N = 865) and both univariate and multivariate approaches to voxel-wise correlations. We created subsamples of different sizes and calculated correlations between task-related activity at each voxel and task performance. Across both data sets the magnitude of the brain-behavior correlations decreased and similarity across spatial maps increased with larger sample sizes. The multivariate technique identified more extensive correlated areas and more similarity across spatial maps, suggesting that a multivariate approach would provide a consistent advantage over univariate approaches in the stability of brain-behavior correlations. In addition, the multivariate analyses showed that a sample size of roughly 80 or more participants would be needed for stable estimates of correlation magnitude in these data sets. Importantly, a number of additional factors would likely influence the choice of sample size for assessing such correlations in any given experiment, including the cognitive task of interest and the amount of data collected per participant. Our results provide novel experimental evidence in two independent data sets that the sample size commonly used in fMRI studies of 20-30 participants is very unlikely to be sufficient for obtaining reproducible brain-behavior correlations, regardless of analytic approach.

Indexed as

Neuropsychological TestsAdultAgedAnalysis of VarianceCerebral CortexData Interpretation, StatisticalDatasets as TopicFemaleFunctional NeuroimagingHumansJudgmentMagnetic Resonance ImagingMaleMemory, Short-TermMiddle AgedPattern Recognition, VisualcorrelationsfMRIRRID:SCR_001622RRID:SCR_001847RRID:SCR_002823RRID:SCR_005990RRID:SCR_007037RRID:SCR_008750sample sizestatistical powerworking memory

Identifiers

PMID32996635
PMCPMC7721240

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.