Evidence map›Paper›PMID 33585666›Full record

ArticleCurrent opinion in behavioral sciences2021

A guide to the measurement and interpretation of fMRI test-retest reliability.

Stephanie Noble, Dustin Scheinost, R Todd Constable

Abstract read
In one paragraph

Article in Current opinion in behavioral sciences, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 98 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
98citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

98 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Review
  9. Review
  10. Article
  11. Comment on "MfMRI assessment of muscle activation by swallowing exercises in laryngectomized individuals: investigating conventional and resistance-based exercises using the swallowing exercise aid (SEA)".European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery · 2026
    Article
  12. Article
  13. Robust FDR Control for Neuroimaging-based Classification via Knockoffs.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2026
    Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

38 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Stephanie NobleDepartment of Radiology and Biomedical Imaging, Yale School of Medicine.
Dustin ScheinostDepartment of Radiology and Biomedical Imaging, Yale School of Medicine.
R Todd ConstableDepartment of Radiology and Biomedical Imaging, Yale School of Medicine.

Funding

Yale Clinical and Translational Science Award (U Component)UL1TR001863 · NCATS · YALE UNIVERSITY · PI John H. Krystal, LUCILA OHNO-MACHADO · 2016 to 2026
$102.9M
Statistical Analysis CoreP50MH115716 · NIMH · YALE UNIVERSITY · PI VOLKMAR, FRED ROBERT · 2017 to 2021
$11.5M
An Individualized, Multidimensional Dimensional Approach to PsychopathologyR01MH121095 · NIMH · YALE UNIVERSITY · PI CONSTABLE, R TODD, SCHEINOST, DUSTIN · 2019 to 2023
$4.2M
Constrained Network-Based Multiple Comparison CorrectionK00MH122372 · NIMH · YALE UNIVERSITY · PI NOBLE, STEPHANIE MARIE · 2019 to 2021
$242k
NCATS NIH HHS UL1 TR001863NIMH NIH HHS K00 MH122372NIMH NIH HHS P50 MH115716NIMH NIH HHS R01 MH121095
6 · The paper itself

Abstract

The test-retest reliability of functional neuroimaging data has recently been a topic of much discussion. Despite early conflicting reports, converging reports now suggest that test-retest reliability is poor for standard univariate measures-namely, voxel- and region-level task-based activation and edge-level functional connectivity. To better understand the implications of these recent studies requires understanding the nuances of test-retest reliability as commonly measured by the intraclass correlation coefficient (ICC). Here we provide a guide to the measurement and interpretation of test-retest reliability in functional neuroimaging and review major findings in the literature. We highlight the importance of making choices that improve reliability so long as they do not diminish validity, pointing to the potential of multivariate approaches that improve both. Finally, we discuss the implications of recent reports of low test-retest reliability in the context of ongoing work in the field.

Indexed as

fMRIfunctional connectivityintraclass correlation coefficienttask-based activationtest-retest reliability

Identifiers

PMID33585666
PMCPMC7875178

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.