ArticleCognitive, affective & behavioral neuroscience2013
Quantifying the reliability of image replication studies: the image intraclass correlation coefficient (I2C2).
Article in Cognitive, affective & behavioral neuroscience, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 60 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
60 citing papers in PubMed, 1 synthesis or guideline pooled it.
- A decade of test-retest reliability of functional connectivity: A systematic review and meta-analysis.NeuroImage · 2019Pooled it
- Magnetic Resonance Imaging-Guided Neuronavigation for Transcranial Magnetic Stimulation in Mood Disorders: Technical Foundation, Advances, and Emerging Tools.Human brain mapping · 2025Review
- Unscaled Indices for Assessing Agreement of Functional Data.Biometrical journal. Biometrische Zeitschrift · 2025Article
- Precision data-driven modeling of cortical dynamics reveals person-specific mechanisms underpinning brain electrophysiology.Proceedings of the National Academy of Sciences of the United States of America · 2025Article
- Challenges in measuring individual differences of brain function.Imaging neuroscience (Cambridge, Mass.) · 2025Article
- Comparing reliability-based measures of functional connectivity between movie and rest: An ROI-based approach.Imaging neuroscience (Cambridge, Mass.) · 2025Article
- Moving beyond processing- and analysis-related variation in resting-state functional brain imaging.Nature human behaviour · 2024Article
- Longitudinal regression of covariance matrix outcomes.Biostatistics (Oxford, England) · 2024Article
- Time-varying functional connectivity as Wishart processes.Imaging neuroscience (Cambridge, Mass.) · 2024Article
- Assessing intra- and inter-method agreement of functional data.Statistical methods in medical research · 2024Article
- Variability of multidimensional diffusion-relaxation MRI estimates in the human brain.Imaging neuroscience (Cambridge, Mass.) · 2024Article
- Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: A multiverse analysis using the monetary incentive delay task.Imaging neuroscience (Cambridge, Mass.) · 2024Article
- Precision data-driven modeling of cortical dynamics reveals idiosyncratic mechanisms underlying canonical oscillations.bioRxiv : the preprint server for biology · 2023Article
- Reproducibility of continuous glucose monitoring results under real-life conditions in an adult population: a functional data analysis.Scientific reports · 2023Article
- ReX: an integrative tool for quantifying and optimizing measurement reliability for the study of individual differences.Nature methods · 2023Article
- High-frequency longitudinal white matter diffusion- and myelin-based MRI database: Reliability and variability.Human brain mapping · 2023Article
- Within-subject reproducibility varies in multi-modal, longitudinal brain networks.Scientific reports · 2023Article
- Comparing the test-retest reliability of resting-state functional magnetic resonance imaging metrics across single band and multiband acquisitions in the context of healthy aging.Human brain mapping · 2023Article
- versaFlow: a versatile pipeline for resolution adapted diffusion MRI processing and its application to studying the variability of the PRIME-DE database.Frontiers in neuroinformatics · 2023Article
- Choice of Voxel-based Morphometry processing pipeline drives variability in the location of neuroanatomical brain markers.Communications biology · 2022Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
9 authors.
Funding
Abstract
This article proposes the image intraclass correlation (I2C2) coefficient as a global measure of reliability for imaging studies. The I2C2 generalizes the classic intraclass correlation (ICC) coefficient to the case when the data of interest are images, thereby providing a measure that is both intuitive and convenient. Drawing a connection with classical measurement error models for replication experiments, the I2C2 can be computed quickly, even in high-dimensional imaging studies. A nonparametric bootstrap procedure is introduced to quantify the variability of the I2C2 estimator. Furthermore, a Monte Carlo permutation is utilized to test reproducibility versus a zero I2C2, representing complete lack of reproducibility. Methodologies are applied to three replication studies arising from different brain imaging modalities and settings: regional analysis of volumes in normalized space imaging for characterizing brain morphology, seed-voxel brain activation maps based on resting-state functional magnetic resonance imaging (fMRI), and fractional anisotropy in an area surrounding the corpus callosum via diffusion tensor imaging. Notably, resting-state fMRI brain activation maps are found to have low reliability, ranging from .2 to .4. Software and data are available to provide easy access to the proposed methods.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.