Evidence map›Paper›PMID 29963984›Full record

ArticleeLife2018

Assessing reliability in neuroimaging research through intra-class effect decomposition (ICED).

Andreas M Brandmaier, Elisabeth Wenger, Nils C Bodammer, Simone Kühn, Naftali Raz, Ulman Lindenberger

Abstract read
In one paragraph

Article in eLife, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 40 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
40citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

40 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Beyond classical metrics: Generalizability theory across psychophysiological modalities.International journal of psychophysiology : official journal of the International Organization of Psychophysiology · 2026
    Review
  4. Article
  5. Article
  6. Developmental Changes in Brain Cellular Membrane and Energy Metabolism: A Multi-occasionThe Journal of neuroscience : the official journal of the Society for Neuroscience · 2025
    Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Challenges in measuring individual differences of brain function.Imaging neuroscience (Cambridge, Mass.) · 2025
    Article
  12. Article
  13. Review
  14. Review
  15. Review
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Andreas M BrandmaierCenter for Lifespan Psychology, Max Planck Institute for Human Development, Berlin, Germany.ORCID 0000-0001-8765-6982
Elisabeth WengerCenter for Lifespan Psychology, Max Planck Institute for Human Development, Berlin, Germany.
Nils C BodammerCenter for Lifespan Psychology, Max Planck Institute for Human Development, Berlin, Germany.
Simone KühnClinic and Policlinic for Psychiatry and Psychotherapy, University Clinic Hamburg-Eppendorf, Hamburg, Germany.
Naftali RazCenter for Lifespan Psychology, Max Planck Institute for Human Development, Berlin, Germany.ORCID 0000-0002-5080-2138
Ulman LindenbergerCenter for Lifespan Psychology, Max Planck Institute for Human Development, Berlin, Germany.ORCID 0000-0001-8428-6453

Funding

NEURAL CORRELATES OF AGE-RELATED DIFFERENCES IN MEMORYR01AG011230 · NIA · WAYNE STATE UNIVERSITY · PI DAUGHERTY, ANA MARIE, RAZ, NAFTALI · 1993 to 2020
$4.8M
NIA NIH HHS R01 AG011230NIH HHS R01-AG011230
6 · The paper itself

Abstract

Magnetic resonance imaging has become an indispensable tool for studying associations of structural and functional properties of the brain with behavior in humans. However, generally recognized standards for assessing and reporting the reliability of these techniques are still lacking. Here, we introduce a new approach for assessing and reporting reliability, termed intra-class effect decomposition (ICED). ICED uses structural equation modeling of data from a repeated-measures design to decompose reliability into orthogonal sources of measurement error that are associated with different characteristics of the measurements, for example, session, day, or scanning site. This allows researchers to describe the magnitude of different error components, make inferences about error sources, and inform them in planning future studies. We apply ICED to published measurements of myelin content and resting state functional connectivity. These examples illustrate how longitudinal data can be leveraged separately or conjointly with cross-sectional data to obtain more precise estimates of reliability.

Indexed as

Analysis of VarianceBrainConnectomeHumansMagnetic Resonance ImagingNeuroimagingReproducibility of ResultsSensitivity and Specificitycoefficient of variationG theoryhumanindividual differencesintra-class correlationneurosciencereliabilitystructural equation modeling

Identifiers

PMID29963984
PMCPMC6044907

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.