Evidence map›Paper›PMID 35856915›Full record

ReviewCurrent opinion in neurology2022

Reproducibility and replicability in neuroimaging data analysis.

Tü Lay Adali, Vince D Calhoun

Abstract readReview
In one paragraph

Review in Current opinion in neurology, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Review
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Review
  15. Article
  16. Article
  17. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors.

Tü Lay AdaliDepartment of CSEE, University of Maryland, Baltimore County, Baltimore, Maryland.
Vince D CalhounTri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, Georgia, USA.

Funding

Male/Female differences in psychosis and mood disorders:Dynamic imaging-genomic models for characterizing and predicting psychosis and mood dR01MH118695 · NIMH · GEORGIA STATE UNIVERSITY · PI ADALI, TULAY, CALHOUN, VINCE D · 2019 to 2023
$3.8M
Data driven dynamic activity/connectivity methods for early detection of Alzheimer’sR01AG073949 · NIA · GEORGIA STATE UNIVERSITY · PI ADALI, TULAY, CALHOUN, VINCE D · 2021 to 2025
$3.7M
Data-driven solutions for temporal, spatial, and spatiotemporal dynamic functional connectivityR01MH123610 · NIMH · GEORGIA STATE UNIVERSITY · PI ADALI, TULAY, CALHOUN, VINCE D · 2021 to 2025
$3.1M
Unified multivariate data-driven solutions for static and dynamic brain connectivityR01EB020407 · NIBIB · THE MIND RESEARCH NETWORK · PI ADALI, TULAY, CALHOUN, VINCE D · 2015 to 2018
$2.7M
NIA NIH HHS R01 AG073949NIBIB NIH HHS R01 EB020407NIMH NIH HHS R01 MH118695NIMH NIH HHS R01 MH123610
6 · The paper itself

Abstract

purpose of reviewMachine learning solutions are being increasingly used in the analysis of neuroimaging (NI) data, and as a result, there is an increase in the emphasis of the reproducibility and replicability of these data-driven solutions. Although this is a very positive trend, related terminology is often not properly defined, and more importantly, (computational) reproducibility that refers to obtaining consistent results using the same data and the same code is often disregarded. RECENT

findingsWe review the findings of a recent paper on the topic along with other relevant literature, and present two examples that demonstrate the importance of accounting for reproducibility in widely used software for NI data. SUMMARY: We note that reproducibility should be a first step in all NI data analyses including those focusing on replicability, and introduce available solutions for assessing reproducibility. We add the cautionary remark that when not taken into account, lack of reproducibility can significantly bias all subsequent analysis stages.

Indexed as

Data AnalysisNeuroimagingHumansMachine LearningReproducibility of ResultsSoftware

Identifiers

PMID35856915
PMCPMC9309985

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.