Evidence map›Paper›PMID 38502108›Full record

ArticleMagnetic resonance in medicine2024

Reproducibility of arterial spin labeling cerebral blood flow image processing: A report of the ISMRM open science initiative for perfusion imaging (OSIPI) and the ASL MRI challenge.

Andre M Paschoal, Joseph G Woods, Joana Pinto, Esther E Bron, Jan Petr, Flora A Kennedy McConnell, Laura Bell, Maria-Eleni Dounavi, Cassandra Gould van Praag, Henk J M M Mutsaerts and 16 more

Abstract read
In one paragraph

Article in Magnetic resonance in medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

26 authors.

Andre M PaschoalInstitute of Physics, University of Campinas, Campinas, Brazil.ORCID 0000-0001-8269-711X
Joseph G WoodsWellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, UK.ORCID 0000-0002-0329-824X
Joana PintoInstitute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK.
Esther E BronDepartment of Radiology & Nuclear Medicine, Erasmus MC-University Medical Center Rotterdam, Rotterdam, the Netherlands.
Jan PetrHelmholtz-Zentrum Dresden-Rossendorf, Institute of Radiopharmaceutical Cancer Research, Dresden, Germany.ORCID 0000-0002-3201-6002
Flora A Kennedy McConnellRadiological Sciences, Division of Clinical Neuroscience, School of Medicine, University of Nottingham, Nottingham, UK.
Laura BellClinical Imaging Group, Genentech, Inc., South San Francisco, California, USA.ORCID 0000-0001-8164-8324
Maria-Eleni DounaviDepartment of Psychiatry, University of Cambridge, Cambridge, UK.
Cassandra Gould van PraagWellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, UK.
Henk J M M MutsaertsDepartment of Radiology and Nuclear Medicine, Vrije Universiteit Amsterdam, Amsterdam UMC Location VUmc, Amsterdam, the Netherlands.ORCID 0000-0003-0894-0307
Aaron Oliver TaylorGold Standard Phantoms Limited, London, UK.
Moss Y ZhaoDepartment of Radiology, Stanford University, Stanford, California, USA.ORCID 0000-0002-0210-7739
Irène BrumerComputer Assisted Clinical Medicine, Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University, Heidelberg, Germany.ORCID 0000-0002-1936-8687
Wei Siang Marcus ChanComputer Assisted Clinical Medicine, Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University, Heidelberg, Germany.
Jack TonerSir Peter Mansfield Imaging Centre, School of Medicine, University of Nottingham, Nottingham, UK.
Jian HuSir Peter Mansfield Imaging Centre, School of Medicine, University of Nottingham, Nottingham, UK.ORCID 0000-0003-0946-9617
Logan X ZhangInstitute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK.ORCID 0000-0003-1484-3992
Catarina DomingosInstitute for Systems and Robotics-Lisboa and Department of Bioengineering, Instituto Superior Técnico-Universidade de Lisboa, Lisbon, Portugal.
Sara P MonteiroInstitute for Systems and Robotics-Lisboa and Department of Bioengineering, Instituto Superior Técnico-Universidade de Lisboa, Lisbon, Portugal.ORCID 0000-0002-2530-5535
Patrícia FigueiredoInstitute for Systems and Robotics-Lisboa and Department of Bioengineering, Instituto Superior Técnico-Universidade de Lisboa, Lisbon, Portugal.
Alexander G J HarmsDepartment of Radiology & Nuclear Medicine, Erasmus MC-University Medical Center Rotterdam, Rotterdam, the Netherlands.
Beatriz E PadrelaDepartment of Radiology and Nuclear Medicine, Vrije Universiteit Amsterdam, Amsterdam UMC Location VUmc, Amsterdam, the Netherlands.
Channelle ThamDepartment of Cognitive Neuroscience, Radboud University Medical Center, Nijmegen, the Netherlands.
Ahmed AbdalleSchulich School of Medicine and Dentistry, Western University, London, Ontario, Canada.
Paula L CroalRadiological Sciences, Division of Clinical Neuroscience, School of Medicine, University of Nottingham, Nottingham, UK.
Udunna AnazodoDepartment of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Québec, Canada.

Funding

DEBBIE JPND2020-568-106E! 113701EU Joint Program for Neurodegenerative Disease ResearchEuropean UnionFundação de Amparo à Pesquisa do Estado de São Paulo 2022/06496-7Fundação para a Ciência e a Tecnologia 10.54499/UIDB/50009/2020Fundação para a Ciência e a Tecnologia 10.54499/UIDP/50009/2020Fundação para a Ciência e a Tecnologia DOI: 10.54499/LA/P/0083/2020Fundação para a Ciência e a Tecnologia PTDC/EMD/EMD/29686/2017Fundação para a Ciência e a Tecnologia SFRH/BD/120006/2016Fundo de Apoio ao Ensino, à Pesquisa e Extensão, Universidade Estadual de Campinas 2589/23Heart Foundation 03-004-2020-T049ISMRM Perfusion Study Group'La Caixa' Foundation LCF/PR/HP22/0053Linacre College, University of Oxford 220204/Z/20/ZNetherlands Enterprise AgencyNetherlands Organisation for health Research and DevelopmentProgramaOperacional Regional de Lisboa LISBOA-01-0145-FEDER-02968Wellcome TrustWellcome Trust 203139/Z/16/ZWellcome Trust Sir Henry Dale Fellowship 220204/Z/20/Z
6 · The paper itself

Abstract

purposeArterial spin labeling (ASL) is a widely used contrast-free MRI method for assessing cerebral blood flow (CBF). Despite the generally adopted ASL acquisition guidelines, there is still wide variability in ASL analysis. We explored this variability through the ISMRM-OSIPI ASL-MRI Challenge, aiming to establish best practices for more reproducible ASL analysis.

methodsEight teams analyzed the challenge data, which included a high-resolution T1-weighted anatomical image and 10 pseudo-continuous ASL datasets simulated using a digital reference object to generate ground-truth CBF values in normal and pathological states. We compared the accuracy of CBF quantification from each team's analysis to the ground truth across all voxels and within predefined brain regions. Reproducibility of CBF across analysis pipelines was assessed using the intra-class correlation coefficient (ICC), limits of agreement (LOA), and replicability of generating similar CBF estimates from different processing approaches.

resultsAbsolute errors in CBF estimates compared to ground-truth synthetic data ranged from 18.36 to 48.12 mL/100 g/min. Realistic motion incorporated into three datasets produced the largest absolute error and variability between teams, with the least agreement (ICC and LOA) with ground-truth results. Fifty percent of the submissions were replicated, and one produced three times larger CBF errors (46.59 mL/100 g/min) compared to submitted results.

conclusionsVariability in CBF measurements, influenced by differences in image processing, especially to compensate for motion, highlights the significance of standardizing ASL analysis workflows. We provide a recommendation for ASL processing based on top-performing approaches as a step toward ASL standardization.

Indexed as

BrainCerebrovascular CirculationImage Processing, Computer-AssistedMagnetic Resonance ImagingSpin LabelsAdultAlgorithmsFemaleHumansMalePerfusion ImagingReproducibility of ResultsSpin LabelsASLcerebral blood flowchallengesimage analysisreproducibility

Identifiers

PMID38502108
PMCPMC11497242

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.