Evidence map›Paper›PMID 28087490›Full record

ArticleNeuroImage2017

Longitudinal multiple sclerosis lesion segmentation: Resource and challenge.

Aaron Carass, Snehashis Roy, Amod Jog, Jennifer L Cuzzocreo, Elizabeth Magrath, Adrian Gherman, Julia Button, James Nguyen, Ferran Prados, Carole H Sudre and 36 more

Open access · greenAbstract read
In one paragraph

Article in NeuroImage, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 115 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
115citing papers in PubMed, 3 pooled it
22.6field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

115 citing papers in PubMed, 3 syntheses or guidelines pooled it, 344 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Self-supervised brain lesion generation for effective data augmentation of medical images.Neural networks : the official journal of the International Neural Network Society · 2025
    Article
  19. Article
  20. Article

55 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

46 authors at 17 institutions in 11 countries.

Aaron CarassDepartment of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218, USA; Department of Computer Science, The Johns Hopkins University, Baltimore, MD 21218, USA. Electronic address: aaron_carass@jhu.edu.
Snehashis RoyCNRM, The Henry M. Jackson Foundation for the Advancement of Military Medicine, Bethesda, MD 20892, USA.
Amod JogDepartment of Computer Science, The Johns Hopkins University, Baltimore, MD 21218, USA.
Jennifer L CuzzocreoDepartment of Radiology, The Johns Hopkins School of Medicine, Baltimore, MD 21287, USA.
Elizabeth MagrathCNRM, The Henry M. Jackson Foundation for the Advancement of Military Medicine, Bethesda, MD 20892, USA.
Adrian GhermanDepartment of Biostatistics, The Johns Hopkins University, Baltimore, MD 21205, USA.
Julia ButtonDepartment of Radiology, The Johns Hopkins School of Medicine, Baltimore, MD 21287, USA.
James NguyenDepartment of Radiology, The Johns Hopkins School of Medicine, Baltimore, MD 21287, USA.
Ferran PradosTranslational Imaging Group, CMIC, UCL, NW1 2HE London, UK; NMR Research Unit, UCL Institute of Neurology, WC1N 3BG London, UK.
Carole H SudreTranslational Imaging Group, CMIC, UCL, NW1 2HE London, UK.
Manuel Jorge CardosoTranslational Imaging Group, CMIC, UCL, NW1 2HE London, UK; Dementia Research Centre, UCL Institute of Neurology, WC1N 3BG London, UK.
Niamh CawleyNMR Research Unit, UCL Institute of Neurology, WC1N 3BG London, UK.
Olga CiccarelliNMR Research Unit, UCL Institute of Neurology, WC1N 3BG London, UK.
Claudia A M Wheeler-KingshottNMR Research Unit, UCL Institute of Neurology, WC1N 3BG London, UK.
Sébastien OurselinTranslational Imaging Group, CMIC, UCL, NW1 2HE London, UK; Dementia Research Centre, UCL Institute of Neurology, WC1N 3BG London, UK.
Laurence CataneseVisAGeS: INSERM U746, CNRS UMR6074, INRIA, University of Rennes I, France.
Hrishikesh DeshpandeVisAGeS: INSERM U746, CNRS UMR6074, INRIA, University of Rennes I, France.
Pierre MaurelVisAGeS: INSERM U746, CNRS UMR6074, INRIA, University of Rennes I, France.
Olivier CommowickVisAGeS: INSERM U746, CNRS UMR6074, INRIA, University of Rennes I, France.
Christian BarillotVisAGeS: INSERM U746, CNRS UMR6074, INRIA, University of Rennes I, France.
Xavier Tomas-FernandezComputational Radiology Laboratory, Boston Childrens Hospital, Boston, MA 02115, USA; Harvard Medical School, Boston, MA 02115, USA.
Simon K WarfieldComputational Radiology Laboratory, Boston Childrens Hospital, Boston, MA 02115, USA; Harvard Medical School, Boston, MA 02115, USA.
Suthirth VaidyaBiomedical Imaging Lab, Department of Engineering Design, Indian Institute of Technology, Chennai 600036, India.
Abhijith ChunduruBiomedical Imaging Lab, Department of Engineering Design, Indian Institute of Technology, Chennai 600036, India.
Ramanathan MuthuganapathyBiomedical Imaging Lab, Department of Engineering Design, Indian Institute of Technology, Chennai 600036, India.
Ganapathy KrishnamurthiBiomedical Imaging Lab, Department of Engineering Design, Indian Institute of Technology, Chennai 600036, India.
Andrew JessonCentre For Intelligent Machines, McGill University, Montréal, QC H3A 0E9, Canada.
Tal ArbelCentre For Intelligent Machines, McGill University, Montréal, QC H3A 0E9, Canada.
Oskar MaierInstitute of Medical Informatics, University of Lübeck, 23538 Lübeck, Germany.
Heinz HandelsInstitute of Medical Informatics, University of Lübeck, 23538 Lübeck, Germany.
Leonardo O IhemeBahçeşehir University, Faculty of Engineering and Natural Sciences, 34349 Beşiktaş, Turkey.
Devrim UnayBahçeşehir University, Faculty of Engineering and Natural Sciences, 34349 Beşiktaş, Turkey.
Saurabh Jainicometrix, 3012 Leuven, Belgium.
Diana M Simaicometrix, 3012 Leuven, Belgium.
Dirk Smeetsicometrix, 3012 Leuven, Belgium.
Mohsen GhafoorianInstitute for Computing and Information Sciences, Radboud University, 6525 HP Nijmegen, Netherlands.
Bram PlatelDiagnostic Image Analysis Group, Radboud University Medical Center, 6525 GA Nijmegen, Netherlands.
Ariel BirenbaumDepartment of Electrical Engineering, Tel-Aviv University, Tel-Aviv 69978, Israel.
Hayit GreenspanDepartment of Biomedical Engineering, Tel-Aviv University, Tel-Aviv 69978, Israel.
Pierre-Louis BazinDepartment of Neurophysics, Max Planck Institute, 04103 Leipzig, Germany.
Peter A CalabresiDepartment of Radiology, The Johns Hopkins School of Medicine, Baltimore, MD 21287, USA.
Ciprian M CrainiceanuDepartment of Biostatistics, The Johns Hopkins University, Baltimore, MD 21205, USA.
Lotta M EllingsenDepartment of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218, USA; Department of Electrical and Computer Engineering, University of Iceland, 107 Reykjavík, Iceland.
Daniel S ReichDepartment of Radiology, The Johns Hopkins School of Medicine, Baltimore, MD 21287, USA; Translational Neuroradiology Unit, National Institute of Neurological Disorders and Stroke, Bethesda, MD 20892, USA.
Jerry L PrinceDepartment of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218, USA; Department of Computer Science, The Johns Hopkins University, Baltimore, MD 21218, USA.
Dzung L PhamCNRM, The Henry M. Jackson Foundation for the Advancement of Military Medicine, Bethesda, MD 20892, USA.
Johns Hopkins University · USUniversity College London · GBIndian Institute of Technology Madras · INHenry M. Jackson Foundation · USIcometrix (Belgium) · BEBahçeşehir University · TRBoston Children's Hospital · USCentre National de la Recherche Scientifique · FRInstitut national de recherche en informatique et en automatique · FRMcGill University · CATel Aviv University · ILUniversity of Lübeck · DEAnalysis Group (United States) · USRadboud University Nijmegen · NLUK Dementia Research Institute · GBUniversité de Rennes · FRUniversity of Iceland · IS

Funding

Multimodal MRI in Multiple SclerosisZIANS003119 · NINDS · NATIONAL INSTITUTE OF NEUROLOGICAL DISORDERS AND STROKE · PI REICH, DANIEL · 2010 to 2025
$53.4M
Statistical Methods for Multilevel Multivariate Functional StudiesR01NS060910 · NINDS · JOHNS HOPKINS UNIVERSITY · PI Ciprian M Crainiceanu · 2009 to 2026
$8.3M
Brain Image Analysis Tools for Quantitative Longitudinal Assessment of MSR01NS070906 · NINDS · HENRY M. JACKSON FDN FOR THE ADV MIL/MED · PI PHAM, DZUNG L · 2010 to 2014
$1.7M
Medical Research Council MR/J01107X/1NINDS NIH HHS R01 NS060910NINDS NIH HHS R01 NS070906
6 · The paper itself

Abstract

In conjunction with the ISBI 2015 conference, we organized a longitudinal lesion segmentation challenge providing training and test data to registered participants. The training data consisted of five subjects with a mean of 4.4 time-points, and test data of fourteen subjects with a mean of 4.4 time-points. All 82 data sets had the white matter lesions associated with multiple sclerosis delineated by two human expert raters. Eleven teams submitted results using state-of-the-art lesion segmentation algorithms to the challenge, with ten teams presenting their results at the conference. We present a quantitative evaluation comparing the consistency of the two raters as well as exploring the performance of the eleven submitted results in addition to three other lesion segmentation algorithms. The challenge presented three unique opportunities: (1) the sharing of a rich data set; (2) collaboration and comparison of the various avenues of research being pursued in the community; and (3) a review and refinement of the evaluation metrics currently in use. We report on the performance of the challenge participants, as well as the construction and evaluation of a consensus delineation. The image data and manual delineations will continue to be available for download, through an evaluation website

Indexed as

AdultAlgorithmsFemaleHumansImage Processing, Computer-AssistedImaging, Three-DimensionalLongitudinal StudiesMagnetic Resonance ImagingMaleMiddle AgedMultiple SclerosisObserver VariationWhite MatterMagnetic resonance imagingMultiple sclerosis

Identifiers

PMID28087490
PMCPMC5344762
OpenAlexW2575552683

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.