Evidence map›Paper›PMID 32427874›Full record

ArticleScientific reports2020

Evaluating White Matter Lesion Segmentations with Refined Sørensen-Dice Analysis.

Aaron Carass, Snehashis Roy, Adrian Gherman, Jacob C Reinhold, Andrew Jesson, Tal Arbel, Oskar Maier, Heinz Handels, Mohsen Ghafoorian, Bram Platel and 9 more

Abstract readEvaluation Study
In one paragraph

Article in Scientific reports, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 72 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
72citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

72 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. AutoPET Challenge on Fully Automated Lesion Segmentation in Oncologic PET/CT Imaging, Part 2: Domain Generalization.Journal of nuclear medicine : official publication, Society of Nuclear Medicine · 2026
    Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

12 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

19 authors.

Aaron CarassDepartment of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, 21218, USA. aaron_carass@jhu.edu.ORCID http://orcid.org/0000-0003-4939-5085
Snehashis RoyCNRM, The Henry M. Jackson Foundation for the Advancement of Military Medicine, Bethesda, MD, 20817, USA.
Adrian GhermanDepartment of Biostatistics, The Johns Hopkins University, Baltimore, MD, 21205, USA.
Jacob C ReinholdDepartment of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, 21218, USA.
Andrew JessonCentre For Intelligent Machines, McGill University, Montréal, QC, H3A 0E9, Canada.
Tal ArbelCentre For Intelligent Machines, McGill University, Montréal, QC, H3A 0E9, Canada.
Oskar MaierInstitute of Medical Informatics, University of Lübeck, 23538, Lübeck, Germany.
Heinz HandelsInstitute of Medical Informatics, University of Lübeck, 23538, Lübeck, Germany.
Mohsen GhafoorianInstitute for Computing and Information Sciences, Radboud University, 6525, HP, Nijmegen, Netherlands.
Bram PlatelDiagnostic Image Analysis Group, Radboud University Medical Center, 6525, GA, Nijmegen, Netherlands.
Ariel BirenbaumDepartment of Electrical Engineering, Tel-Aviv University, Tel-Aviv, 69978, Israel.
Hayit GreenspanDepartment of Biomedical Engineering, Tel-Aviv University, Tel-Aviv, 69978, Israel.
Dzung L PhamCNRM, The Henry M. Jackson Foundation for the Advancement of Military Medicine, Bethesda, MD, 20817, USA.
Ciprian M CrainiceanuDepartment of Biostatistics, The Johns Hopkins University, Baltimore, MD, 21205, USA.
Peter A CalabresiDepartment of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD, 21287, USA.ORCID http://orcid.org/0000-0002-7776-6472
Jerry L PrinceDepartment of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, 21218, USA.
William R Gray RoncalDepartment of Computer Science, The Johns Hopkins University, Baltimore, MD, 21218, USA.
Russell T ShinoharaPenn Statistics in Imaging and Visualization Center, Department of Biostatistics & Epidemiology, University of Pennsylvania, Philadelphia, PA, 19104, USA.
Ipek OguzDepartment of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, 37203, USA.

Funding

Imaging Neurodegeneration in Multiple SclerosisR01NS082347 · NINDS · JOHNS HOPKINS UNIVERSITY · PI PETER A CALABRESI, Shiv Saidha · 2013 to 2026
$7.0M
Adaptive Large-Scale Framework for Automatic Biomedical Image SegmentationR01EB017255 · NIBIB · UNIVERSITY OF PENNSYLVANIA · PI YUSHKEVICH, PAUL A. · 2014 to 2018
$3.0M
Statistical methods for large and complex databases of ultra-high-dimensionalR01NS085211 · NINDS · UNIVERSITY OF PENNSYLVANIA · PI SHINOHARA, RUSSELL TAKESHI · 2013 to 2017
$1.8M
Brain Image Analysis Tools for Quantitative Longitudinal Assessment of MSR01NS070906 · NINDS · HENRY M. JACKSON FDN FOR THE ADV MIL/MED · PI PHAM, DZUNG L · 2010 to 2014
$1.7M
Early detection of Huntington's Disease: Longitudinal analysis of basal ganglia and cortical thicknessR01NS094456 · NINDS · VANDERBILT UNIVERSITY · PI OGUZ, IPEK · 2016 to 2019
$1.3M
SABER: Scalable Analytics for Brain Exploration Research using X-Ray Microtomography and Electron MicroscopyR24MH114799 · NIMH · JOHNS HOPKINS UNIVERSITY · PI GRAY RONCAL, WILLIAM R · 2017 to 2019
$1.2M
Spatiotemporal Modeling of MRI Brain Lesion Trajectories of Biomarker DiscoveryR21NS093349 · NINDS · UNIVERSITY OF PENNSYLVANIA · PI ELOYAN, ANI, SHINOHARA, RUSSELL TAKESHI · 2016 to 2017
$454k
NIBIB NIH HHS R01 EB017255NIMH NIH HHS R24 MH114799NINDS NIH HHS R01 NS070906NINDS NIH HHS R01 NS082347NINDS NIH HHS R01 NS085211NINDS NIH HHS R01 NS094456NINDS NIH HHS R21 NS093349
6 · The paper itself

Abstract

The Sørensen-Dice index (SDI) is a widely used measure for evaluating medical image segmentation algorithms. It offers a standardized measure of segmentation accuracy which has proven useful. However, it offers diminishing insight when the number of objects is unknown, such as in white matter lesion segmentation of multiple sclerosis (MS) patients. We present a refinement for finer grained parsing of SDI results in situations where the number of objects is unknown. We explore these ideas with two case studies showing what can be learned from our two presented studies. Our first study explores an inter-rater comparison, showing that smaller lesions cannot be reliably identified. In our second case study, we demonstrate fusing multiple MS lesion segmentation algorithms based on the insights into the algorithms provided by our analysis to generate a segmentation that exhibits improved performance. This work demonstrates the wealth of information that can be learned from refined analysis of medical image segmentations.

Indexed as

AdultAlgorithmsFemaleHumansImage Processing, Computer-AssistedMagnetic Resonance ImagingMaleMiddle AgedMultiple SclerosisWhite Matter

Identifiers

PMID32427874
PMCPMC7237671

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.