Evidence map›Paper›PMID 38991556›Full record

Trial reportNeuro-oncology2024

Automated segmentation of brain metastases with deep learning: A multi-center, randomized crossover, multi-reader evaluation study.

Xiao Luo, Yadi Yang, Shaohan Yin, Hui Li, Ying Shao, Dechun Zheng, Xinchun Li, Jianpeng Li, Weixiong Fan, Jing Li and 21 more

Abstract readMulticenter StudyRandomized Controlled Trial
In one paragraph

Trial report in Neuro-oncology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Clinical and MRI factors influencing interobserver delineation variability of brain metastases before stereotactic radiotherapy.Strahlentherapie und Onkologie : Organ der Deutschen Rontgengesellschaft ... [et al] · 2026
    Article
  3. Article
  4. Article
  5. Review
  6. Review
  7. Article
  8. Artificial intelligence in neuro-oncology: methodological bases, practical applications and ethical and regulatory issues.Clinical & translational oncology : official publication of the Federation of Spanish Oncology Societies and of the National Cancer Institute of Mexico · 2025
    Review
  9. Review
  10. Review
  11. Article
  12. Review
  13. Article
  14. Review
  15. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

31 authors.

Xiao LuoState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.ORCID 0000-0001-5864-0279
Yadi YangState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Shaohan YinState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Hui LiState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Ying ShaoR&D Department, Shanghai United Imaging Intelligence Co., Ltd, Shanghai, China.
Dechun ZhengDepartment of Radiology, Fujian Cancer Hospital, Fujian Medical University Cancer Hospital, Fuzhou, Fujian Province, China.
Xinchun LiDepartment of Radiology, The First Affiliated Hospital of Guangzhou Medical University, Guang zhou, Guangdong Province, China.
Jianpeng LiDepartment of Radiology, Affiliated Dongguan Hospital, Southern Medical University, Dongguan, Guangdong Province, China.
Weixiong FanDepartment of Magnetic Resonance, Guangdong Provincial Key Laboratory of Precision Medicine and Clinical Translational Research of Hakka Population, Meizhou People's Hospital, Meizhou, Guangdong Province, China.
Jing LiState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Xiaohua BanState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Shanshan LianState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Yun ZhangState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Qiuxia YangState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Weijing ZhangState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Cheng ZhangState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Lidi MaState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.ORCID 0000-0003-0221-6529
Yingwei LuoState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Fan ZhouState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Shiyuan WangState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Cuiping LinState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Jiao LiState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Ma LuoState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Jianxun HeDepartment of Radiology, The First Affiliated Hospital of Guangzhou Medical University, Guang zhou, Guangdong Province, China.
Guixiao XuState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.
Yaozong GaoR&D Department, Shanghai United Imaging Intelligence Co., Ltd, Shanghai, China.ORCID 0000-0002-7547-5209
Dinggang ShenR&D Department, Shanghai United Imaging Intelligence Co., Ltd, Shanghai, China.
Ying SunDepartment of Radiation Oncology, Sun Yat-Sen University Cancer Center, Guang zhou, Guangdong Province, China.ORCID 0000-0002-4630-9404
Yonggao MouDepartment of Neurosurgery, Sun Yat-Sen University Cancer Center, Guang zhou, Guangdong Province, China.
Rong ZhangState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.ORCID 0000-0003-1188-0640
Chuanmiao XieState Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Sun Yat-sen University Cancer Center, Guang zhou, Guangdong Province, China.ORCID 0000-0001-8533-623X

Funding

Guangdong Medical Science and Technology Research Foundation C2022061
6 · The paper itself

Abstract

backgroundArtificial intelligence has been proposed for brain metastasis (BM) segmentation but it has not been fully clinically validated. The aim of this study was to develop and evaluate a system for BM segmentation.

methodsA deep-learning-based BM segmentation system (BMSS) was developed using contrast-enhanced MR images from 488 patients with 10338 brain metastases. A randomized crossover, multi-reader study was then conducted to evaluate the performance of the BMSS for BM segmentation using data prospectively collected from 50 patients with 203 metastases at 5 centers. Five radiology residents and 5 attending radiologists were randomly assigned to contour the same prospective set in assisted and unassisted modes. Aided and unaided Dice similarity coefficients (DSCs) and contouring times per lesion were compared.

resultsThe BMSS alone yielded a median DSC of 0.91 (95% confidence interval, 0.90-0.92) in the multi-center set and showed comparable performance between the internal and external sets (P = .67). With BMSS assistance, the readers increased the median DSC from 0.87 (0.87-0.88) to 0.92 (0.92-0.92) (P < .001) with a median time saving of 42% (40-45%) per lesion. Resident readers showed a greater improvement than attending readers in contouring accuracy (improved median DSC, 0.05 [0.05-0.05] vs 0.03 [0.03-0.03]; P < .001), but a similar time reduction (reduced median time, 44% [40-47%] vs 40% [37-44%]; P = .92) with BMSS assistance.

conclusionsThe BMSS can be optimally applied to improve the efficiency of brain metastasis delineation in clinical practice.

Indexed as

Brain NeoplasmsCross-Over StudiesDeep LearningMagnetic Resonance ImagingAdultAgedFemaleHumansImage Interpretation, Computer-AssistedImage Processing, Computer-AssistedMaleMiddle AgedProspective Studiesautomatic segmentationbrain metastasesdeep learningMRImulti-reader multi-case

Identifiers

PMID38991556
PMCPMC11639187

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.