Evidence map›Paper›PMID 34503533›Full record

ArticleRadiation oncology (London, England)2021

Evaluation of auto-segmentation accuracy of cloud-based artificial intelligence and atlas-based models.

Yuka Urago, Hiroyuki Okamoto, Tomoya Kaneda, Naoya Murakami, Tairo Kashihara, Mihiro Takemori, Hiroki Nakayama, Kotaro Iijima, Takahito Chiba, Junichi Kuwahara and 5 more

Abstract readEvaluation Study
In one paragraph

Article in Radiation oncology (London, England), 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 32 papers.

0numbers the graph read from it
0cells of the map it votes in
32citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

32 citing papers in PubMed.

  1. Article
  2. Convolutional Neural Networks in Radiology: Principles, Clinical Applications, and a Practical Framework for Radiologists.Medical principles and practice : international journal of the Kuwait University, Health Science Centre · 2026
    Review
  3. Review
  4. Article
  5. Enhancing Radiation Oncology Education Through Artificial Intelligence: A Review of Applications, Limitations, and Future Directions.Journal of cancer education : the official journal of the American Association for Cancer Education · 2025
    Review
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Evaluation of multiple-vendor AI autocontouring solutions.Radiation oncology (London, England) · 2024
    Article
  17. Article
  18. Article
  19. Review
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Yuka UragoDepartment of Radiological Sciences, Graduate School of Human Health Sciences, Tokyo Metropolitan University, 7-2-10 Higashi-Ogu, Arakawa-ku, Tokyo, 116-8551, Japan.
Hiroyuki OkamotoDepartment of Medical Physics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan. hiokamot@ncc.go.jp.ORCID http://orcid.org/0000-0001-9491-787X
Tomoya KanedaDepartment of Radiation Oncology, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.
Naoya MurakamiDepartment of Radiation Oncology, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.
Tairo KashiharaDepartment of Radiation Oncology, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.
Mihiro TakemoriDepartment of Radiological Sciences, Graduate School of Human Health Sciences, Tokyo Metropolitan University, 7-2-10 Higashi-Ogu, Arakawa-ku, Tokyo, 116-8551, Japan.
Hiroki NakayamaDepartment of Radiological Sciences, Graduate School of Human Health Sciences, Tokyo Metropolitan University, 7-2-10 Higashi-Ogu, Arakawa-ku, Tokyo, 116-8551, Japan.
Kotaro IijimaDepartment of Medical Physics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.
Takahito ChibaDepartment of Medical Physics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.
Junichi KuwaharaDepartment of Medical Physics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.
Shouichi KatsutaDepartment of Radiological Technology, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.
Satoshi NakamuraDepartment of Medical Physics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.
Weishan ChangDepartment of Radiological Sciences, Graduate School of Human Health Sciences, Tokyo Metropolitan University, 7-2-10 Higashi-Ogu, Arakawa-ku, Tokyo, 116-8551, Japan.
Hidetoshi SaitohDepartment of Radiological Sciences, Graduate School of Human Health Sciences, Tokyo Metropolitan University, 7-2-10 Higashi-Ogu, Arakawa-ku, Tokyo, 116-8551, Japan.
Hiroshi IgakiDepartment of Radiation Oncology, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.

Funding

ITOCHU corporation C2019-121
6 · The paper itself

Abstract

backgroundContour delineation, a crucial process in radiation oncology, is time-consuming and inaccurate due to inter-observer variation has been a critical issue in this process. An atlas-based automatic segmentation was developed to improve the delineation efficiency and reduce inter-observer variation. Additionally, automated segmentation using artificial intelligence (AI) has recently become available. In this study, auto-segmentations by atlas- and AI-based models for Organs at Risk (OAR) in patients with prostate and head and neck cancer were performed and delineation accuracies were evaluated.

methodsTwenty-one patients with prostate cancer and 30 patients with head and neck cancer were evaluated. MIM Maestro was used to apply the atlas-based segmentation. MIM Contour ProtégéAI was used to apply the AI-based segmentation. Three similarity indices, the Dice similarity coefficient (DSC), Hausdorff distance (HD), and mean distance to agreement (MDA), were evaluated and compared with manual delineations. In addition, radiation oncologists visually evaluated the delineation accuracies.

resultsAmong patients with prostate cancer, the AI-based model demonstrated higher accuracy than the atlas-based on DSC, HD, and MDA for the bladder and rectum. Upon visual evaluation, some errors were observed in the atlas-based delineations when the boundary between the small bowel or the seminal vesicle and the bladder was unclear. For patients with head and neck cancer, no significant differences were observed between the two models for almost all OARs, except small delineations such as the optic chiasm and optic nerve. The DSC tended to be lower when the HD and the MDA were smaller in small volume delineations.

conclusionsIn terms of efficiency, the processing time for head and neck cancers was much shorter than manual delineation. While quantitative evaluation with AI-based segmentation was significantly more accurate than atlas-based for prostate cancer, there was no significant difference for head and neck cancer. According to the results of visual evaluation, less necessity of manual correction in AI-based segmentation indicates that the segmentation efficiency of AI-based model is higher than that of atlas-based model. The effectiveness of the AI-based model can be expected to improve the segmentation efficiency and to significantly shorten the delineation time.

Indexed as

Artificial IntelligenceCloud ComputingAtlases as TopicHead and Neck NeoplasmsHumansMaleObserver VariationOrgans at RiskProstatic NeoplasmsArtificial intelligenceAutomatic segmentationDeep learning neural networkHead and neck cancerProstate cancer

Identifiers

PMID34503533
PMCPMC8427857

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.