Evidence map›Paper›PMID 34027588›Full record

ArticleJournal of digital imaging2021

Novel Autosegmentation Spatial Similarity Metrics Capture the Time Required to Correct Segmentations Better Than Traditional Metrics in a Thoracic Cavity Segmentation Workflow.

Kendall J Kiser, Arko Barman, Sonja Stieb, Clifton D Fuller, Luca Giancardo

Open access · hybridAbstract read
In one paragraph

Article in Journal of digital imaging, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 31 papers.

0numbers the graph read from it
0cells of the map it votes in
31citing papers in PubMed
2.8field-weighted citation impact, top 9% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

31 citing papers in PubMed, 43 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Quantifying manual editing time in autocontouring via audit log analysis.Physics and imaging in radiation oncology · 2026
    Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Journal of medical imaging (Bellingham, Wash.) · 2023
    Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 3 institutions in 1 country.

Kendall J KiserDepartment of Radiation Oncology, Washington University School of Medicine in St. Louis, St. Louis, MO, USA. K.j.kiser@wustl.edu.ORCID 0000-0001-7457-5534
Arko BarmanCenter for Precision Health, UT Health School of Biomedical Informatics, Houston, TX, USA.
Sonja StiebDepartment of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, USA.
Clifton D FullerDepartment of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, USA.
Luca GiancardoCenter for Precision Health, UT Health School of Biomedical Informatics, Houston, TX, USA.
The University of Texas Health Science Center at Houston · USThe University of Texas MD Anderson Cancer Center · USWashington University in St. Louis · US

Funding

Tumor Evolution and Metastasis ProgramP30CA016672 · NCI · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI Fabien Delerue · 1985 to 2026
$290.8M
Convalescent Plasma to Limit Coronavirus Associated ComplicationsUL1TR003167 · NCATS · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI KARP, DANIEL D, MCPHERSON, DAVID D · 2019 to 2023
$45.3M
Targeting the p53 pathway for reversal of oral premalignancyP50CA097007 · NCI · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI MILLS, GORDON B. · 2002 to 2012
$26.1M
Development of functional magnetic resonance imaging-guided adaptive radiotherapy for head and neck cancer patients using novel MR-Linac deviceR01DE028290 · NIDCR · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI CHRISTODOULEAS, JOHN PAUL, FULLER, CLIFTON DAVID · 2019 to 2023
$4.3M
Using Dynamic Contrast-Enhanced Magnetic Resonance Imaging (DCE-MRI) to Establish Objective Clinical Outcome Measures for Mandibular OsteoradionecrosisR01DE025248 · NIDCR · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI LAI, STEPHEN Y · 2016 to 2020
$2.9M
SMART-ACT: Spatial Methodologic Approaches for Risk Assessment and Therapeutic Adaptation in Cancer TreatmentR01CA214825 · NCI · UNIVERSITY OF ILLINOIS AT CHICAGO · PI CANAHUATE, GUADALUPE, FULLER, CLIFTON DAVID · 2017 to 2019
$1.1M
imaging Radiation-Associated Dysphagia (iRAD)R01CA218148 · NCI · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI FULLER, CLIFTON DAVID, HUTCHESON, KATHERINE ARNOLD · 2017 to 2019
$810k
Fellow and Resident Radiation Oncology iNtensive Training in Imaging and Informatics to Empower Research Careers (FRONTI2ER)R25EB025787 · NIBIB · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI DAS, PRAJNAN, FULLER, CLIFTON DAVID · 2018 to 2022
$535k
Using Dynamic Contrast-Enhanced Magnetic Resonance Imaging (DCE-MRI) to Establish Objective Clinical Outcome Measures for Mandibular OsteoradionecrosisR56DE025248 · NIDCR · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI LAI, STEPHEN Y · 2015 to 2015
$470k
NCATS NIH HHS UL1 TR003167NCI NIH HHS 1R01CA214825NCI NIH HHS 1R01CA218148NCI NIH HHS P30 CA016672NCI NIH HHS P30CA016672NCI NIH HHS P50 CA097007NCI NIH HHS P50CA097007NCI NIH HHS R01 CA214825NCI NIH HHS R01 CA218148NIBIB NIH HHS R25 EB025787NIBIB NIH HHS R25EB025787-01NIDCR NIH HHS 1R01DE025248NIDCR NIH HHS R01 DE025248NIDCR NIH HHS R01 DE028290NIDCR NIH HHS R56 DE025248NIDCR NIH HHS R56DE025248NIH HHS UL1TR003167
6 · The paper itself

Abstract

Automated segmentation templates can save clinicians time compared to de novo segmentation but may still take substantial time to review and correct. It has not been thoroughly investigated which automated segmentation-corrected segmentation similarity metrics best predict clinician correction time. Bilateral thoracic cavity volumes in 329 CT scans were segmented by a UNet-inspired deep learning segmentation tool and subsequently corrected by a fourth-year medical student. Eight spatial similarity metrics were calculated between the automated and corrected segmentations and associated with correction times using Spearman's rank correlation coefficients. Nine clinical variables were also associated with metrics and correction times using Spearman's rank correlation coefficients or Mann-Whitney U tests. The added path length, false negative path length, and surface Dice similarity coefficient correlated better with correction time than traditional metrics, including the popular volumetric Dice similarity coefficient (respectively ρ = 0.69, ρ = 0.65, ρ =  - 0.48 versus ρ =  - 0.25; correlation p values < 0.001). Clinical variables poorly represented in the autosegmentation tool's training data were often associated with decreased accuracy but not necessarily with prolonged correction time. Metrics used to develop and evaluate autosegmentation tools should correlate with clinical time saved. To our knowledge, this is only the second investigation of which metrics correlate with time saved. Validation of our findings is indicated in other anatomic sites and clinical workflows. Novel spatial similarity metrics may be preferable to traditional metrics for developing and evaluating autosegmentation tools that are intended to save clinicians time.

Indexed as

Thoracic CavityHumansTomography, X-Ray ComputedWorkflow“AI artificial intelligence” [MeSH]“Clinical informatics” [MeSH]“Computer-assisted image analysis” [MeSH]Image segmentation“Medical imaging” [MeSH]

Identifiers

PMID34027588
PMCPMC8329111
OpenAlexW3165529692

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.