Evidence map›Paper›PMID 40410643›Full record

ArticleInsights into imaging2025

Evaluation of a deep-learning segmentation model for patients with colorectal cancer liver metastases (COALA) in the radiological workflow.

Michiel Zeeuw, Jacqueline Bereska, Marius Strampel, Luuk Wagenaar, Boris Janssen, Henk Marquering, Ruby Kemna, Jan Hein van Waesberghe, Janneke van den Bergh, Irene Nota and 13 more

Abstract read
In one paragraph

Article in Insights into imaging, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

23 authors.

Michiel Zeeuw *Department of Surgery, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands. j.m.zeeuw@amsterdamumc.nl.ORCID http://orcid.org/0000-0001-7918-5404
Jacqueline Bereska *Department of Biomedical Engineering and Physics, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
Marius StrampelDepartment of Biomedical Engineering and Physics, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
Luuk WagenaarDepartment of Biomedical Engineering and Physics, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
Boris JanssenDepartment of Surgery, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
Henk MarqueringCancer Center Amsterdam, Amsterdam, The Netherlands.
Ruby KemnaDepartment of Surgery, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
Jan Hein van WaesbergheCancer Center Amsterdam, Amsterdam, The Netherlands.
Janneke van den BerghCancer Center Amsterdam, Amsterdam, The Netherlands.
Irene NotaCancer Center Amsterdam, Amsterdam, The Netherlands.
Shira MoosCancer Center Amsterdam, Amsterdam, The Netherlands.
Yung NioCancer Center Amsterdam, Amsterdam, The Netherlands.
Marnix KopCancer Center Amsterdam, Amsterdam, The Netherlands.
Jakob KistCancer Center Amsterdam, Amsterdam, The Netherlands.
Femke StruikCancer Center Amsterdam, Amsterdam, The Netherlands.
Nina WesdorpDepartment of Surgery, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
Jules NelissenDepartment of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
Katinka RusDepartment of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
Alexandra de SitterDepartment of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
Jaap StokerCancer Center Amsterdam, Amsterdam, The Netherlands.
Joost HuiskensDepartment of Surgery, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
Inez VerpalenCancer Center Amsterdam, Amsterdam, The Netherlands.
Geert KazemierDepartment of Surgery, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.

Funding

KWF Kankerbestrijding 14002/2021-2
6 · The paper itself

Abstract

objectivesFor patients with colorectal liver metastases (CRLM), total tumor volume (TTV) is prognostic. A deep-learning segmentation model for CRLM to assess TTV called COlorectal cAncer Liver metastases Assessment (COALA) has been developed. This study evaluated COALA's performance and practical utility in the radiological picture archiving and communication system (PACS). A secondary aim was to provide lessons for future researchers on the implementation of artificial intelligence (AI) models.

methodsPatients discussed between January and December 2023 in a multidisciplinary meeting for CRLM were included. In those patients, CRLM was automatically segmented in portal-venous phase CT scans by COALA and integrated with PACS. Eight expert abdominal radiologists completed a questionnaire addressing segmentation accuracy and PACS integration. They were also asked to write down general remarks.

resultsIn total, 57 patients were evaluated. Of those patients, 112 contrast-enhanced portal-venous phase CT scans were analyzed. Of eight radiologists, six (75%) evaluated the model as user-friendly in their radiological workflow. Areas of improvement of the COALA model were the segmentation of small lesions, heterogeneous lesions, and lesions at the border of the liver with involvement of the diaphragm or heart. Key lessons for implementation were a multidisciplinary approach, a robust method prior to model development and organizing evaluation sessions with end-users early in the development phase.

conclusionThis study demonstrates that the deep-learning segmentation model for patients with CRLM (COALA) is user-friendly in the radiologist's PACS. Future researchers striving for implementation should have a multidisciplinary approach, propose a robust methodology and involve end-users prior to model development. CRITICAL RELEVANCE STATEMENT: Many segmentation models are being developed, but none of those models are evaluated in the (radiological) workflow or clinically implemented. Our model is implemented in the radiological work system, providing valuable lessons for researchers to achieve clinical implementation. KEY POINTS: Developed segmentation models should be implemented in the radiological workflow. Our implemented segmentation model provides valuable lessons for future researchers. If implemented in clinical practice, our model could allow for objective radiological evaluation.

Indexed as

Artificial intelligenceColorectal neoplasmsComputed tomographyLiverWorkflow

Identifiers

PMID40410643
PMCPMC12102431

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.