Evidence map›Paper›PMID 31151901›Full record

ArticleAcademic radiology2020

Automated Identification of Optimal Portal Venous Phase Timing with Convolutional Neural Networks.

Jingchen Ma, Laurent Dercle, Philip Lichtenstein, Deling Wang, Aiping Chen, Jianguo Zhu, Hubert Piessevaux, Jun Zhao, Lawrence H Schwartz, Lin Lu and 1 more

Abstract read
In one paragraph

Article in Academic radiology, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. [Contrast agent strategies in elective oncological imaging].Radiologie (Heidelberg, Germany) · 2026
    Review
  3. A CT-based radiomics tumor quality and quantity model to predict early recurrence after radical surgery for colorectal liver metastases.Clinical & translational oncology : official publication of the Federation of Spanish Oncology Societies and of the National Cancer Institute of Mexico · 2025
    Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Review
  9. Article
  10. Review
  11. Radiomics and Deep Learning: Hepatic Applications.Korean journal of radiology · 2020
    Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Jingchen MaSchool of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China; Department of Radiology, Columbia University Medical Center, 630 West 168th Street, New York, NY 10032.
Laurent DercleDepartment of Radiology, Columbia University Medical Center, 630 West 168th Street, New York, NY 10032; Gustave Roussy, Université Paris-Saclay, Université Paris-Saclay, Département D'imagerie Médicale, Villejuif, France.
Philip LichtensteinDepartment of Radiology, Columbia University Medical Center, 630 West 168th Street, New York, NY 10032.
Deling WangDepartment of Medical Imaging, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangzhou, Guangdong, China.
Aiping ChenDepartment of Radiology, First Affiliated Hospital of NanJing Medical University, Nanjing, China.
Jianguo ZhuDepartment of Radiology, the Second Affiliated Hospital of Nanjing Medical University, Nanjing, China.
Hubert PiessevauxCliniques Universitaires Saint-Luc, Brussels, Belgium.
Jun ZhaoSchool of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China.
Lawrence H SchwartzDepartment of Radiology, Columbia University Medical Center, 630 West 168th Street, New York, NY 10032.
Lin LuDepartment of Radiology, Columbia University Medical Center, 630 West 168th Street, New York, NY 10032. Electronic address: ll2860@cumc.columbia.edu.
Binsheng ZhaoDepartment of Radiology, Columbia University Medical Center, 630 West 168th Street, New York, NY 10032.

Funding

Integrating Radiomics into S0819 and Lung-MAP, Biomarker Driven Clinical Trials for Lung CancerU01CA225431 · NCI · SLOAN-KETTERING INST CAN RESEARCH · PI SCHWARTZ, LAWRENCE H, ZHAO, BINSHENG · 2018 to 2022
$3.1M
Quantitative Volume and Density Response Assessment: Sarcoma and HCC as a ModelU01CA140207 · NCI · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI SCHWARTZ, LAWRENCE H, ZHAO, BINSHENG · 2011 to 2015
$2.8M
NCI NIH HHS U01 CA140207NCI NIH HHS U01 CA225431
6 · The paper itself

Abstract

objectivesTo develop a deep learning-based algorithm to automatically identify optimal portal venous phase timing (PVP-timing) so that image analysis techniques can be accurately performed on post contrast studies.

methods681 CT-scans (training: 479 CT-scans; validation: 202 CT-scans) from a multicenter clinical trial in patients with liver metastases from colorectal cancer were retrospectively analyzed for algorithm development and validation. An additional external validation was performed on a cohort of 228 CT-scans from gastroenteropancreatic neuroendocrine cancer patients. Image acquisition was performed according to each centers' standard CT protocol for single portal venous phase, portal venous acquisition. The reference gold standard for the classification of PVP-timing as either optimal or nonoptimal was based on experienced radiologists' consensus opinion. The algorithm performed automated localization (on axial slices) of the portal vein and aorta upon which a novel dual input Convolutional Neural Network calculated a probability of the optimal PVP-timing.

resultsThe algorithm automatically computed a PVP-timing score in 3 seconds and reached area under the curve of 0.837 (95% CI: 0.765, 0.890) in validation set and 0.844 (95% CI: 0.786, 0.889) in external validation set.

conclusionA fully automated, deep-learning derived PVP-timing algorithm was developed to classify scans' contrast-enhancement timing and identify scans with optimal PVP-timing. The rapid identification of such scans will aid in the analysis of quantitative (radiomics) features used to characterize tumors and changes in enhancement with treatment in a multitude of settings including quantitative response criteria such as Choi and MASS which rely on reproducible measurement of enhancement.

Indexed as

AlgorithmsDeep LearningLiver NeoplasmsPortal VeinClinical Trials as TopicContrast MediaHumansNeural Networks, ComputerRetrospective StudiesContrast MediaAbdominalArtificial intelligenceQuality controlRadiographyTomographyX-ray computed

Identifiers

PMID31151901
PMCPMC9109713

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.