Evidence map›Paper›PMID 32939632›Full record

ArticleAbdominal radiology (New York)2020

Development of a volumetric pancreas segmentation CT dataset for AI applications through trained technologists: a study during the COVID 19 containment phase.

Garima Suman, Ananya Panda, Panagiotis Korfiatis, Marie E Edwards, Sushil Garg, Daniel J Blezek, Suresh T Chari, Ajit H Goenka

Open access · bronzeAbstract read
In one paragraph

Article in Abdominal radiology (New York), 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed, 1 pooled it
1.8field-weighted citation impact, top 12% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed, 1 synthesis or guideline pooled it, 21 citations in OpenAlex.

  1. Pooled it
  2. Bounding box-based 3D AI model for user-guided volumetric segmentation of pancreatic ductal adenocarcinoma on standard-of-care CTs.Pancreatology : official journal of the International Association of Pancreatology (IAP) ... [et al.] · 2023
    Trial
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Review
  12. Article
  13. Review
  14. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 2 institutions in 1 country.

Garima SumanDepartment of Radiology, Mayo Clinic, 200 First Street SW, Rochester, MN, 55905, USA.
Ananya PandaDepartment of Radiology, Mayo Clinic, 200 First Street SW, Rochester, MN, 55905, USA.
Panagiotis KorfiatisDepartment of Radiology, Mayo Clinic, 200 First Street SW, Rochester, MN, 55905, USA.
Marie E EdwardsDepartment of Radiology, Mayo Clinic, 200 First Street SW, Rochester, MN, 55905, USA.
Sushil GargDepartment of Gastroenterology and Hepatology, Mayo Clinic, 200 First Street SW, Rochester, MN, 55905, USA.
Daniel J BlezekDepartment of Radiology, Mayo Clinic, 200 First Street SW, Rochester, MN, 55905, USA.
Suresh T ChariDepartment of Gastroenterology, Hepatology and Nutrition, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd, Houston, TX, 77030, USA.
Ajit H GoenkaDepartment of Radiology, Mayo Clinic, 200 First Street SW, Rochester, MN, 55905, USA. goenka.ajit@mayo.edu.ORCID http://orcid.org/0000-0002-7804-2695
Mayo Clinic · USThe University of Texas MD Anderson Cancer Center · US

Funding

Funk-Zitiello Foundation 2020 Champions for Hope Pancreatic Cancer Award
6 · The paper itself

Abstract

purposeTo evaluate the performance of trained technologists vis-à-vis radiologists for volumetric pancreas segmentation and to assess the impact of supplementary training on their performance.

methodsIn this IRB-approved study, 22 technologists were trained in pancreas segmentation on portal venous phase CT through radiologist-led interactive videoconferencing sessions based on an image-rich curriculum. Technologists segmented pancreas in 188 CTs using freehand tools on custom image-viewing software. Subsequent supplementary training included multimedia videos focused on common errors, which were followed by second batch of 159 segmentations. Two radiologists reviewed all cases and corrected inaccurate segmentations. Technologists' segmentations were compared against radiologists' segmentations using Dice-Sorenson coefficient (DSC), Jaccard coefficient (JC), and Bland-Altman analysis.

resultsCorrections were made in 71 (38%) cases from first batch [26 (37%) oversegmentations and 45 (63%) undersegmentations] and in 77 (48%) cases from second batch [12 (16%) oversegmentations and 65 (84%) undersegmentations]. DSC, JC, false positive (FP), and false negative (FN) [mean (SD)] in first versus second batches were 0.63 (0.15) versus 0.63 (0.16), 0.48 (0.15) versus 0.48 (0.15), 0.29 (0.21) versus 0.21 (0.10), and 0.36 (0.20) versus 0.43 (0.19), respectively. Differences were not significant (p > 0.05). However, range of mean pancreatic volume difference reduced in the second batch [- 2.74 cc (min - 92.96 cc, max 87.47 cc) versus - 23.57 cc (min - 77.32, max 30.19)].

conclusionTrained technologists could perform volumetric pancreas segmentation with reasonable accuracy despite its complexity. Supplementary training further reduced range of volume difference in segmentations. Investment into training technologists could augment and accelerate development of body imaging datasets for AI applications.

Indexed as

Artificial IntelligenceClinical CompetenceCOVID-19Datasets as TopicHumansImage Processing, Computer-AssistedPancreasRadiologyReproducibility of ResultsRetrospective StudiesTomography, X-Ray ComputedArtificial intelligenceCOVID-19Data curationDeep learning

Identifiers

PMID32939632
PMCPMC7493700
OpenAlexW3086822727

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.