Evidence map›Paper›PMID 40790928›Full record

ArticleMedical physics2025

Defining ground truth for prostate segmentation of transrectal ultrasound images: Inter- and intra-observer variability of manual versus semi-automatic methods.

Louis Lenfant, Clément Beitone, Jocelyne Troccaz, Gaelle Fiard, Bernard Malavaud, Sandrine Voros, Pierre C Mozer

Abstract readComparative Study
In one paragraph

Article in Medical physics, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Louis LenfantPredictive Onco-Urology, GRC n°5, Sorbonne Université, AP-HP, Hôpital Pitié-Salpêtrière, Urology, Paris, France.
Clément BeitoneUniversité Grenoble Alpes, CNRS, INSERM, Grenoble INP, TIMC, Grenoble, France.
Jocelyne TroccazUniversité Grenoble Alpes, CNRS, INSERM, Grenoble INP, TIMC, Grenoble, France.
Gaelle FiardDepartment of Urology, Université Grenoble Alpes, CNRS, CHU Grenoble Alpes, Grenoble INP, TIMC, Grenoble, France.
Bernard MalavaudDepartment of Urology, Institut Universitaire du Cancer Toulouse-Oncopôle, Toulouse, France.
Sandrine VorosUniversité Grenoble Alpes, CNRS, INSERM, Grenoble INP, TIMC, Grenoble, France.
Pierre C MozerPredictive Onco-Urology, GRC n°5, Sorbonne Université, AP-HP, Hôpital Pitié-Salpêtrière, Urology, Paris, France.

Funding

French Public Bank of InvestmentsKoelisVermon
6 · The paper itself

Abstract

backgroundAccurate prostate segmentation in transrectal ultrasound (TRUS) imaging is essential for diagnosis, treatment planning, and developing artificial intelligence (AI) algorithms. Although manual segmentation is often recommended as the ground truth for AI training, it is time-consuming, prone to inter- and intra-observer variability, and rarely used in everyday clinical practice. Semi-automatic methods provide a faster alternative but lack thorough multi-operator evaluations. Understanding variability in segmentation methods is crucial to defining a reliable reference standard for future AI training. PURPOSE: To investigate the inter-individual variability in manual and semi-automatic prostate contour segmentation on 3D TRUS images and to compare both approaches to determine the most consistent method that could serve as a reference standard for future AI model development.

methodsThis study is a methodological investigation and not an AI study. Four urology experts independently performed manual and semi-automatic segmentation on 100 prostate 3D TRUS exams obtained from patients undergoing fusion prostate biopsy. Inter-individual and intra-individual variability for manual segmentation was assessed using the Average Surface Distance (ASD) between manually placed points and a reference mesh. Two methods were used to create the reference prostate mesh after manual point positioning: a statistical shape model (manual_SSM) and a deformable model (manual_soft-SSM). Semi-automatic segmentations were evaluated using ASD, Dice similarity coefficient, and Hausdorff distance. A Simultaneous Truth and Performance Level Estimation (STAPLE) like consensus method was applied to assess variability across experts in semi-automatic segmentation. Statistical comparisons used Wilcoxon tests, and effect sizes were calculated using Cohen's d. Bonferroni correction was applied for multiple comparisons. A significance level of p < 0.05 (adjusted as needed) was used.

resultsManual segmentation inter-individual variability was higher with the manual_SSM method [ASD = 2.6 mm (Inter Quartile Range (IQR) 2.3-3.0)] compared to the manual_soft-SSM [ASD = 1.5 mm (IQR 1.2-1.8), P < 0.001]. Intra-individual variability also showed lower ASD values with manual_soft-SSM compared to manual_SSM, [(1.0 (0.8-1.1) versus 2.2 (1.9-2.6), p < 0.001], respectively. For semi-automatic segmentation, inter-individual variability yielded an ASD of 1.4 mm (IQR 1.1-1.9), Dice of 0.90 (IQR 0.88-0.92), and Hausdorff distance of 5.7 mm (IQR 4.47-7.36). Manual and semi-automatic segmentation comparisons demonstrated an ASD of 1.43 mm (IQR 1.20-1.90).

conclusionsThe semi-automatic segmentation method evaluated in this study demonstrated comparable accuracy to manual segmentation while reducing inter- and intra-individual variability. These findings suggest that the tested semi-automatic approach can serve as a reliable reference standard for AI training in prostate segmentation.

Indexed as

Image Processing, Computer-AssistedProstateRectumAutomationHumansImaging, Three-DimensionalMaleObserver VariationProstatic NeoplasmsUltrasonographyalgorithms*artificial intelligenceimage‐guided biopsy*image interpretation, computer‐assisted/*methodsimaging, three‐dimensional*/methodsimaging, three‐dimensional/*methodspattern recognition, automated/*methodsprostatic neoplasms*/diagnostic imagingreproducibility of results

Identifiers

PMID40790928
PMCPMC12340470

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.