Evidence map›Paper›PMID 38165432›Full record

ArticleEuropean radiology2024

Manual prostate MRI segmentation by readers with different experience: a study of the learning progress.

Fredrik Langkilde, Patrick Masaba, Lars Edenbrandt, Magnus Gren, Airin Halil, Mikael Hellström, Måns Larsson, Ameer Ali Naeem, Jonas Wallström, Stephan E Maier and 1 more

Open access · hybridAbstract read
In one paragraph

Article in European radiology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
6.7field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 16 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 4 institutions in 2 countries.

Fredrik LangkildeDepartment of Radiology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden. fredrik.langkilde@gu.se.ORCID http://orcid.org/0000-0002-8706-4036
Patrick MasabaDepartment of Molecular Medicine and Surgery (MMK), Karolinska Institutet, Stockholm, Sweden.
Lars EdenbrandtDepartment of Molecular and Clinical Medicine, Institute of Medicine, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden.
Magnus GrenDepartment of Radiology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden.
Airin HalilDepartment of Radiology, Sahlgrenska University Hospital, Gothenburg, Sweden.
Mikael HellströmDepartment of Radiology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden.
Måns LarssonEigenvision AB, Malmö, Sweden.
Ameer Ali NaeemDepartment of Radiology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden.
Jonas WallströmDepartment of Radiology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden.
Stephan E MaierDepartment of Radiology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden.ORCID http://orcid.org/0000-0003-0646-3893
Fredrik JäderlingDepartment of Molecular Medicine and Surgery (MMK), Karolinska Institutet, Stockholm, Sweden.ORCID http://orcid.org/0000-0002-9042-7328
Sahlgrenska University Hospital · SEKarolinska Institutet · SEBrigham and Women's Hospital · USUniversity of Gothenburg · SE

Funding

ALF agreement (SE) ALFGBG-932648
6 · The paper itself

Abstract

objectiveTo evaluate the learning progress of less experienced readers in prostate MRI segmentation. MATERIALS AND

methodsOne hundred bi-parametric prostate MRI scans were retrospectively selected from the Göteborg Prostate Cancer Screening 2 Trial (single center). Nine readers with varying degrees of segmentation experience were involved: one expert radiologist, two experienced radiology residents, two inexperienced radiology residents, and four novices. The task was to segment the whole prostate gland. The expert's segmentations were used as reference. For all other readers except three novices, the 100 MRI scans were divided into five rounds (cases 1-10, 11-25, 26-50, 51-76, 76-100). Three novices segmented only 50 cases (three rounds). After each round, a one-on-one feedback session between the expert and the reader was held, with feedback on systematic errors and potential improvements for the next round. Dice similarity coefficient (DSC) > 0.8 was considered accurate.

resultsUsing DSC > 0.8 as the threshold, the novices had a total of 194 accurate segmentations out of 250 (77.6%). The residents had a total of 397/400 (99.2%) accurate segmentations. In round 1, the novices had 19/40 (47.5%) accurate segmentations, in round 2 41/60 (68.3%), and in round 3 84/100 (84.0%) indicating learning progress.

conclusionsRadiology residents, regardless of prior experience, showed high segmentation accuracy. Novices showed larger interindividual variation and lower segmentation accuracy than radiology residents. To prepare datasets for artificial intelligence (AI) development, employing radiology residents seems safe and provides a good balance between cost-effectiveness and segmentation accuracy. Employing novices should only be considered on an individual basis. CLINICAL RELEVANCE STATEMENT: Employing radiology residents for prostate MRI segmentation seems safe and can potentially reduce the workload of expert radiologists. Employing novices should only be considered on an individual basis. KEY POINTS: • Using less experienced readers for prostate MRI segmentation is cost-effective but may reduce quality. • Radiology residents provided high accuracy segmentations while novices showed large inter-reader variability. • To prepare datasets for AI development, employing radiology residents seems safe and might provide a good balance between cost-effectiveness and segmentation accuracy while novices should only be employed on an individual basis.

Indexed as

Clinical CompetenceMagnetic Resonance ImagingProstatic NeoplasmsAgedHumansImage Interpretation, Computer-AssistedInternship and ResidencyMaleMiddle AgedObserver VariationProstateRadiologistsRadiologyRetrospective StudiesArtificial intelligenceLearning curveMagnetic resonance imagingProstate cancer

Identifiers

PMID38165432
PMCPMC11213744
OpenAlexW4390507782

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.