Evidence map›Paper›PMID 39355039›Full record

ArticleFrontiers in nuclear medicine2023

Comparative effectiveness of standard vs. AI-assisted PET/CT reading workflow for pre-treatment lymphoma staging: a multi-institutional reader study evaluation.

Russell Frood, Julien M Y Willaime, Brad Miles, Greg Chambers, H'ssein Al-Chalabi, Tamir Ali, Natasha Hougham, Naomi Brooks, George Petrides, Matthew Naylor and 6 more

Abstract read
In one paragraph

Article in Frontiers in nuclear medicine, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. LLM-powered prostate cancer staging from PSMA-PET/CT reports using PROMISE v2.European journal of nuclear medicine and molecular imaging · 2026
    Article
  3. Article
  4. AutoPET Challenge on Fully Automated Lesion Segmentation in Oncologic PET/CT Imaging, Part 2: Domain Generalization.Journal of nuclear medicine : official publication, Society of Nuclear Medicine · 2026
    Article
  5. Article
  6. Article
  7. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors.

Russell FroodDepartment of Radiology, Leeds Teaching Hospitals NHS Trust, Leeds, United Kingdom.
Julien M Y WillaimeMirada Medical Ltd., Oxford, United Kingdom.
Brad MilesAlliance Medical Ltd., Warwick, United Kingdom.
Greg ChambersDepartment of Radiology, Leeds Teaching Hospitals NHS Trust, Leeds, United Kingdom.
H'ssein Al-ChalabiDepartment of Radiology, Leeds Teaching Hospitals NHS Trust, Leeds, United Kingdom.
Tamir AliDepartment of Radiology, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle, United Kingdom.
Natasha HoughamDepartment of Radiology, Royal Cornwall Hospitals NHS Trust, Truro, United Kingdom.
Naomi BrooksAlliance Medical Ltd., Warwick, United Kingdom.
George PetridesDepartment of Radiology, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle, United Kingdom.
Matthew NaylorDepartment of Radiology, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle, United Kingdom.
Daniel WardDepartment of Radiology, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle, United Kingdom.
Tom SulkinDepartment of Radiology, Royal Cornwall Hospitals NHS Trust, Truro, United Kingdom.
Richard ChaytorDepartment of Radiology, Royal Cornwall Hospitals NHS Trust, Truro, United Kingdom.
Peter StrouhalAlliance Medical Ltd., Warwick, United Kingdom.
Chirag PatelDepartment of Radiology, Leeds Teaching Hospitals NHS Trust, Leeds, United Kingdom.
Andrew F ScarsbrookDepartment of Radiology, Leeds Teaching Hospitals NHS Trust, Leeds, United Kingdom.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: Fluorine-18 fluorodeoxyglucose (FDG)-positron emission tomography/computed tomography (PET/CT) is widely used for staging high-grade lymphoma, with the time to evaluate such studies varying depending on the complexity of the case. Integrating artificial intelligence (AI) within the reporting workflow has the potential to improve quality and efficiency. The aims of the present study were to evaluate the influence of an integrated research prototype segmentation tool implemented within diagnostic PET/CT reading software on the speed and quality of reporting with variable levels of experience, and to assess the effect of the AI-assisted workflow on reader confidence and whether this tool influenced reporting behaviour. Methods: Nine blinded reporters (three trainees, three junior consultants and three senior consultants) from three UK centres participated in a two-part reader study. A total of 15 lymphoma staging PET/CT scans were evaluated twice: first, using a standard PET/CT reporting workflow; then, after a 6-week gap, with AI assistance incorporating pre-segmentation of disease sites within the reading software. An even split of PET/CT segmentations with gold standard (GS), false-positive (FP) over-contour or false-negative (FN) under-contour were provided. The read duration was calculated using file logs, while the report quality was independently assessed by two radiologists with >15 years of experience. Confidence in AI assistance and identification of disease was assessed via online questionnaires for each case. Results: There was a significant decrease in time between non-AI and AI-assisted reads (median 15.0 vs. 13.3 min, Conclusions: The study findings indicate that an AI-assisted workflow achieves comparable performance to humans, demonstrating a marginal enhancement in reporting speed. Less experienced readers were more influenced by segmentation errors. An AI-assisted PET/CT reading workflow has the potential to increase reporting efficiency without adversely affecting quality, which could reduce costs and report turnaround times. These preliminary findings need to be confirmed in larger studies.

Indexed as

artificial intelligenceefficiencylymphomamulti-reader studyPET/CT

Identifiers

PMID39355039
PMCPMC11440880

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.