Evidence map›Paper›PMID 39565453›Full record

ArticleEuropean radiology experimental2024

An AI deep learning algorithm for detecting pulmonary nodules on ultra-low-dose CT in an emergency setting: a reader study.

Inge A H van den Berk, Colin Jacobs, Maadrika M N P Kanglie, Onno M Mets, Miranda Snoeren, Alexander D Montauban van Swijndregt, Elisabeth M Taal, Tjitske S R van Engelen, Jan M Prins, Shandra Bipat and 3 more

Abstract read
In one paragraph

Article in European radiology experimental, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Review
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Inge A H van den BerkDepartment of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands. i.a.vandenberk@amsterdamumc.nl.ORCID http://orcid.org/0000-0001-8724-6502
Colin JacobsDepartment of Medical Imaging, Radboud University Medical Center, Nijmegen, The Netherlands.
Maadrika M N P KanglieDepartment of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
Onno M MetsDepartment of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
Miranda SnoerenDepartment of Medical Imaging, Radboud University Medical Center, Nijmegen, The Netherlands.
Alexander D Montauban van SwijndregtDepartment of Radiology and Nuclear Medicine, OLVG, Amsterdam, The Netherlands.
Elisabeth M TaalDepartment of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
Tjitske S R van EngelenDivision of Infectious Diseases, Department of Internal Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
Jan M PrinsDivision of Infectious Diseases, Department of Internal Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
Shandra BipatDepartment of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
Patrick M M BossuytDepartment of Epidemiology & Data Science, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
Jaap StokerDepartment of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
OPTIMACT study group

Funding

ZonMw 843001806
6 · The paper itself

Abstract

backgroundTo retrospectively assess the added value of an artificial intelligence (AI) algorithm for detecting pulmonary nodules on ultra-low-dose computed tomography (ULDCT) performed at the emergency department (ED).

methodsIn the OPTIMACT trial, 870 patients with suspected nontraumatic pulmonary disease underwent ULDCT. The ED radiologist prospectively read the examinations and reported incidental pulmonary nodules requiring follow-up. All ULDCTs were processed post hoc using an AI deep learning software marking pulmonary nodules ≥ 6 mm. Three chest radiologists independently reviewed the subset of ULDCTs with either prospectively detected incidental nodules in 35/870 patients or AI marks in 458/870 patients; findings scored as nodules by at least two chest radiologists were used as true positive reference standard. Proportions of true and false positives were compared.

resultsDuring the OPTIMACT study, 59 incidental pulmonary nodules requiring follow-up were prospectively reported. In the current analysis, 18/59 (30.5%) nodules were scored as true positive while 104/1,862 (5.6%) AI marks in 84/870 patients (9.7%) were scored as true positive. Overall, 5.8 times more (104 versus 18) true positive pulmonary nodules were detected with the use of AI, at the expense of 42.9 times more (1,758 versus 41) false positives. There was a median number of 1 (IQR: 0-2) AI mark per ULDCT.

conclusionThe use of AI on ULDCT in patients suspected of pulmonary disease in an emergency setting results in the detection of many more incidental pulmonary nodules requiring follow-up (5.8×) with a high trade-off in terms of false positives (42.9×). RELEVANCE STATEMENT: AI aids in the detection of incidental pulmonary nodules that require follow-up at chest-CT, aiding early pulmonary cancer detection but also results in an increase of false positive results that are mainly clustered in patients with major abnormalities.

trial registrationThe OPTIMACT trial was registered on 6 December 2016 in the National Trial Register (number NTR6163) (onderzoekmetmensen.nl). KEY POINTS: An AI deep learning algorithm was tested on 870 ULDCT examinations acquired in the ED. AI detected 5.8 times more pulmonary nodules requiring follow-up (true positives). AI resulted in the detection of 42.9 times more false positive results, clustered in patients with major abnormalities. AI in the ED setting may aid in early pulmonary cancer detection with a high trade-off in terms of false positives.

Indexed as

Deep LearningEmergency Service, HospitalMultiple Pulmonary NodulesTomography, X-Ray ComputedAgedAlgorithmsArtificial IntelligenceFemaleHumansLung NeoplasmsMaleMiddle AgedProspective StudiesRadiation DosageRetrospective StudiesSolitary Pulmonary NoduleArtificial intelligenceEmergency service (hospital)Multiple pulmonary nodulesSolitary pulmonary nodulesTomography (x-ray computed)

Identifiers

PMID39565453
PMCPMC11579269

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.