Evidence map›Paper›PMID 38764066›Full record

ArticleEuropean radiology experimental2024

Effect of emphysema on AI software and human reader performance in lung nodule detection from low-dose chest CT.

Nikos Sourlos, GertJan Pelgrim, Hendrik Joost Wisselink, Xiaofei Yang, Gonda de Jonge, Mieneke Rook, Mathias Prokop, Grigory Sidorenkov, Marcel van Tuinen, Rozemarijn Vliegenthart and 1 more

Erratum issuedAbstract read
In one paragraph

Article in European radiology experimental, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

11 authors.

Nikos SourlosDepartment of Radiology, University Medical Center of Groningen, Groningen, 9713GZ, The Netherlands.
GertJan PelgrimDepartment of Radiology, University Medical Center of Groningen, Groningen, 9713GZ, The Netherlands.
Hendrik Joost WisselinkDepartment of Radiology, University Medical Center of Groningen, Groningen, 9713GZ, The Netherlands.
Xiaofei YangDepartment of Epidemiology, University Medical Center Groningen, Groningen, 9713GZ, The Netherlands.
Gonda de JongeDepartment of Radiology, University Medical Center of Groningen, Groningen, 9713GZ, The Netherlands.
Mieneke RookDepartment of Radiology, Martini Hospital, Groningen, 9728NT, The Netherlands.
Mathias ProkopDepartment of Radiology, University Medical Center of Groningen, Groningen, 9713GZ, The Netherlands.
Grigory SidorenkovDepartment of Radiology, University Medical Center of Groningen, Groningen, 9713GZ, The Netherlands.
Marcel van TuinenDepartment of Radiology, University Medical Center of Groningen, Groningen, 9713GZ, The Netherlands.
Rozemarijn VliegenthartDepartment of Radiology, University Medical Center of Groningen, Groningen, 9713GZ, The Netherlands.
Peter M A van OoijenDataScience Center in Health (DASH), University Medical Center Groningen, Groningen, 9713GZ, The Netherlands. p.m.a.van.ooijen@umcg.nl.ORCID http://orcid.org/0000-0002-8995-1210

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundEmphysema influences the appearance of lung tissue in computed tomography (CT). We evaluated whether this affects lung nodule detection by artificial intelligence (AI) and human readers (HR).

methodsIndividuals were selected from the "Lifelines" cohort who had undergone low-dose chest CT. Nodules in individuals without emphysema were matched to similar-sized nodules in individuals with at least moderate emphysema. AI results for nodular findings of 30-100 mm

resultsThirty-nine participants with and 82 without emphysema were included (n = 121, aged 61 ± 8 years (mean ± standard deviation), 58/121 males (47.9%)). AI and HR detected 196 and 206 nodular findings, respectively, yielding 109 concordant nodules and 184 discrepancies, including 118 true nodules. For AI, sensitivity was 0.68 (95% confidence interval 0.57-0.77) in emphysema versus 0.71 (0.62-0.78) in non-emphysema, with FPs/scan 0.51 and 0.22, respectively (p = 0.028). For HR, sensitivity was 0.76 (0.65-0.84) and 0.80 (0.72-0.86), with FPs/scan of 0.15 and 0.27 (p = 0.230). Overall sensitivity was slightly higher for HR than for AI, but this difference disappeared after the exclusion of benign lymph nodes. FPs/scan were higher for AI in emphysema than in non-emphysema (p = 0.028), while FPs/scan for HR were higher than AI for 30-100 mm

conclusionsAI resulted in more FPs/scan in emphysema compared to non-emphysema, a difference not observed for HR. RELEVANCE STATEMENT: In the creation of a benchmark dataset to validate AI software for lung nodule detection, the inclusion of emphysema cases is important due to the additional number of FPs. KEY POINTS: • The sensitivity of nodule detection by AI was similar in emphysema and non-emphysema. • AI had more FPs/scan in emphysema compared to non-emphysema. • Sensitivity and FPs/scan by the human reader were comparable for emphysema and non-emphysema. • Emphysema and non-emphysema representation in benchmark dataset is important for validating AI.

Indexed as

Artificial IntelligencePulmonary EmphysemaTomography, X-Ray ComputedAgedFemaleHumansLung NeoplasmsMaleMiddle AgedRadiation DosageRadiographic Image Interpretation, Computer-AssistedSensitivity and SpecificitySoftwareSolitary Pulmonary NoduleArtificial intelligenceEmphysemaMultiple pulmonary nodulesSoftware validationTomography (x-ray computed)

Identifiers

PMID38764066
PMCPMC11102890

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.