Evidence map›Paper›PMID 37769221›Full record

ArticleJCO global oncology2023

Natural Language Processing for the Identification of Incidental Lung Nodules in Computed Tomography Reports: A Quality Control Tool.

Rodrigo Basilio, Alysson Roncally Carvalho, Rosana Rodrigues, Marco Conrado, Sephania Accorsi, Reza Forghani, Tiago Machuca, Matheus Zanon, Stephan Altmayer, Bruno Hochhegger

Erratum issuedOpen access · goldAbstract read
In one paragraph

Article in JCO global oncology, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 3 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed, 1 pooled it
0.8field-weighted citation impact, top 24% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 1 synthesis or guideline pooled it, 3 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

10 authors at 4 institutions in 2 countries.

Rodrigo BasilioD'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil.ORCID 0000-0003-0041-8004
Alysson Roncally CarvalhoD'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil.
Rosana RodriguesD'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil.ORCID 0000-0002-9952-3834
Marco ConradoD'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil.
Sephania AccorsiD'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil.ORCID 0000-0002-3454-6963
Reza ForghaniRadiomics and Augmented Intelligence Laboratory (RAIL), University of Florida, Gainesville, FL.ORCID 0000-0002-8572-1864
Tiago MachucaD'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil.ORCID 0000-0002-0748-7590
Matheus ZanonFederal University of Health Sciences of Porto Alegre, Porto Alegre, Brazil.ORCID 0000-0001-7851-5125
Stephan AltmayerStanford Hospital, Stanford University Medical Center, Palo Alto, CA.ORCID 0000-0001-9214-1916
Bruno HochheggerRadiomics and Augmented Intelligence Laboratory (RAIL), University of Florida, Gainesville, FL.ORCID 0000-0003-1984-4636
D’Or Institute for Research and Education · BRUniversidade Federal de Ciências da Saúde de Porto Alegre · BRStanford Medicine · USUniversity of Florida · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeTo evaluate the diagnostic performance of a natural language processing (NLP) model in detecting incidental lung nodules (ILNs) in unstructured chest computed tomography (CT) reports.

methodsAll unstructured consecutive reports of chest CT scans performed at a tertiary hospital between 2020 and 2021 were retrospectively reviewed (n = 21,542) to train the NLP tool. Internal validation was performed using reference readings by two radiologists of both CT scans and reports, using a different external cohort of 300 chest CT scans. Second, external validation was performed in a cohort of all random unstructured chest CT reports from 57 different hospitals conducted in May 2022. A review by the same thoracic radiologists was used as the gold standard. The sensitivity, specificity, and accuracy were calculated.

resultsOf 21,542 CT reports, 484 mentioned at least one ILN (mean age, 71 ± 17.6 [standard deviation] years; women, 52%) and were included in the training set. In the internal validation (n = 300), the NLP tool detected ILN with a sensitivity of 100.0% (95% CI, 97.6 to 100.0), a specificity of 95.9% (95% CI, 91.3 to 98.5), and an accuracy of 98.0% (95% CI, 95.7 to 99.3). In the external validation (n = 977), the NLP tool yielded a sensitivity of 98.4% (95% CI, 94.5 to 99.8), a specificity of 98.6% (95% CI, 97.5 to 99.3), and an accuracy of 98.6% (95% CI, 97.6 to 99.2). Twelve months after the initial reports, 8 (8.60%) patients had a final diagnosis of lung cancer, among which 2 (2.15%) would have been lost to follow-up without the NLP tool.

conclusionNLP can be used to identify ILNs in unstructured reports with high accuracy, allowing a timely recall of patients and a potential diagnosis of early-stage lung cancer that might have been lost to follow-up.

Indexed as

Lung NeoplasmsNatural Language ProcessingAgedAged, 80 and overFemaleHumansLungMiddle AgedRetrospective StudiesTomography, X-Ray Computed

Identifiers

PMID37769221
PMCPMC10581645
OpenAlexW4387142634

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.