Comparison of three commercial AI tools for detection and malignancy assessment of incidental lung nodules.

Objectives: Incidental pulmonary nodules are common on computed tomography (CT), and management typically relies on size and volume. Artificial intelligence (AI)-based tools show promise in nodule detection and risk assessment, but their clinical utility remains uncertain. This study aimed to evaluate the accuracy of AI-based software in detecting and predicting the malignancy of incidental pulmonary nodules. Materials and methods: This retrospective study included patients selected from a cohort of 1,138 individuals who underwent chest CT between 2015 and 2024 and met the inclusion criteria. Patients were classified into benign and malignant groups. Malignancy was determined by histopathology or by at least 2 years of follow-up. Nodule location, size, and type were assessed using by both using radiology reports and AI tools. Three commercial tools (AI-I, AI-II, and AI-III) were assessed for nodule detection and malignancy risk prediction. Agreement was assessed using Cohen's kappa and the intraclass correlation coefficient (ICC), and diagnostic performance was evaluated using receiver operating characteristic analysis. Results: Chest CT scans of 374 patients (mean age 66 ± 9 yr.; range 37-88 yr.; 231 males) with at least one solid or part-solid nodule were evaluated. AI-I and AI-II demonstrated excellent agreement with radiology reports for nodule localization ( Conclusion: AI-based tools demonstrated high accuracy for incidental pulmonary detection; however, their performance in malignancy risk stratification differed substantially.