Impact of CT dose on AI performance: A comparison of radiomics, deep, and foundation models in a multicentric anthropomorphic phantom study.

backgroundComputed tomography (CT) is widely used in clinical practice due to its ability to provide detailed anatomical information. However, variations in radiation dose can affect image quality, potentially compromising the performance and reliability of artificial intelligence (AI) models applied to these images. PURPOSE: To evaluate the robustness of radiomics-based and deep learning-based models to variations in CT dose levels using a standardized dataset obtained from a 3D-printed anthropomorphic phantom simulating liver tissue with anomalies, as well as in the publicly available dataset CT-ORG with real patient data for organ classification. This study is in an early experimental stage, tested only on retrospective data.

methodsA total of 1378 image series from 649 scans were acquired across 13 scanners from four manufacturers at five dose levels. Features were extracted from six regions of interest (ROIs), representing four liver tissue types (normal, cyst, hemangioma, metastasis), using four methods: PyRadiomics, a shallow convolutional neural network (CNN), SwinUNETR, and a CT foundation model (CT-FM). Feature stability was assessed using the Intraclass Correlation Coefficient (ICC), while Uniform Manifold Approximation and Projection (UMAP) was employed to evaluate tissue types separability and the influence of scanner variations. Generalizability was tested by training liver tissue classifiers on one dose level and testing on others, alongside a dose classification task (10-fold cross-validation) to determine the sensitivity of each method to dose variations. In addition, we compared the four methods in addressing the task of organ classification (10-fold cross-validation) with the CT-ORG dataset containing 140 CT scans acquired with varying dose levels.

resultsRadiomic features showed limited robustness to dose variations, leading to reduced performance in liver tissue classification and the lowest ICC among methods (ICC: 0.8355

conclusionsThe study highlights the limited robustness of traditional radiomics and deep models to CT dose variation and underscores the potential of foundation models like CT-FM to enable robust clinical applications by mitigating dose-related variability. This enhanced performance is likely due to the model's pretraining on large and diverse datasets, allowing it to learn robust and generalizable representations across varying acquisition conditions.