Comparison of Artificial Intelligence Detection and Short-Term Breast Cancer Risk Models within and beyond Their Intended Use in Mammography Screening.

Purpose To compare artificial intelligence-based breast cancer detection and short-term breast cancer risk prediction models in their intended and nonintended settings over a single mammography screening round. Materials and Methods In this retrospective study, the Cohort of Screen-Age Women-Case Control dataset from Sweden (May 2008-December 2016; Hologic) was used, including patients with screen-detected and interval cancers, with interval cancers defined as a diagnosis more than 60 days after screening. Two examination-based settings were evaluated: detection (screening examinations) and short-term risk (screen-negative examinations). Mirai Risk, RSNA Detection (2023 challenge winner), Transpara Detection, and Transpara Risk models were assessed in both intended and nonintended settings. Discriminative performance was evaluated using the area under the receiver operating characteristic curve (AUC), and then clinically relevant sensitivity and specificity thresholds were compared. Results A total of 20 187 examinations (7430 women) were included, with 741 examinations leading to diagnosis within 2 years (524 screen-detected and 217 interval cancers) and 19 446 examinations without cancer. Transpara Detection and Transpara Risk achieved similar performance for detection (AUC for each, 0.92; 95% CI: 0.91, 0.93;