Multi-modal analysis for accurate prediction of preoperative stage and indications of optimal treatment in gastric cancer.

backgroundAccurate preoperative clinical staging of gastric cancer helps determine therapeutic strategies. However, no multi-category grading models for gastric cancer have been established. This study aimed to develop multi-modal (CT/EHRs) artificial intelligence (AI) models for predicting tumor stages and optimal treatment indication based on preoperative CT images and electronic health records (EHRs) in patients with gastric cancer.

methodsThis retrospective study enrolled 602 patients with a pathological diagnosis of gastric cancer from Nanfang hospital retrospectively and divided them into training (n = 452) and validation sets (n = 150). A total of 1326 features were extracted of which 1316 radiomic features were extracted from the 3D CT images and 10 clinical parameters were obtained from electronic health records (EHRs). Four multi-layer perceptrons (MLPs) whose input was the combination of radiomic features and clinical parameters were automatically learned with the neural architecture search (NAS) strategy.

resultsTwo two-layer MLPs identified by NAS approach were employed to predict the stage of the tumor showed greater discrimination with the average ACC value of 0.646 for five T stages, 0.838 for four N stages than traditional methods with ACC of 0.543 (P value = 0.034) and 0.468 (P value = 0.021), respectively. Furthermore, our models reported high prediction accuracy for the indication of endoscopic resection and the preoperative neoadjuvant chemotherapy with the AUC value of 0.771 and 0.661, respectively.

conclusionsOur multi-modal (CT/EHRs) artificial intelligence models generated with the NAS approach have high accuracy for tumor stage prediction and optimal treatment regimen and timing, which could facilitate radiologists and gastroenterologists to improve diagnosis and treatment efficiency.