Development and technical validation of an artificial intelligence model for quantitative analysis of histopathologic features of eosinophilic esophagitis.

Background: In an attempt to provide quantitative, reproducible, and standardized analyses in cases of eosinophilic esophagitis (EoE), we have developed an artificial intelligence (AI) digital pathology model for the evaluation of histologic features in the EoE/esophageal eosinophilia spectrum. Here, we describe the development and technical validation of this novel AI tool. Methods: A total of 10 726 objects and 56.2 mm Results: The performance of the AI model for all cell type features was similar/non-inferior to that of our group of GI pathologists (F1-scores: 94.5-94.8 for AI vs human and 92.6-96.0 for human vs human). Segmentation area features were rated for accuracy using the following scale: 1. "perfect or nearly perfect" (95%-100%, no significant errors), 2. "very good" (80%-95%, only minor errors), 3. "good" (70%-80%, significant errors but still captures the feature well), 4. "insufficient" (less than 70%, significant errors compromising feature recognition). Rating scores for tissue (1.01), spongiosis (1.15), basal layer (1.05), surface layer (1.04), lamina propria (1.15), and collagen (1.11) were in the "very good" to "perfect or nearly perfect" range, while degranulation (2.23) was rated between "good" and "very good". Conclusion: Our newly developed AI-based tool showed an excellent performance (non-inferior to a group of experienced GI pathologists) for the recognition of various histologic features in the EoE/esophageal mucosal eosinophilia spectrum. This tool represents an important step in creating an accurate and reproducible method for semi-automated quantitative analysis to be used in the evaluation of esophageal biopsies in this clinical context.