Readability and Quality of Chatbot Responses to Periodontal Patient Queries: A Cross-Sectional Evaluation of Three Publicly Accessible Large Language Models.

Objective: The increasing use of large language models (LLMs) as sources of health information raises concerns regarding the quality and readability of patient-directed content. This study aimed to evaluate and compare the readability and quality of responses generated by three publicly accessible LLMs, ChatGPT-4o, Google Gemini 2.0 Flash, and DeepSeek-R1, to frequently asked patient questions related to periodontology. Materials and Methods: In this cross-sectional study, 48 real-world periodontal questions were retrieved from Reddit and Quora and entered verbatim into each chatbot (February 2025, default settings). Readability was assessed using Flesch Reading Ease (FRE) and Flesch-Kincaid Grade Level (FKGL). Quality and accuracy were evaluated using the Quality Analysis of Medical Artificial Intelligence (QAMAI) tool by three independent expert periodontists. Mean scores were compared using one-way ANOVA with Tukey post-hoc tests ( Results: FKGL differed significantly among models ( Conclusions: All evaluated LLMs produced responses with mean QAMAI scores at the lower end of the predefined good-quality range; however, their readability exceeded recommended standards for public health materials. While LLMs may serve as supplementary educational tools, language simplification strategies and continued professional oversight remain essential to ensure safe and accessible patient information.