ArticleBMC oral health2025
Evaluating the performance of AI chatbots in responding to dental implant FAQs: A comparative study.
Article in BMC oral health, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
13 citing papers in PubMed.
- Bloom's taxonomy-based comparison of artificial intelligence and dental students in restorative dentistry.BMC medical education · 2026Article
- Article
- Applications, Challenges, and Future Directions of Large Language Models in Health Care Communication: Scoping Review.Journal of medical Internet research · 2026Article
- Large language models in implant dentistry: a scoping review of applications, performance, and limitations.BMC oral health · 2026Article
- Informed Consent in AI-Augmented Dentistry and Dental Research: A Scoping Review.Dentistry journal · 2026Review
- Evaluation of Arabic-Language AI Chatbot Responses to Migraine-Related Questions: A Comparative Cross-Sectional Study.Journal of clinical medicine · 2026Article
- Evaluating large language models for orthodontic consultation in patients with periodontitis: a study of reliability, quality, and readability.BMC oral health · 2026Article
- Performance of ChatGPT in dental implant treatment planning: evaluation using the modified DISCERN, Global Quality Score, and accuracy-safety score.BMC oral health · 2026Article
- Evaluating the efficacy and readability of advanced large language models in responding to patients' frequently asked questions about chronic rhinosinusitis: a comparative analysis.European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery · 2026Article
- AI Triage in Primary Care: Building Safer and More Equitable Real-World Evidence.Journal of medical Internet research · 2026Article
- Artificial Intelligence in Oral and Maxillofacial Surgery: Integrating Clinical Innovation and Workflow Optimization.Journal of clinical medicine · 2026Review
- Application of artificial intelligence in oral health management: challenges and opportunities.Frontiers in medicine · 2026Review
- Readability and Quality of Chatbot Responses to Periodontal Patient Queries: A Cross-Sectional Evaluation of Three Publicly Accessible Large Language Models.International journal of dentistry · 2026Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
5 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundThis study aims to evaluate and compare the performance of five publicly accessible large-language-model (LLM) based chatbots-ChatGPT-o1, Deepseek-R1, Google-Gemini-Advanced, Claude-3.5-Sonnet, and Perplexity-Pro-in providing responses to frequently asked questions (FAQs) about dental implant treatment. The primary goal was to assess the accuracy, completeness, clarity, relevance, and consistency of chatbot-generated answers.
methodsA total of 45 FAQs commonly encountered in clinical practice and online patient forums regarding dental implants were selected and categorized into nine thematic domains. Each question was submitted to the chatbots individually using a standardized protocol. Responses were independently assessed by a panel of four dental experts and one layperson using a 5-point Likert-scale. Python with Google-Colab was used for statistical analysis.
resultsChatGPT-o1 achieved the highest overall performance, particularly in relevance (M = 4.99), consistency (M = 4.97), and accuracy (M = 4.96). Deepseek-R1 followed closely, with strong scores in completeness and relevance. Claude-3.5-Sonnet ranked moderately, while Gemini-Advanced and Perplexity-Pro showed lower performance in completeness and clarity. Significant differences were observed among chatbots across all criteria (p < 0.001). Inter-rater reliability was high (α = 0.87), confirming consistency among evaluators.
conclusionsAI-driven chatbots demonstrated strong potential in delivering accurate and patient-friendly information about dental implant treatment. However, performance varied considerably across platforms, with ChatGPT-o1 and Deepseek-R1 showing the highest reliability. These findings highlight the emerging role of AI chatbots as supplementary tools in dental education and patient communication, while also underscoring the need for continued validation and ethical oversight in clinical applications.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.