Evidence map›Paper›PMID 40501075›Full record

ArticleJournal of periodontal & implant science2025

Evaluating the quality and empathy of responses to patient questions on the Korean Academy of Periodontology's online question and answer section: a cross-sectional study comparing periodontists and an AI-powered chatbot.

Jae-Hong Lee, So-Hae Oh, Falk Schwendicke, Akhilanand Chaurasia, Young-Taek Kim

Abstract read
In one paragraph

Article in Journal of periodontal & implant science, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Jae-Hong LeeDepartment of Periodontology, College of Dentistry and Institute of Oral Bioscience, Jeonbuk National University, Jeonju, Korea.ORCID https://orcid.org/0000-0002-2375-0141
So-Hae OhDepartment of Periodontology, College of Dentistry and Institute of Oral Bioscience, Jeonbuk National University, Jeonju, Korea.ORCID https://orcid.org/0000-0002-0203-4226
Falk SchwendickeClinic for Conservative Dentistry and Periodontology, University Hospital of the Ludwig-Maximilians-University Munich, Munich, Germany.ORCID https://orcid.org/0000-0003-1223-1669
Akhilanand ChaurasiaDepartment of Oral Medicine and Radiology, Faculty of Dental Sciences, King George's Medical University, Lucknow, India.ORCID https://orcid.org/0000-0002-8356-9512
Young-Taek KimDepartment of Periodontology, National Health Insurance Service Ilsan Hospital, Goyang, Korea. youngtaek@nhimc.or.kr.ORCID https://orcid.org/0000-0002-5132-5783

Funding

Ministry of Health and Welfare RS-2023-KH142251
6 · The paper itself

Abstract

purposeThis study aimed to evaluate and compare the responses of an artificial intelligence (AI)-powered chatbot and professional periodontists to patient queries in periodontology and implantology, using the Korean Academy of Periodontology's (KAP) online question and answer (Q&A) section.

methodsIn this comparative cross-sectional study, we analyzed 219 patient-submitted periodontal and implant knowledge questions from the KAP online Q&A section. A panel of 10 evaluators-5 periodontists and 5 laypersons-rated both the periodontist's and the AI chatbot's responses using standardized scales. We applied the

resultsTen evaluators judged the AI chatbot's responses to be significantly superior in quality and empathy compared to periodontist replies. A higher proportion of periodontist responses fell below acceptable quality ("very poor" or "poor") than chatbot responses (28.7% vs. 15.0%;

conclusionsAI-powered chatbots can deliver more accurate and empathetic answers than human periodontists, suggesting their potential role as consultation assistants merits further investigation. The high intraclass correlation coefficient values (0.79-0.93) indicate a high level of agreement among evaluators in both the periodontist and lay evaluator groups, thus confirming the reliability and robustness of the study's assessment methodology.

Indexed as

Artificial intelligenceDeep learningDentistsNatural language processingPatients

Identifiers

PMID40501075
PMCPMC12798413

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.