Evidence map›Paper›PMID 38180877›Full record

ArticleDento maxillo facial radiology2024

A content-aware chatbot based on GPT 4 provides trustworthy recommendations for Cone-Beam CT guidelines in dental imaging.

Maximilian Frederik Russe, Alexander Rau, Michael Andreas Ermer, René Rothweiler, Sina Wenger, Klara Klöble, Ralf K W Schulze, Fabian Bamberg, Rainer Schmelzeisen, Marco Reisert and 1 more

Abstract read
In one paragraph

Article in Dento maxillo facial radiology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Article
  7. Evaluating the Accuracy, Reliability, Consistency, and Readability of Different Large Language Models in Restorative Dentistry.Journal of esthetic and restorative dentistry : official publication of the American Academy of Esthetic Dentistry ... [et al.] · 2025
    Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Maximilian Frederik RusseDepartment of Diagnostic and Interventional Radiology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg 79106, Germany.ORCID 0000-0003-3187-2429
Alexander RauDepartment of Diagnostic and Interventional Radiology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg 79106, Germany.ORCID 0000-0001-5881-6043
Michael Andreas ErmerDepartment of Oral and Maxillofacial Surgery, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg 79106, Germany.
René RothweilerDepartment of Oral and Maxillofacial Surgery, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg 79106, Germany.
Sina WengerDepartment of Oral and Maxillofacial Surgery, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg 79106, Germany.
Klara KlöbleDepartment of Oral and Maxillofacial Surgery, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg 79106, Germany.
Ralf K W SchulzeDivision of Oral Diagnostic Sciences, Department of Oral Surgery and Stomatology and Oral Diagnostics, School of Dental Medicine, University of Bern, Bern 3010, Switzerland.
Fabian BambergDepartment of Diagnostic and Interventional Radiology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg 79106, Germany.ORCID 0000-0002-7460-3942
Rainer SchmelzeisenDepartment of Oral and Maxillofacial Surgery, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg 79106, Germany.
Marco ReisertDivision of Medical Physics, Department of Diagnostic and Interventional Radiology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg 79106, Germany.
Wiebke Semper-HoggDepartment of Oral and Maxillofacial Surgery, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg 79106, Germany.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesTo develop a content-aware chatbot based on GPT-3.5-Turbo and GPT-4 with specialized knowledge on the German S2 Cone-Beam CT (CBCT) dental imaging guideline and to compare the performance against humans.

methodsThe LlamaIndex software library was used to integrate the guideline context into the chatbots. Based on the CBCT S2 guideline, 40 questions were posed to content-aware chatbots and early career and senior practitioners with different levels of experience served as reference. The chatbots' performance was compared in terms of recommendation accuracy and explanation quality. Chi-square test and one-tailed Wilcoxon signed rank test evaluated accuracy and explanation quality, respectively.

resultsThe GPT-4 based chatbot provided 100% correct recommendations and superior explanation quality compared to the one based on GPT3.5-Turbo (87.5% vs. 57.5% for GPT-3.5-Turbo; P = .003). Moreover, it outperformed early career practitioners in correct answers (P = .002 and P = .032) and earned higher trust than the chatbot using GPT-3.5-Turbo (P = 0.006).

conclusionsA content-aware chatbot using GPT-4 reliably provided recommendations according to current consensus guidelines. The responses were deemed trustworthy and transparent, and therefore facilitate the integration of artificial intelligence into clinical decision-making.

Indexed as

Artificial IntelligenceSoftwareClinical Decision-MakingCone-Beam Computed TomographyConsensusHumanschatbotCone-Beam CTdental imagingnatural language processing

Identifiers

PMID38180877
PMCPMC11003655

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.