Evidence map›Paper›PMID 39987420›Full record

ArticleEuropean archives of paediatric dentistry : official journal of the European Academy of Paediatric Dentistry2025

Evaluating the evidence-based potential of six large language models in paediatric dentistry: a comparative study on generative artificial intelligence.

Anastasia Dermata, Aristidis Arhakis, Miltiadis A Makrygiannakis, Kostis Giannakopoulos, Eleftherios G Kaklamanos

Abstract readComparative Study
In one paragraph

Article in European archives of paediatric dentistry : official journal of the European Academy of Paediatric Dentistry, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

19 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Comparative evaluation of ChatGPT and Gemini in detecting external apical root resorption on panoramic radiographs of orthodontic patients : Artificial intelligence performance in detecting root resorption.Journal of orofacial orthopedics = Fortschritte der Kieferorthopadie : Organ/official journal Deutsche Gesellschaft fur Kieferorthopadie · 2025
    Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Anastasia DermataSchool of Dentistry, Aristotle University of Thessaloniki, 54124, Thessaloniki, Greece.ORCID http://orcid.org/0000-0002-6631-7161
Aristidis ArhakisSchool of Dentistry, Aristotle University of Thessaloniki, 54124, Thessaloniki, Greece. arhakis@dent.auth.gr.ORCID http://orcid.org/0000-0003-4390-0466
Miltiadis A MakrygiannakisSchool of Dentistry, National and Kapodistrian University of Athens, 11527, Athens, Greece.ORCID http://orcid.org/0000-0003-2855-8623
Kostis GiannakopoulosSchool of Dentistry, European University Cyprus, 2404, Nicosia, Cyprus.ORCID http://orcid.org/0000-0001-7008-7306
Eleftherios G KaklamanosSchool of Dentistry, Aristotle University of Thessaloniki, 54124, Thessaloniki, Greece.ORCID http://orcid.org/0000-0002-0513-5110

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeThe use of large language models (LLMs) in generative artificial intelligence (AI) is rapidly increasing in dentistry. However, their reliability is yet to be fully founded. This study aims to evaluate the diagnostic accuracy, clinical applicability, and patient education potential of LLMs in paediatric dentistry, by evaluating the responses of six LLMs: Google AI's Gemini and Gemini Advanced, OpenAI's ChatGPT-3.5, -4o and -4, and Microsoft's Copilot.

methodsTen open-type clinical questions, relevant to paediatric dentistry were posed to the LLMs. The responses were graded by two independent evaluators from 0 to 10 using a detailed rubric. After 4 weeks, answers were reevaluated to assess intra-evaluator reliability. Statistical comparisons used Friedman's and Wilcoxon's and Kruskal-Wallis tests to assess the model that provided the most comprehensive, accurate, explicit and relevant answers.

resultsVariations of results were noted. Chat GPT 4 answers were scored as the best (average score 8.08), followed by the answers of Gemini Advanced (8.06), ChatGPT 4o (8.01), ChatGPT 3.5 (7.61), Gemini (7,32) and Copilot (5.41). Statistical analysis revealed that Chat GPT 4 outperformed all other LLMs, and the difference was statistically significant. Despite variations and different responses to the same queries, remarkable similarities were observed. Except for Copilot, all chatbots managed to achieve a score level above 6.5 on all queries.

conclusionThis study demonstrates the potential use of language models (LLMs) in supporting evidence-based paediatric dentistry. Nevertheless, they cannot be regarded as completely trustworthy. Dental professionals should critically use AI models as supportive tools and not as a substitute of overall scientific knowledge and critical thinking.

Indexed as

Artificial IntelligenceEvidence-Based DentistryLanguagePediatric DentistryChildGenerative Artificial IntelligenceHumansLarge Language ModelsReproducibility of ResultsChatGPTGoogle geminiLarge language modelsMicrosoft’s copilotOpenAI’sPaediatric dentistry

Identifiers

PMID39987420
PMCPMC12165978

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.