ArticleInternational dental journal2024
Performance of Generative Artificial Intelligence in Dental Licensing Examinations.
Article in International dental journal, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 83 papers, 7 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
83 citing papers in PubMed, 7 syntheses or guidelines pooled it.
- Accuracy of Large Language Models in Answering Dental Examination Questions: A Systematic Review and Meta-Analysis.International dental journal · 2026Pooled it
- Educational Applications of ChatGPT in University-Based Dental Education. A Systematic Review.European journal of dental education : official journal of the Association for Dental Education in Europe · 2026Pooled it
- Can Large Language Models Serve as Reliable Tools for Information in Dentistry? A Systematic Review.International dental journal · 2025Pooled it
- The potentials and challenges of integrating generative artificial intelligence (AI) in dental and orthodontic education: a systematic review.BMC oral health · 2025Pooled it
- Accuracy of Large Language Models When Answering Clinical Research Questions: Systematic Review and Network Meta-Analysis.Journal of medical Internet research · 2025Pooled it
- Large Language Models in Dental Licensing Examinations: Systematic Review and Meta-Analysis.International dental journal · 2025Pooled it
- Self-monitoring of Oral Health Using Smartphone Selfie Powered by Artificial Intelligence: Implications for Preventive Dentistry.Oral health & preventive dentistry · 2024Pooled it
- Evaluating ChatGPT-4o as an Educational Support Tool for the Emergency Management of Dental Trauma: Randomized Controlled Study Among Students.JMIR medical education · 2025Trial
- The letter to editor regarding "AI hallucinates because it's trained to fake it till it makes it".The Japanese dental science review · 2026Article
- Evaluation of artificial intelligence-based software programs applied to the radiographic and photographic identification of dental implant systems.Journal of prosthodontics : official journal of the American College of Prosthodontists · 2026Article
- Reimagining Dental Education: Integrating Digital Technologies for a Global, Digitally Native Generation-A Perspective.European journal of dentistry · 2026Article
- Beyond the Drill: Can Digital Gadgets Redefine the Future of Dental Education?European journal of dental education : official journal of the Association for Dental Education in Europe · 2026Article
- Bloom's taxonomy-based comparison of artificial intelligence and dental students in restorative dentistry.BMC medical education · 2026Article
- Performance of large language models on undergraduate endodontic multiple-choice questions.BMC oral health · 2026Article
- Article
- Guideline-based clinical reasoning in periodontology education: a comparative study of residents and large language models.BMC medical education · 2026Article
- Evaluation of the performance of ChatGPT-4 and ChatGPT-4o as a learning tool in endodontics.International endodontic journal · 2026Article
- Comparative Performance of State-of-the-Art LLMs on the KDLE: A 2025 Benchmark Study.International dental journal · 2026Article
- Evaluation of ChatGPT-4o in oral and maxillofacial surgery examinations: a comparative study of performance on U.S. dental decks and chinese dental licensing examination practice questions.BMC oral health · 2026Article
- Evaluating large language models for interpreting and applying caries guidelines in clinical decision support.BMC oral health · 2026Article
23 more citing papers are in PubMed but not listed here.
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
6 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
objectivesGenerative artificial intelligence (GenAI), including large language models (LLMs), has vast potential applications in health care and education. However, it is unclear how proficient LLMs are in interpreting written input and providing accurate answers in dentistry. This study aims to investigate the accuracy of GenAI in answering questions from dental licensing examinations.
methodsA total of 1461 multiple-choice questions from question books for the US and the UK dental licensing examinations were input into 2 versions of ChatGPT 3.5 and 4.0. The passing rates of the US and UK dental examinations were 75.0% and 50.0%, respectively. The performance of the 2 versions of GenAI in individual examinations and dental subjects was analysed and compared.
resultsChatGPT 3.5 correctly answered 68.3% (n = 509) and 43.3% (n = 296) of questions from the US and UK dental licensing examinations, respectively. The scores for ChatGPT 4.0 were 80.7% (n = 601) and 62.7% (n = 429), respectively. ChatGPT 4.0 passed both written dental licensing examinations, whilst ChatGPT 3.5 failed. ChatGPT 4.0 answered 327 more questions correctly and 102 incorrectly compared to ChatGPT 3.5 when comparing the 2 versions.
conclusionsThe newer version of GenAI has shown good proficiency in answering multiple-choice questions from dental licensing examinations. Whilst the more recent version of GenAI generally performed better, this observation may not hold true in all scenarios, and further improvements are necessary. The use of GenAI in dentistry will have significant implications for dentist-patient communication and the training of dental professionals.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.