ArticleBMC oral health2025
Artificial intelligence versus human expertise: reliability of ChatGPT and the London atlas for dental age estimation using panoramic radiographs.
Article in BMC oral health, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
2 citing papers in PubMed.
- Comparative Evaluation of Large Language Models for Reporting Jaw Lesions on Panoramic Radiographs.Diagnostics (Basel, Switzerland) · 2026Article
- Comparison of the diagnostic accuracy of dentists and ChatGPT in jawbone lesions.BMC oral health · 2026Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
1 author.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundThis study evaluated the performance of ChatGPT, a multimodal large language model (LLM), in estimating dental age from panoramic radiographs (PRs) and compared its accuracy and reproducibility with those of the London Atlas (LA) method.
methodsPRs of 620 healthy children aged 6 through 13 years were retrospectively analyzed. An experienced dentomaxillofacial radiologist estimated dental age using the LA, and the ChatGPT-4o model analyzed the same anonymized images to generate automated age predictions. Both methods were repeated after two weeks to assess intra-observer reliability. Predictive accuracy and agreement with chronological age (CA) were evaluated using mean absolute error (MAE), root mean squared error (RMSE), intraclass correlation coefficients (ICC), and Bland–Altman analyses. Statistical significance was set at p < .05.
resultsChatGPT’s predictions differed significantly from chronological age (CA), tending to overestimate age in younger children and underestimate age in older children. Compared with the LA, ChatGPT exhibited higher MAE and RMSE values, indicating lower predictive accuracy and greater variability. Error magnitudes were greatest in the 6-, 12-, and 13-year-old groups and lowest in the 8-year-old group, whereas the LA showed lower and more stable errors across ages. The LA demonstrated fewer discrepancies and excellent reproducibility (ICC = 0.960) as compared with the moderate agreement of ChatGPT (ICC = 0.703). Overall, the LA provided estimates closer to CA, whereas ChatGPT exhibited greater variability.
conclusionsChatGPT shows promise for complex decision-making tasks such as dental age estimation; however, its current accuracy, reproducibility, and output stability remain inferior to established methods such as the LA. The inconsistent predictions observed across repeated evaluations highlight a critical limitation regarding its reliability for clinical and forensic applications. Therefore, ChatGPT-based estimations should be interpreted with caution until future versions achieve more consistent and reproducible performance through population-specific training, model optimization, and multicenter validation.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.