ArticleBMC oral health2024
Evaluating the accuracy of Chat Generative Pre-trained Transformer version 4 (ChatGPT-4) responses to United States Food and Drug Administration (FDA) frequently asked questions about dental amalgam.
Article in BMC oral health, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
13 citing papers in PubMed.
- The role of large language models in dental diagnosis, decision-making, and communication: A systematic review.The Japanese dental science review · 2026Review
- From algorithms to empathy: can large language models effectively answer patients' questions in restorative dentistry?BMC oral health · 2026Article
- Performance of 4 artificial intelligence chatbots in responding to multiple choice questions in operative dentistry.BMC oral health · 2026Article
- Accuracy, quality, and readability analyses of responses from large language models to questions on pediatric dental sedation.BMC oral health · 2026Article
- A comparative analysis of embedded chatbot models and ChatGPT-4 for answering orthodontic treatment queries.Scientific reports · 2026Article
- Generative Artificial Intelligence: Applications and Future Prospects in Dentistry.International dental journal · 2026Review
- Applications and potential of ChatGPT in dentistry: Scoping review of research perspectives.Journal of dental sciences · 2026Review
- Exploring artificial intelligence chatbots in pediatric fluoride education: a cross-sectional study.Scientific reports · 2025Article
- Artificial Intelligence-Aided Tooth Detection and Segmentation on Pediatric Panoramic Radiographs in Mixed Dentition Using a Transfer Learning Approach.Diagnostics (Basel, Switzerland) · 2025Article
- Evaluation of the accuracy of ChatGPT-4 and Gemini's responses to the World Dental Federation's frequently asked questions on oral health.BMC oral health · 2025Article
- Correlates of Medical and Allied Health Students' Engagement with Generative AI in Nigeria.Medical science educator · 2025Article
- Performance of large language artificial intelligence models on solving restorative dentistry and endodontics student assessments.Clinical oral investigations · 2024Article
- Artificial Intelligence in Dental Education: Opportunities and Challenges of Large Language Models and Multimodal Foundation Models.JMIR medical education · 2024Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
2 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundThe use of artificial intelligence in the field of health sciences is becoming widespread. It is known that patients benefit from artificial intelligence applications on various health issues, especially after the pandemic period. One of the most important issues in this regard is the accuracy of the information provided by artificial intelligence applications.
objectiveThe purpose of this study was to the frequently asked questions about dental amalgam, as determined by the United States Food and Drug Administration (FDA), which is one of these information resources, to Chat Generative Pre-trained Transformer version 4 (ChatGPT-4) and to compare the content of the answers given by the application with the answers of the FDA.
methodsThe questions were directed to ChatGPT-4 on May 8th and May 16th, 2023, and the responses were recorded and compared at the word and meaning levels using ChatGPT. The answers from the FDA webpage were also recorded. The responses were compared for content similarity in "Main Idea", "Quality Analysis", "Common Ideas", and "Inconsistent Ideas" between ChatGPT-4's responses and FDA's responses.
resultsChatGPT-4 provided similar responses at one-week intervals. In comparison with FDA guidance, it provided answers with similar information content to frequently asked questions. However, although there were some similarities in the general aspects of the recommendation regarding amalgam removal in the question, the two texts are not the same, and they offered different perspectives on the replacement of fillings.
conclusionsThe findings of this study indicate that ChatGPT-4, an artificial intelligence based application, encompasses current and accurate information regarding dental amalgam and its removal, providing it to individuals seeking access to such information. Nevertheless, we believe that numerous studies are required to assess the validity and reliability of ChatGPT-4 across diverse subjects.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.