Evidence map›Paper›PMID 42096837›Full record

ArticleInternational dental journal2026

Knowledge and Awareness of Performance Metrics in Dental Image Analysis With Artificial Intelligence: A Cross-Sectional Survey of Researchers and Clinicians.

Rishi Ramani, Bree Jones, Akhilanand Chaurasia, Yeganeh Khazaei, Julia Schwärzler, Sergio E Uribe, Falk Schwendicke, Antonin Tichy

Abstract read
In one paragraph

Article in International dental journal, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Rishi RamaniDental Data and Artificial Intelligence (D2AI) research group, Melbourne Dental School, University of Melbourne, Victoria, Australia; Topic Group Oral Health, ITU/WHO/WIPO Global Initiative on Artificial Intelligence for Health, Geneva, Switzerland. Electronic address: r.ramani@unimelb.edu.au.
Bree JonesDental Data and Artificial Intelligence (D2AI) research group, Melbourne Dental School, University of Melbourne, Victoria, Australia; Topic Group Oral Health, ITU/WHO/WIPO Global Initiative on Artificial Intelligence for Health, Geneva, Switzerland.
Akhilanand ChaurasiaTopic Group Oral Health, ITU/WHO/WIPO Global Initiative on Artificial Intelligence for Health, Geneva, Switzerland; Department of Oral Medicine and Radiology, King George's Medical University, Lucknow, India.
Yeganeh KhazaeiDental Data and Artificial Intelligence (D2AI) research group, Melbourne Dental School, University of Melbourne, Victoria, Australia; Topic Group Oral Health, ITU/WHO/WIPO Global Initiative on Artificial Intelligence for Health, Geneva, Switzerland.
Julia SchwärzlerTopic Group Oral Health, ITU/WHO/WIPO Global Initiative on Artificial Intelligence for Health, Geneva, Switzerland; Clinic for Conservative Dentistry, Periodontology and Digital Dentistry, LMU University Hospital, Munich, Germany.
Sergio E UribeTopic Group Oral Health, ITU/WHO/WIPO Global Initiative on Artificial Intelligence for Health, Geneva, Switzerland; Clinic for Conservative Dentistry, Periodontology and Digital Dentistry, LMU University Hospital, Munich, Germany; Department of General Dentistry, Rīga Stradiņš University, Rīga, Latvia; Institute of Stomatology, Rīga Stradiņš University, Rīga, Latvia.
Falk SchwendickeTopic Group Oral Health, ITU/WHO/WIPO Global Initiative on Artificial Intelligence for Health, Geneva, Switzerland; Clinic for Conservative Dentistry, Periodontology and Digital Dentistry, LMU University Hospital, Munich, Germany.
Antonin TichyTopic Group Oral Health, ITU/WHO/WIPO Global Initiative on Artificial Intelligence for Health, Geneva, Switzerland; Clinic for Conservative Dentistry, Periodontology and Digital Dentistry, LMU University Hospital, Munich, Germany; Institute of Dental Medicine, First Faculty of Medicine, Charles University, Prague, Czech Republic. Electronic address: Antonin.Tichy@med.uni-muenchen.de.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

INTRODUCTION AND

aimAppropriate performance metrics are essential for evaluating machine learning (ML) algorithm performance in dental image analysis. A broad variety of performance metrics are used in dental artificial intelligence (AI) research which could cause confusion regarding model performance. This study aimed to assess the knowledge, awareness, and self-reported confidence of oral health researchers and clinicians regarding AI performance metrics.

methodsThis cross-sectional, questionnaire-based survey initially recruited participants (n = 100) from the ITU/WHO/WIPO Global Initiative on AI for Health Topic Group - Oral Health and affiliated professional global networks. An online self-administered questionnaire evaluated theoretical knowledge and applied knowledge. Participants also reported basic demographics and their confidence in using different metrics.

resultsOverall performance was poor with participants achieving a mean score of 17.1% (SD: 15.2%, median: 16.7%, IQR: 16.7%) for fully correct responses. Responses to theoretical questions were rarely fully correct (range: 1%-15%; median: 5.5%). Applied scenario performance ranged from 17% to 37% correct responses (median: 29%). Participants demonstrated greater knowledge of common metrics (accuracy, specificity) but struggled with advanced measures (Intersection over Union & Dice Similarity Coefficient). Common errors included terminology confusion, familiarity bias towards accuracy, and task-metric misalignment.

conclusionSubstantial gaps exist in knowledge and awareness of both theory and practical applications of AI performance metrics amongst dental professionals and researchers. Frequent misapplication of commonly known metrics suggests overgeneralisation without consideration of task-specific requirements. CLINICAL RELEVANCE: Inadequate knowledge or awareness of metric selection and interpretation may lead to the deployment of suboptimal algorithms, which can compromise diagnostic accuracy and patient outcomes. Enhanced understanding of performance metrics is critical for ensuring reliable, fair, safe, and effective AI systems in clinical dentistry.

Indexed as

Artificial IntelligenceDentistsHealth Knowledge, Attitudes, PracticeAdultAlgorithmsCross-Sectional StudiesFemaleHumansMachine LearningMaleSurveys and QuestionnairesArtificial intelligenceHealth knowledge, attitudes, practicePredictive value of testsRadiography, dental, digitalSensitivity and specificitySurveys and questionnaires

Identifiers

PMID42096837
PMCPMC13156619

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.