Evidence map›Paper›PMID 39789113›Full record

ArticleScientific reports2025

The importance of clinical experience in AI-assisted corneal diagnosis: verification using intentional AI misleading.

Hiroki Maehara, Yuta Ueno, Takefumi Yamaguchi, Yoshiyuki Kitaguchi, Dai Miyazaki, Ryohei Nejima, Takenori Inomata, Naoko Kato, Tai-Ichiro Chikama, Jun Ominato and 6 more

Abstract read
In one paragraph

Article in Scientific reports, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Review
  5. Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors.

Hiroki MaeharaDepartment of Ophthalmology, Fukushima Medical University School of Medicine, Fukushima, Japan.
Yuta UenoDepartment of Ophthalmology, Faculty of Medicine, University of Tsukuba, 1-1-1 Tennoudai, Tsukuba, Ibaraki, Japan. yu_ueno71@yahoo.co.jp.
Takefumi YamaguchiDepartment of Ophthalmology, Tokyo Dental College Ichikawa General Hospital, Chiba, Japan.
Yoshiyuki KitaguchiDepartment of Ophthalmology, Osaka University Graduate School of Medicine, Osaka, Japan.
Dai MiyazakiDivision of Ophthalmology and Visual Science, Faculty of Medicine, Tottori University, Tottori, Japan.
Ryohei NejimaDepartment of Ophthalmology, Miyata Eye Hospital, Miyazaki, Japan.
Takenori InomataDepartment of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan.
Naoko KatoDepartment of Ophthalmology, Tsukazaki Hospital, Hyogo, Japan.
Tai-Ichiro ChikamaDivision of Ophthalmology and Visual Science, Graduate School of Biomedical and Health Sciences, Hiroshima University, Hiroshima, Japan.
Jun OminatoDivision of Ophthalmology and Visual Science, Graduate School of Medical and Dental Sciences, Niigata University, Niigata, Japan.
Tatsuya YunokiDepartment of Ophthalmology, University of Toyama, Toyama, Japan.
Kinya TsubotaDepartment of Ophthalmology, Tokyo Medical University, Tokyo, Japan.
Masahiro OdaGraduate School of Informatics, Nagoya University, Nagoya, Japan.
Manabu SuzutaniDepartment of Ophthalmology, Fukushima Medical University School of Medicine, Fukushima, Japan.
Tetsuju SekiryuDepartment of Ophthalmology, Fukushima Medical University School of Medicine, Fukushima, Japan.
Tetsuro OshikaDepartment of Ophthalmology, Faculty of Medicine, University of Tsukuba, 1-1-1 Tennoudai, Tsukuba, Ibaraki, Japan.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

We developed an AI system capable of automatically classifying anterior eye images as either normal or indicative of corneal diseases. This study aims to investigate the influence of AI's misleading guidance on ophthalmologists' responses. This cross-sectional study included 30 cases each of infectious and immunological keratitis. Responses regarding the presence of infection were collected from 7 corneal specialists and 16 non-corneal-specialist ophthalmologists, first based on the images alone and then after presenting the AI's classification results. The AI's diagnoses were deliberately altered to present a correct classification in 70% of the cases and incorrect in 30%. The overall accuracy of the ophthalmologists did not significantly change after AI assistance was introduced [75.2 ± 8.1%, 75.9 ± 7.2%, respectively (P = 0.59)]. In cases where the AI presented incorrect diagnoses, the accuracy of corneal specialists before and after AI assistance was showing no significant change [60.3 ± 35.2% and 53.2 ± 30.9%, respectively (P = 0.11)]. In contrast, the accuracy for non-corneal specialists dropped significantly from 54.5 ± 27.8% to 31.6 ± 29.3% (P < 0.001), especially in cases where the AI presented incorrect options. Less experienced ophthalmologists were misled due to incorrect AI guidance, but corneal specialists were not. Even with the introduction of AI diagnostic support systems, the importance of ophthalmologist's experience remains crucial.

Indexed as

Artificial IntelligenceAdultAgedCorneaCorneal DiseasesCross-Sectional StudiesDiagnosis, Computer-AssistedFemaleHumansMaleMiddle AgedOphthalmologistsAIAI assistArtificial intelligenceMisleading AI guidanceOcular surface

Identifiers

PMID39789113
PMCPMC11717947

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.