Evidence map›Paper›PMID 39593799›Full record

ArticleBioengineering (Basel, Switzerland)2024

Performance of a Deep Learning System and Performance of Optometrists for the Detection of Glaucomatous Optic Neuropathy Using Colour Retinal Photographs.

Catherine L Jan, Algis Vingrys, Jacqueline Henwood, Xianwen Shang, Christian Davey, Peter van Wijngaarden, George Y X Kong, Jennifer C Fan Gaskin, Bernardo P Soares Bezerra, Randall S Stafford and 1 more

Abstract read
In one paragraph

Article in Bioengineering (Basel, Switzerland), 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Analysing diagnostic practices and referral pathways for glaucoma in Australian primary eye care.Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians (Optometrists) · 2025
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Catherine L JanCentre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, VIC 3002, Australia.ORCID 0000-0001-7383-8208
Algis VingrysCentre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, VIC 3002, Australia.ORCID 0000-0001-5920-4604
Jacqueline HenwoodCentre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, VIC 3002, Australia.
Xianwen ShangCentre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, VIC 3002, Australia.
Christian DaveySchool of Mathematics and Statistics, University of Melbourne, Melbourne, VIC 3010, Australia.ORCID 0000-0003-3097-9769
Peter van WijngaardenCentre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, VIC 3002, Australia.ORCID 0000-0002-8800-7834
George Y X KongCentre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, VIC 3002, Australia.
Jennifer C Fan GaskinCentre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, VIC 3002, Australia.
Bernardo P Soares BezerraCentre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, VIC 3002, Australia.
Randall S StaffordStanford Prevention Research Center, Stanford University School of Medicine, Stanford, CA 94304, USA.
Mingguang HeCentre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, VIC 3002, Australia.

Funding

Global STEM Professorship Scheme (HK) P0046113Medical Research Future Fund (Australia) MRFAI00035National Critical Research Infrastructure Initiative (Australia) N/ANHMRC Investigator Grant (Australia) APP1175405Operational Infrastructure Support from the Victorian State Government N/AResearch Training Scholarship from the Australian Commonwealth Government N/A
6 · The paper itself

Abstract

BACKGROUND/

objectivesGlaucoma is the leading cause of irreversible blindness, with a significant proportion of cases remaining undiagnosed globally. The interpretation of optic disc and retinal nerve fibre layer images poses challenges for optometrists and ophthalmologists, often leading to misdiagnosis. AI has the potential to improve diagnosis. This study aims to validate an AI system (a convolutional neural network based on the Inception-v3 architecture) for detecting glaucomatous optic neuropathy (GON) using colour fundus photographs from a UK population and to compare its performance against Australian optometrists.

methodsA retrospective external validation study was conducted, comparing AI's performance with that of 11 AHPRA-registered optometrists in Australia on colour retinal photographs, evaluated against a reference (gold) standard established by a panel of glaucoma specialists. Statistical analyses were performed using sensitivity, specificity, and area under the receiver operating characteristic curve (AUROC).

resultsFor referable GON, the sensitivity of the AI (33.3% [95%CI: 32.4-34.3) was significantly lower than that of optometrists (65.1% [95%CI: 64.1-66.0]),

conclusionThe AI system exhibited lower performance than optometrists in detecting referable glaucoma. Our findings suggest that while AI can serve as a screening tool, both AI and optometrists have suboptimal performance for the nuanced diagnosis of glaucoma using fundus photographs alone. Enhanced training with diverse populations for AI is essential for improving GON detection and addressing the significant challenge of undiagnosed cases.

Indexed as

artificial intelligencedeep learningglaucoma detectionprimary care

Identifiers

PMID39593799
PMCPMC11591493

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.