Evidence map›Paper›PMID 40235827›Full record

ArticleOphthalmology science

Comparison of Deep Learning and Clinician Performance for Detecting Referable Glaucoma from Fundus Photographs in a Safety Net Population.

Van Nguyen, Sreenidhi Iyengar, Haroon Rasheed, Galo Apolo, Zhiwei Li, Aniket Kumar, Hong Nguyen, Austin Bohner, Kyle Bolo, Rahul Dhodapkar and 14 more

Abstract read
In one paragraph

Article in Ophthalmology science. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Review
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

24 authors.

Van NguyenDepartment of Ophthalmology, Keck School of Medicine, Roski Eye Institute, University of Southern California, Los Angeles, California.
Sreenidhi IyengarDepartment of Computer Science, Information Sciences Institute, University of Southern California, Los Angeles, California.
Haroon RasheedDepartment of Ophthalmology, Keck School of Medicine, Roski Eye Institute, University of Southern California, Los Angeles, California.
Galo ApoloDepartment of Ophthalmology, Keck School of Medicine, Roski Eye Institute, University of Southern California, Los Angeles, California.
Zhiwei LiDepartment of Computer Science, Information Sciences Institute, University of Southern California, Los Angeles, California.
Aniket KumarDepartment of Computer Science, Information Sciences Institute, University of Southern California, Los Angeles, California.
Hong NguyenDepartment of Computer Science, Information Sciences Institute, University of Southern California, Los Angeles, California.
Austin BohnerDepartment of Ophthalmology, Keck School of Medicine, Roski Eye Institute, University of Southern California, Los Angeles, California.
Kyle BoloDepartment of Ophthalmology, Keck School of Medicine, Roski Eye Institute, University of Southern California, Los Angeles, California.
Rahul DhodapkarDepartment of Ophthalmology, Keck School of Medicine, Roski Eye Institute, University of Southern California, Los Angeles, California.
Jiun DoDepartment of Ophthalmology, Los Angeles General Medical Center, Los Angeles, California.
Andrew T DuongDepartment of Ophthalmology, Keck School of Medicine, Roski Eye Institute, University of Southern California, Los Angeles, California.
Jeffrey GlucksteinDepartment of Ophthalmology, Keck School of Medicine, Roski Eye Institute, University of Southern California, Los Angeles, California.
Kendra HongDepartment of Ophthalmology, Keck School of Medicine, Roski Eye Institute, University of Southern California, Los Angeles, California.
Lucas L HumayunKeck School of Medicine, University of Southern California, Los Angeles, California.
Alanna JamesDepartment of Ophthalmology, Keck School of Medicine, Roski Eye Institute, University of Southern California, Los Angeles, California.
Junhui LeeDepartment of Ophthalmology, Keck School of Medicine, Roski Eye Institute, University of Southern California, Los Angeles, California.
Kent NguyenDepartment of Ophthalmology, Keck School of Medicine, Roski Eye Institute, University of Southern California, Los Angeles, California.
Brandon J WongDepartment of Ophthalmology, Keck School of Medicine, Roski Eye Institute, University of Southern California, Los Angeles, California.
Jose-Luis AmbiteDepartment of Computer Science, Information Sciences Institute, University of Southern California, Los Angeles, California.
Carl KesselmanDepartment of Computer Science, Information Sciences Institute, University of Southern California, Los Angeles, California.
Lauren P DaskivichDepartment of Ophthalmology, Keck School of Medicine, Roski Eye Institute, University of Southern California, Los Angeles, California.
Michael PazzaniDepartment of Computer Science, Information Sciences Institute, University of Southern California, Los Angeles, California.
Benjamin Y XuDepartment of Ophthalmology, Keck School of Medicine, Roski Eye Institute, University of Southern California, Los Angeles, California.

Funding

Ophthalmic Therapeutics Engineering CoreP30EY029220 · NEI · UNIVERSITY OF SOUTHERN CALIFORNIA · PI Mahnaz Shahidi · 2018 to 2026
$6.5M
Optic Nerve Relays for Vision Restoration and Advancement Optic Nerve Regeneration ResearchR01EY036155 · NEI · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI Jiun Lap Do, Derek Stuart Welsbie · 2024 to 2026
$1.5M
NEI NIH HHS P30 EY029220NEI NIH HHS R01 EY036155
6 · The paper itself

Abstract

Purpose: Develop and test a deep learning (DL) algorithm for detecting referable glaucoma. Design: Retrospective cohort study. Participants: A total of 6116 patients from the Los Angeles County (LAC) Department of Health Services (DHS) were included. Methods: Fundus photographs and patient-level labels of referable glaucoma (cup-to-disc ratio ≥0.6) provided by 21 certified optometrists. A DL algorithm based on the Visual Geometry Group-19 architecture was trained using patient-level labels generalized to images from both eyes. Area under the receiver operating curve (AUROC), sensitivity, and specificity were calculated to assess algorithm performance using an independent test set that was also graded by 13 clinicians with 0 to 10 years of experience. Algorithm performance was tested using reference labels provided by either LAC DHS optometrists or an expert panel of 3 glaucoma specialists. Main Outcome Measures: Area under the receiver operating curve, sensitivity, and specificity. Results: The DL algorithm was trained using 12 998 images from 5616 patients (2086 referable glaucoma, 3530 nonglaucoma). In this data set, the mean age was 56.8 ± 10.5 years with 54.8% women, 68.2% Latinos, 8.9% Blacks, 6.0% Asians, and 2.7% Whites. One thousand images from 500 patients (250 referable glaucoma, 250 nonglaucoma) with similar demographics ( Conclusions: A DL algorithm for detecting referable glaucoma trained using patient-level data provided by certified LAC DHS optometrists approximates or exceeds performance by ophthalmologists and optometrists, who exhibit variable sensitivity and specificity unrelated to experience level. Implementation of this algorithm in screening workflows could help reallocate resources and provide more reproducible and timely glaucoma care. Financial Disclosures: Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Indexed as

Artificial intelligenceDeep learningGlaucomaScreeningTelemedicine

Identifiers

PMID40235827
PMCPMC11999268

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.