Evidence map›Paper›PMID 36731747›Full record

ArticleOphthalmology. Glaucoma

The Definition of Glaucomatous Optic Neuropathy in Artificial Intelligence Research and Clinical Applications.

Felipe A Medeiros, Terry Lee, Alessandro A Jammal, Lama A Al-Aswad, Malvina B Eydelman, Joel S Schuman, Collaborative Community for Ophthalmic Imaging Executive Committee, Glaucoma Workgroup

Open access · greenAbstract read
In one paragraph

Article in Ophthalmology. Glaucoma. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 1 pooled it
2.2field-weighted citation impact, top 13% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 1 synthesis or guideline pooled it, 8 citations in OpenAlex.

  1. Pooled it
  2. Current Trends in AI and Eye Disease Diagnostics.Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians (Optometrists) · 2026
    Review
  3. Artificial Intelligence in Glaucoma Detection and Progression.Advances in ophthalmology and optometry · 2026
    Article
  4. Review
  5. Article
  6. Review
  7. Review
  8. Article
  9. Big data for imaging assessment in glaucoma.Taiwan journal of ophthalmology
    Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 4 institutions in 1 country.

Felipe A MedeirosDepartment of Ophthalmology, Duke University School of Medicine, Durham, North Carolina; Department of Electrical and Computer Engineering, Pratt School of Engineering, Duke University, Durham, North Carolina. Electronic address: felipe.medeiros@duke.edu.
Terry LeeDepartment of Ophthalmology, Duke University School of Medicine, Durham, North Carolina.
Alessandro A JammalDepartment of Ophthalmology, Duke University School of Medicine, Durham, North Carolina.
Lama A Al-AswadDepartment of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, New York; Department of Population Health, NYU Langone Health, NYU Grossman School of Medicine, New York, New York.
Malvina B EydelmanUS Food and Drug Administration, Silver Spring, Maryland.
Joel S SchumanDepartment of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, New York; Department of Biomedical Engineering, New York University Tandon School of Engineering, Brooklyn, New York; Department of Electrical and Computer Engineering, New York University Tandon School of Engineering, Brooklyn, New York; Center for Neural Science, NYU, New York, New York; Neuroscience Institute, NYU Langone Health, New York, New York.
Collaborative Community for Ophthalmic Imaging Executive Committee
Glaucoma Workgroup
Duke University · USNew York University · USNYU Langone Health · USUnited States Food and Drug Administration · US

Funding

Novel Glaucoma Diagnostics for Structure and Function - Renewal - 1R01EY013178 · NEI · WILLS EYE HEALTH SYSTEM · PI Joel S Schuman · 2000 to 2026
$17.5M
Diagnostic Innovations in Glaucoma Study (DIGS): Functional ImpairmentR01EY021818 · NEI · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI MEDEIROS, FELIPE · 2011 to 2015
$3.4M
Clinical glaucoma management enabled by visible-light OCTU01EY033001 · NEI · NORTHWESTERN UNIVERSITY · PI SCHUMAN, JOEL S, ZHANG, HAO F · 2021 to 2025
$3.2M
The BCI (Brain Computer Interface) Glaucoma Study: Objective Home-Based Detection of Progressive Visual Function Loss in GlaucomaR01EY029885 · NEI · UNIVERSITY OF MIAMI SCHOOL OF MEDICINE · PI ASRANI, SANJAY, MEDEIROS, FELIPE · 2019 to 2022
$2.2M
Objective Quantification of Neural Damage for Screening, Diagnosis and Monitoring of Glaucoma with Fundus PhotographsR21EY031898 · NEI · DUKE UNIVERSITY · PI MEDEIROS, FELIPE · 2020 to 2021
$437k
NEI NIH HHS R01 EY013178NEI NIH HHS R01 EY021818NEI NIH HHS R01 EY029885NEI NIH HHS R21 EY031898NEI NIH HHS U01 EY033001
6 · The paper itself

Abstract

objectiveAlthough artificial intelligence (AI) models may offer innovative and powerful ways to use the wealth of data generated by diagnostic tools, there are important challenges related to their development and validation. Most notable is the lack of a perfect reference standard for glaucomatous optic neuropathy (GON). Because AI models are trained to predict presence of glaucoma or its progression, they generally rely on a reference standard that is used to train the model and assess its validity. If an improper reference standard is used, the model may be trained to detect or predict something that has little or no clinical value. This article summarizes the issues and discussions related to the definition of GON in AI applications as presented by the Glaucoma Workgroup from the Collaborative Community for Ophthalmic Imaging (CCOI) US Food and Drug Administration Virtual Workshop, on September 3 and 4, 2020, and on January 28, 2022.

designReview and conference proceedings. SUBJECTS: No human or animal subjects or data therefrom were used in the production of this article.

methodsA summary of the Workshop was produced with input and approval from all participants.

main outcome measuresConsensus position of the CCOI Workgroup on the challenges in defining GON and possible solutions.

resultsThe Workshop reviewed existing challenges that arise from the use of subjective definitions of GON and highlighted the need for a more objective approach to characterize GON that could facilitate replication and comparability of AI studies and allow for better clinical validation of proposed AI tools. Different tests and combination of parameters for defining a reference standard for GON have been proposed. Different reference standards may need to be considered depending on the scenario in which the AI models are going to be applied, such as community-based or opportunistic screening versus detection or monitoring of glaucoma in tertiary care.

conclusionsThe development and validation of new AI-based diagnostic tests should be based on rigorous methodology with clear determination of how the reference standards for glaucomatous damage are constructed and the settings where the tests are going to be applied. FINANCIAL DISCLOSURE(S): Proprietary or commercial disclosure may be found after the references.

Indexed as

GlaucomaOptic DiskOptic Nerve DiseasesAnimalsArtificial IntelligenceHumansOptic NerveArtificial intelligenceGlaucomaGlaucomatous optic neuropathy

Identifiers

PMID36731747
PMCPMC10387499
OpenAlexW4318567369

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.