Evidence map›Paper›PMID 41999903›Full record

ArticleOphthalmology2026

Reference Standard for Validation of Age-Related Macular Degeneration Screening Algorithms.

Amitha Domalpally, Emily Y Chew, Malvina B Eydelman, Tiarnán D L Keenan, Pearse A Keane, Aaron Y Lee, Cecilia S Lee, Eleonora M Lad, Jennifer I Lim, Anat Lowenstein and 3 more

Abstract readValidation Study
In one paragraph

Article in Ophthalmology, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Amitha DomalpallyWisconsin Reading Center, Department of Ophthalmology and Visual Sciences, University of Wisconsin-Madison, Madison, Wisconsin. Electronic address: domalpally@wisc.edu.
Emily Y ChewDivision of Epidemiology and Clinical Applications, National Eye Institute, National Institutes of Health, Bethesda, Maryland.
Malvina B EydelmanCollaborative Community on Ophthalmic Innovation, Reston, Virginia.
Tiarnán D L KeenanDivision of Epidemiology and Clinical Applications, National Eye Institute, National Institutes of Health, Bethesda, Maryland.
Pearse A KeaneNIHR Biomedical Research Centre at Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, London, United Kingdom.
Aaron Y LeeDepartment of Ophthalmology and Visual Science, Washington University in St Louis, Saint Louis, Missouri.
Cecilia S LeeDepartment of Ophthalmology and Visual Science, Washington University in St Louis, Saint Louis, Missouri.
Eleonora M LadDepartment of Ophthalmology, Duke University Medical Center, Durham, North Carolina.
Jennifer I LimDepartment of Ophthalmology and Visual Sciences, University of Illinois at Chicago, Chicago, Illinois.
Anat LowensteinDepartment of Ophthalmology and Optometry, Tel Aviv Medical Center, Tel Aviv, Israel.
Ursula Schmidt-ErfurthMedical University of Vienna, Vienna, Austria.
Michael D AbramoffDepartment of Ophthalmology and Visual Sciences, Electrical and Computer Engineering, University of Iowa, Iowa City, Iowa.
Collaborative Community for Ophthalmic Imaging Executive Committee and the Working Group for Artificial Intelligence in Age-related Macular Degeneration

Funding

Stanford Vision Research CoreP30EY026877 · NEI · STANFORD UNIVERSITY · PI Jeffrey L Goldberg · 2017 to 2026
$8.0M
Intramural NIH HHS Z99 EY999999NEI NIH HHS P30 EY026877
6 · The paper itself

Abstract

purposeArtificial intelligence (AI)-based screening models hold promise for identifying individuals with undiagnosed age-related macular degeneration (AMD) in nonspecialist settings. A standardized reference framework for image labeling is needed to enable consistent training, validation, and deployment of AI-based screening algorithms. The goal of the present study was to establish expert consensus on an image-based reference standard for labeling AMD.

designModified Delphi consensus study.

participantsFellowship-trained retina specialists, ophthalmologists, AI specialists, and imaging specialists.

methodsA prespecified Delphi process was conducted using structured surveys. Over 2 rounds, panelists assessed opinions on existing reference standards, including the Age-Related Eye Disease Study scale and Beckman scale, as well as imaging methods such as color, OCT, and autofluorescence. The surveys also evaluated imaging features of AMD, including drusen, pseudodrusen, and pigment changes, as well as referral criteria. Consensus was defined using a 9-point Likert scale, with predefined statistical thresholds for agreement.

main outcome measuresAgreement on key elements of a reference standard.

resultsConsensus was reached on adopting the Beckman classification as the level 1 reference standard (median score, 8; agreement). OCT use for identifying key AMD features, including drusen, geographic atrophy (GA), and choroidal neovascularization, also reached consensus (median scores, 8.5-9; agreement). Pigment change detection did not reach consensus (median, 7.5; uncertain), and screening age thresholds showed nonconsensus (median, 8; uncertain). Referral thresholds reached consensus, including urgent referral for neovascular AMD and nonurgent referral for GA and intermediate AMD (median, 9; agreement).

conclusionsThis study defined a consensus-based reference standard for labeling AMD from images for AI-based screening. These recommendations are intended to support consistent AI model development and evaluation, while remaining distinct from clinical practice guidelines. FINANCIAL DISCLOSURE(S): Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Indexed as

AlgorithmsArtificial IntelligenceMacular DegenerationMass ScreeningConsensusDelphi TechniqueFluorescein AngiographyHumansReference StandardsTomography, Optical CoherenceAge-related macular degenerationAI screeningReference standardRetinal imaging

Identifiers

PMID41999903
PMCPMC13498439

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.