Evidence map›Paper›PMID 37558406›Full record

ReviewBMJ open ophthalmology2023

Fairness and generalisability in deep learning of retinopathy of prematurity screening algorithms: a literature review.

Luis Filipe Nakayama, William Greig Mitchell, Lucas Zago Ribeiro, Robyn Gayle Dychiao, Warachaya Phanphruk, Leo Anthony Celi, Khumbo Kalua, Alvina Pauline Dy Santiago, Caio Vinicius Saito Regatieri, Nilva Simeren Bueno Moraes

Open access · goldAbstract readReview
In one paragraph

Review in BMJ open ophthalmology, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
2.1field-weighted citation impact, top 13% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 9 citations in OpenAlex.

  1. Article
  2. Article
  3. Review
  4. Review
  5. Body Surface Potential Mapping: A Perspective on High-Density Cutaneous Electrophysiology.Advanced science (Weinheim, Baden-Wurttemberg, Germany) · 2025
    Review
  6. Article
  7. Article
  8. BRSET: A Brazilian Multilabel Ophthalmological Dataset of Retina Fundus Photos.medRxiv : the preprint server for health sciences · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 8 institutions in 6 countries.

Luis Filipe NakayamaLaboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA luisnaka@mit.edu.ORCID 0000-0002-6847-6748
William Greig MitchellDepartment of Ophthalmology, The Royal Victorian Eye and Ear Hospital, East Melbourne, Victoria, Australia.
Lucas Zago RibeiroDepartment of Ophthalmology, Sao Paulo Federal University, Sao Paulo, Brazil.
Robyn Gayle DychiaoUniversity of the Philippines Manila College of Medicine, Manila, Philippines.
Warachaya PhanphrukDepartment of Ophthalmology, Khon Kaen University, Nai Mueang, Thailand.
Leo Anthony CeliLaboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA.
Khumbo KaluaDepartment of Ophthalmology, Blantyre Institute for Community Ophthalmology, BICO, Blantyre, Malawi.
Alvina Pauline Dy SantiagoDepartment of Ophthalmology and Visual Sciences, Philippine General Hospital, Manila, Philippines.ORCID 0000-0003-2917-5683
Caio Vinicius Saito RegatieriDepartment of Ophthalmology, Sao Paulo Federal University, Sao Paulo, Brazil.
Nilva Simeren Bueno MoraesDepartment of Ophthalmology, Sao Paulo Federal University, Sao Paulo, Brazil.
Universidade Federal de São Paulo · BRBlantyre Institute for Community Ophthalmology · MWHarvard University · USKhon Kaen University · THMassachusetts Institute of Technology · USPhilippine General Hospital · PHThe Royal Victorian Eye & Ear Hospital · AUUniversity of the Philippines Manila · PH

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundRetinopathy of prematurity (ROP) is a vasoproliferative disease responsible for more than 30 000 blind children worldwide. Its diagnosis and treatment are challenging due to the lack of specialists, divergent diagnostic concordance and variation in classification standards. While artificial intelligence (AI) can address the shortage of professionals and provide more cost-effective management, its development needs fairness, generalisability and bias controls prior to deployment to avoid producing harmful unpredictable results. This review aims to compare AI and ROP study's characteristics, fairness and generalisability efforts.

methodsOur review yielded 220 articles, of which 18 were included after full-text assessment. The articles were classified into ROP severity grading, plus detection, detecting treatment requiring, ROP prediction and detection of retinal zones.

resultsAll the article's authors and included patients are from middle-income and high-income countries, with no low-income countries, South America, Australia and Africa Continents representation.Code is available in two articles and in one on request, while data are not available in any article. 88.9% of the studies use the same retinal camera. In two articles, patients' sex was described, but none applied a bias control in their models.

conclusionThe reviewed articles included 180 228 images and reported good metrics, but fairness, generalisability and bias control remained limited. Reproducibility is also a critical limitation, with few articles sharing codes and none sharing data. Fair and generalisable ROP and AI studies are needed that include diverse datasets, data and code sharing, collaborative research, and bias control to avoid unpredictable and harmful deployments.

Indexed as

Deep LearningRetinopathy of PrematurityAlgorithmsArtificial IntelligenceChildHumansInfant, NewbornReproducibility of ResultsImagingRetina

Identifiers

PMID37558406
PMCPMC10414056
OpenAlexW4385690477

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.