Evidence map›Paper›PMID 30470715›Full record

ArticleThe British journal of ophthalmology2018

Evaluation of a deep learning image assessment system for detecting severe retinopathy of prematurity.

Travis K Redd, John Peter Campbell, James M Brown, Sang Jin Kim, Susan Ostmo, Robison Vernon Paul Chan, Jennifer Dy, Deniz Erdogmus, Stratis Ioannidis, Jayashree Kalpathy-Cramer and 2 more

Open access · bronzeAbstract read
In one paragraph

Article in The British journal of ophthalmology, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 81 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
81citing papers in PubMed, 1 pooled it
11.0field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

81 citing papers in PubMed, 1 synthesis or guideline pooled it, 177 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Review
  4. Article
  5. Article
  6. Review
  7. Review
  8. External validation of an artificial intelligence-based model for retinopathy of prematurity screening using Phoenix ICON retinal images.Journal of AAPOS : the official publication of the American Association for Pediatric Ophthalmology and Strabismus · 2025
    Article
  9. Article
  10. Review
  11. Review
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article

21 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors at 6 institutions in 2 countries.

Travis K ReddDepartment of Ophthalmology, Casey Eye Institute, Oregon Health & Science University, Portland, Oregon, USA.
John Peter CampbellDepartment of Ophthalmology, Casey Eye Institute, Oregon Health & Science University, Portland, Oregon, USA.
James M BrownAthinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, Maryland, USA.
Sang Jin KimDepartment of Ophthalmology, Casey Eye Institute, Oregon Health & Science University, Portland, Oregon, USA.
Susan OstmoDepartment of Ophthalmology, Casey Eye Institute, Oregon Health & Science University, Portland, Oregon, USA.
Robison Vernon Paul ChanDepartment of Ophthalmology and Visual Sciences, Illinois Eye and Ear Infirmary, University of Illinois at Chicago, Chicago, Illinois, USA.
Jennifer DyDepartment of Electrical and Computer Engineering, Northeastern University, Boston, Massachusetts, USA.
Deniz ErdogmusDepartment of Electrical and Computer Engineering, Northeastern University, Boston, Massachusetts, USA.
Stratis IoannidisDepartment of Electrical and Computer Engineering, Northeastern University, Boston, Massachusetts, USA.
Jayashree Kalpathy-CramerAthinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, Maryland, USA.
Michael F ChiangDepartment of Ophthalmology, Casey Eye Institute, Oregon Health & Science University, Portland, Oregon, USA chiangm@ohsu.edu.
Imaging and Informatics in Retinopathy of Prematurity (i-ROP) Research Consortium
Oregon Health & Science University · USNortheastern University · USAthinoula A. Martinos Center for Biomedical Imaging · USMassachusetts General Hospital · USSamsung Medical Center · KRUniversity of Illinois Chicago · US

Funding

Proteomics CoreP30EY010572 · NEI · OREGON HEALTH & SCIENCE UNIVERSITY · PI TED S ACOTT · 1995 to 2026
$19.4M
Translational Core for Therapeutic and Diagnostic DevelopmentP30EY001792 · NEI · UNIVERSITY OF ILLINOIS AT CHICAGO · PI MCANANY, JAMES JASON · 1985 to 2025
$14.8M
Clinical and Genetic Analysis of Retinopathy of PrematurityR01EY019474 · NEI · OREGON HEALTH & SCIENCE UNIVERSITY · PI CAMPBELL, JOHN PETER · 2010 to 2020
$7.0M
Mentored Vision Clinician-Scientist Program at OHSUK12EY027720 · NEI · OREGON HEALTH & SCIENCE UNIVERSITY · PI David Huang · 2018 to 2026
$2.2M
Clinical and genetic analysis of retinopathy of prematurityR01HD107493 · NICHD · OREGON HEALTH & SCIENCE UNIVERSITY · PI CAMPBELL, JOHN PETER · 2021 to 2023
$1.8M
NEI NIH HHS K12 EY027720NEI NIH HHS P30 EY001792NEI NIH HHS P30 EY010572NEI NIH HHS R01 EY019474NICHD NIH HHS R01 HD107493
6 · The paper itself

Abstract

backgroundPrior work has demonstrated the near-perfect accuracy of a deep learning retinal image analysis system for diagnosing plus disease in retinopathy of prematurity (ROP). Here we assess the screening potential of this scoring system by determining its ability to detect all components of ROP diagnosis.

methodsClinical examination and fundus photography were performed at seven participating centres. A deep learning system was trained to detect plus disease, generating a quantitative assessment of retinal vascular abnormality (the i-ROP plus score) on a 1-9 scale. Overall ROP disease category was established using a consensus reference standard diagnosis combining clinical and image-based diagnosis. Experts then ranked ordered a second data set of 100 posterior images according to overall ROP severity.

results4861 examinations from 870 infants were analysed. 155 examinations (3%) had a reference standard diagnosis of type 1 ROP. The i-ROP deep learning (DL) vascular severity score had an area under the receiver operating curve of 0.960 for detecting type 1 ROP. Establishing a threshold i-ROP DL score of 3 conferred 94% sensitivity, 79% specificity, 13% positive predictive value and 99.7% negative predictive value for type 1 ROP. There was strong correlation between expert rank ordering of overall ROP severity and the i-ROP DL vascular severity score (Spearman correlation coefficient=0.93; p<0.0001).

conclusionThe i-ROP DL system accurately identifies diagnostic categories and overall disease severity in an automated fashion, after being trained only on posterior pole vascular morphology. These data provide proof of concept that a deep learning screening platform could improve objectivity of ROP diagnosis and accessibility of screening.

Indexed as

child health (paediatrics)public healthretinatelemedicine

Identifiers

PMID30470715
PMCPMC7880608
OpenAlexW2901661131

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.