Evidence map›Paper›PMID 32380115›Full record

ArticleOphthalmology. Retina2020

Variability in Plus Disease Identified Using a Deep Learning-Based Retinopathy of Prematurity Severity Scale.

Rene Y Choi, James M Brown, Jayashree Kalpathy-Cramer, R V Paul Chan, Susan Ostmo, Michael F Chiang, J Peter Campbell, Imaging and Informatics in Retinopathy of Prematurity Consortium

Open access · greenAbstract readMulticenter Study
In one paragraph

Article in Ophthalmology. Retina, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed, 2 pooled it
2.1field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed, 2 syntheses or guidelines pooled it, 21 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Observational
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Performance of deep-learning artificial intelligence algorithms in detecting retinopathy of prematurity: A systematic review.Saudi journal of ophthalmology : official journal of the Saudi Ophthalmological Society
    Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

8 authors at 3 institutions in 2 countries.

Rene Y ChoiDepartment of Ophthalmology, Casey Eye Institute, Oregon Health & Science University, Portland, Oregon.
James M BrownAthinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, Massachusetts; Department of Computer Science, University of Lincoln, Lincoln, United Kingdom.
Jayashree Kalpathy-CramerAthinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, Massachusetts.
R V Paul ChanDepartment of Ophthalmology and Visual Sciences, Illinois Eye and Ear Infirmary, University of Illinois at Chicago, Chicago, Illinois.
Susan OstmoDepartment of Ophthalmology, Casey Eye Institute, Oregon Health & Science University, Portland, Oregon.
Michael F ChiangDepartment of Ophthalmology, Casey Eye Institute, Oregon Health & Science University, Portland, Oregon; Department of Medical Informatics and Clinical Epidemiology, Oregon Health & Science University, Portland, Oregon.
J Peter CampbellDepartment of Ophthalmology, Casey Eye Institute, Oregon Health & Science University, Portland, Oregon. Electronic address: campbelp@ohsu.edu.
Imaging and Informatics in Retinopathy of Prematurity Consortium
Oregon Health & Science University · USMassachusetts General Hospital · USUniversity of Illinois Chicago · US

Funding

Proteomics CoreP30EY010572 · NEI · OREGON HEALTH & SCIENCE UNIVERSITY · PI John Peter Campbell · 1995 to 2026
$19.4M
Clinical and Genetic Analysis of Retinopathy of PrematurityR01EY019474 · NEI · OREGON HEALTH & SCIENCE UNIVERSITY · PI CAMPBELL, JOHN PETER · 2010 to 2020
$7.0M
Translational Vision Science Research at Oregon Health & Science UniversityT32EY023211 · NEI · OREGON HEALTH & SCIENCE UNIVERSITY · PI Yali Jia, Kate E Keller · 2013 to 2026
$2.4M
Mentored Vision Clinician-Scientist Program at OHSUK12EY027720 · NEI · OREGON HEALTH & SCIENCE UNIVERSITY · PI David Huang · 2018 to 2026
$2.2M
Clinical and genetic analysis of retinopathy of prematurityR01HD107493 · NICHD · OREGON HEALTH & SCIENCE UNIVERSITY · PI CAMPBELL, JOHN PETER · 2021 to 2023
$1.8M
NEI NIH HHS K12 EY027720NEI NIH HHS P30 EY010572NEI NIH HHS R01 EY019474NEI NIH HHS T32 EY023211NICHD NIH HHS R01 HD107493
6 · The paper itself

Abstract

purposeRetinopathy of prematurity is a leading cause of childhood blindness worldwide, but clinical diagnosis is subjective, which leads to treatment differences. Our goal was to determine objective differences in the diagnosis of plus disease between clinicians using an automated retinopathy of prematurity (ROP) vascular severity score.

designThis retrospective cohort study used data from the Imaging and Informatics in ROP Consortium, which comprises 8 tertiary care centers in North America. Fundus photographs of all infants undergoing ROP screening examinations between July 1, 2011, and December 31, 2016, were obtained.

participantsInfants meeting ROP screening criteria who were diagnosed with plus disease and treatment initiated by an examining physician based on ophthalmoscopic examination results.

methodsAn ROP severity score (1-9) was generated for each image using a deep learning (DL) algorithm.

main outcome measuresThe mean, median, and range of ROP vascular severity scores overall and for each examiner when the diagnosis of plus disease was made.

resultsA total of 5255 clinical examinations in 871 babies were analyzed. Of these, 168 eyes were diagnosed with plus disease by 11 different examiners and were included in the study. The mean ± standard deviation vascular severity score for patients diagnosed with plus disease was 7.4 ± 1.9, median was 8.5 (interquartile range, 5.8-8.9), and range was 1.1 to 9.0. Within some examiners, variability in the level of vascular severity diagnosed as plus disease was present, and 1 examiner routinely diagnosed plus disease in patients with less severe disease than the other examiners (P < 0.01).

conclusionsWe observed variability both between and within examiners in the diagnosis of plus disease using DL. Prospective evaluation of clinical trial data using an objective measurement of vascular severity may help to define better the minimum necessary level of vascular severity for the diagnosis of plus disease or how other clinical features such as zone, stage, and extent of peripheral disease ought to be incorporated in treatment decisions.

Indexed as

AlgorithmsDeep LearningFemaleGestational AgeHumansInfant, NewbornMaleRetinopathy of PrematurityRetrospective StudiesSeverity of Illness Index

Identifiers

PMID32380115
PMCPMC7867469
OpenAlexW3023593337

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.