Evidence map›Paper›PMID 32598950›Full record

Trial reportOphthalmology2021

Retinal Specialist versus Artificial Intelligence Detection of Retinal Fluid from OCT: Age-Related Eye Disease Study 2: 10-Year Follow-On Study.

Tiarnan D L Keenan, Traci E Clemons, Amitha Domalpally, Michael J Elman, Moshe Havilio, Elvira Agrón, Gidi Benyamini, Emily Y Chew

Open access · greenAbstract readMulticenter StudyRandomized Controlled Trial
In one paragraph

Trial report in Ophthalmology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 47 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
47citing papers in PubMed, 1 pooled it
6.2field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

47 citing papers in PubMed, 1 synthesis or guideline pooled it, 90 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Review
  14. Review
  15. Article
  16. Article
  17. Advances in artificial intelligence-based technologies for increasing the quality of medical products.Daru : journal of Faculty of Pharmacy, Tehran University of Medical Sciences · 2024
    Review
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 5 institutions in 2 countries.

Tiarnan D L KeenanDivision of Epidemiology and Clinical Applications, National Eye Institute, National Institutes of Health, Bethesda, Maryland. Electronic address: tiarnan.keenan@nih.gov.
Traci E ClemonsThe EMMES Company, LLC, Rockville, Maryland.
Amitha DomalpallyFundus Photograph Reading Center, University of Wisconsin, Madison, Wisconsin.
Michael J ElmanElman Retina Group, Baltimore, Maryland.
Moshe HavilioNotal Vision Ltd., Tel Aviv, Israel.
Elvira AgrónDivision of Epidemiology and Clinical Applications, National Eye Institute, National Institutes of Health, Bethesda, Maryland.
Gidi BenyaminiNotal Vision Ltd., Tel Aviv, Israel.
Emily Y ChewDivision of Epidemiology and Clinical Applications, National Eye Institute, National Institutes of Health, Bethesda, Maryland.
National Institutes of Health · USNotal Vision (Israel) · ILElman Retina Group · USEmmes (United States) · USUniversity of Wisconsin–Madison · US

Funding

The Age-Related Eye Disease Study 2 (AREDS2)ZIAEY000485 · NEI · NATIONAL EYE INSTITUTE · PI CHEW, EMILY Y · 2009 to 2015
$990k
Age-Related Eye Disease Follow-up Study (AREDS) Follow-up StudyZIAEY000489 · NEI · NATIONAL EYE INSTITUTE · PI CHEW, EMILY Y · 2009 to 2025
$639k
Intramural NIH HHS ZIA EY000485NIH HHS HHSN263201300005CNIH HHS HHSN263201300005G
6 · The paper itself

Abstract

purposeTo evaluate the performance of retinal specialists in detecting retinal fluid presence in spectral domain OCT (SD-OCT) scans from eyes with age-related macular degeneration (AMD) and compare performance with an artificial intelligence algorithm.

designProspective comparison of retinal fluid grades from human retinal specialists and the Notal OCT Analyzer (NOA) on SD-OCT scans from 2 common devices.

participantsA total of 1127 eyes of 651 Age-Related Eye Disease Study 2 10-year Follow-On Study (AREDS2-10Y) participants with SD-OCT scans graded by reading center graders (as the ground truth).

methodsThe AREDS2-10Y investigators graded each SD-OCT scan for the presence/absence of intraretinal and subretinal fluid. Separately, the same scans were graded by the NOA.

main outcome measuresAccuracy (primary), sensitivity, specificity, precision, and F1-score.

resultsOf the 1127 eyes, retinal fluid was present in 32.8%. For detecting retinal fluid, the investigators had an accuracy of 0.805 (95% confidence interval [CI], 0.780-0.828), a sensitivity of 0.468 (95% CI, 0.416-0.520), a specificity of 0.970 (95% CI, 0.955-0.981). The NOA metrics were 0.851 (95% CI, 0.829-0.871), 0.822 (95% CI, 0.779-0.859), 0.865 (95% CI, 0.839-0.889), respectively. For detecting intraretinal fluid, the investigator metrics were 0.815 (95% CI, 0.792-0.837), 0.403 (95% CI, 0.349-0.459), and 0.978 (95% CI, 0.966-0.987); the NOA metrics were 0.877 (95% CI, 0.857-0.896), 0.763 (95% CI, 0.713-0.808), and 0.922 (95% CI, 0.902-0.940), respectively. For detecting subretinal fluid, the investigator metrics were 0.946 (95% CI, 0.931-0.958), 0.583 (95% CI, 0.471-0.690), and 0.973 (95% CI, 0.962-0.982); the NOA metrics were 0.863 (95% CI, 0.842-0.882), 0.940 (95% CI, 0.867-0.980), and 0.857 (95% CI, 0.835-0.877), respectively.

conclusionsIn this large and challenging sample of SD-OCT scans obtained with 2 common devices, retinal specialists had imperfect accuracy and low sensitivity in detecting retinal fluid. This was particularly true for intraretinal fluid and difficult cases (with lower fluid volumes appearing on fewer B-scans). Artificial intelligence-based detection achieved a higher level of accuracy. This software tool could assist physicians in detecting retinal fluid, which is important for diagnostic, re-treatment, and prognostic tasks.

Indexed as

Artificial IntelligenceOphthalmologistsAged, 80 and overFemaleFollow-Up StudiesHumansMacular DegenerationMaleProspective StudiesSubretinal FluidTime FactorsTomography, Optical Coherence

Identifiers

PMID32598950
PMCPMC8371700
OpenAlexW3046617692

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.