Evidence map›Paper›PMID 31419240›Full record

ArticlePloS one2019

Validation of automated artificial intelligence segmentation of optical coherence tomography images.

Peter M Maloca, Aaron Y Lee, Emanuel R de Carvalho, Mali Okada, Katrin Fasler, Irene Leung, Beat Hörmann, Pascal Kaiser, Susanne Suter, Pascal W Hasler and 6 more

Open access · goldAbstract readValidation Study
In one paragraph

Article in PloS one, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 32 papers.

0numbers the graph read from it
0cells of the map it votes in
32citing papers in PubMed
8.4field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

32 citing papers in PubMed, 76 citations in OpenAlex.

  1. Trial
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Clinically applicable deep learning-based decision aids for treatment of neovascular AMD.Graefe's archive for clinical and experimental ophthalmology = Albrecht von Graefes Archiv fur klinische und experimentelle Ophthalmologie · 2022
    Article
  18. Article
  19. Review
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors at 8 institutions in 5 countries.

Peter M MalocaInstitute of Molecular and Clinical Ophthalmology Basel (IOB), Basel, Switzerland.ORCID 0000-0002-4794-5859
Aaron Y LeeDepartment of Ophthalmology, Puget Sound Veteran Affairs, Seattle, Washington, United States of America.
Emanuel R de CarvalhoMoorfields Eye Hospital NHS Foundation Trust, London, United Kingdom.
Mali OkadaRoyal Victorian Eye and Ear Hospital, Melbourne, Victoria, Australia.
Katrin FaslerMoorfields Eye Hospital NHS Foundation Trust, London, United Kingdom.ORCID 0000-0002-0348-961X
Irene LeungMoorfields Ophthalmic Reading Centre, London, United Kingdom.
Beat HörmannSupercomputing Systems, Zurich, Switzerland.
Pascal KaiserSupercomputing Systems, Zurich, Switzerland.
Susanne SuterSupercomputing Systems, Zurich, Switzerland.
Pascal W HaslerOCTlab, Department of Ophthalmology, University Hospital Basel, Basel, Switzerland.
Javier Zarranz-VenturaInstitut Clínic d'Oftalmologia, Hospital Clínic de Barcelona, Barcelona, Spain.ORCID 0000-0003-2338-8143
Catherine EganMoorfields Eye Hospital NHS Foundation Trust, London, United Kingdom.
Tjebo F C HeerenMoorfields Eye Hospital NHS Foundation Trust, London, United Kingdom.ORCID 0000-0001-5297-2301
Konstantinos BalaskasMoorfields Eye Hospital NHS Foundation Trust, London, United Kingdom.
Adnan TufailMoorfields Eye Hospital NHS Foundation Trust, London, United Kingdom.
Hendrik P N SchollInstitute of Molecular and Clinical Ophthalmology Basel (IOB), Basel, Switzerland.
Moorfields Eye Hospital NHS Foundation Trust · GBSupercomputing Systems (Switzerland) · CHHospital Clínic de Barcelona · ESJohns Hopkins University · USMoorfields Eye Hospital · GBThe Royal Victorian Eye & Ear Hospital · AUUniversity of Basel · CHUniversity of Washington · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeTo benchmark the human and machine performance of spectral-domain (SD) and swept-source (SS) optical coherence tomography (OCT) image segmentation, i.e., pixel-wise classification, for the compartments vitreous, retina, choroid, sclera.

methodsA convolutional neural network (CNN) was trained on OCT B-scan images annotated by a senior ground truth expert retina specialist to segment the posterior eye compartments. Independent benchmark data sets (30 SDOCT and 30 SSOCT) were manually segmented by three classes of graders with varying levels of ophthalmic proficiencies. Nine graders contributed to benchmark an additional 60 images in three consecutive runs. Inter-human and intra-human class agreement was measured and compared to the CNN results.

resultsThe CNN training data consisted of a total of 6210 manually segmented images derived from 2070 B-scans (1046 SDOCT and 1024 SSOCT; 630 C-Scans). The CNN segmentation revealed a high agreement with all grader groups. For all compartments and groups, the mean Intersection over Union (IOU) score of CNN compartmentalization versus group graders' compartmentalization was higher than the mean score for intra-grader group comparison.

conclusionThe proposed deep learning segmentation algorithm (CNN) for automated eye compartment segmentation in OCT B-scans (SDOCT and SSOCT) is on par with manual segmentations by human graders.

Indexed as

AlgorithmsArtificial IntelligenceBenchmarkingChoroidDeep LearningHumansImage Interpretation, Computer-AssistedNeural Networks, ComputerObserver VariationRetinaScleraTomography, Optical CoherenceVitreous Body

Identifiers

PMID31419240
PMCPMC6697318
OpenAlexW2967173855

What OpenQuestion holds

Textmetadata
LicenceCC0
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.