Evidence map›Paper›PMID 36631567›Full record

ArticleScientific reports2023

Assessing the external validity of machine learning-based detection of glaucoma.

Chi Li, Jacqueline Chua, Florian Schwarzhans, Rahat Husain, Michaël J A Girard, Shivani Majithia, Yih-Chung Tham, Ching-Yu Cheng, Tin Aung, Georg Fischer and 6 more

Abstract read
In one paragraph

Article in Scientific reports, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors.

Chi Li *Singapore Eye Research Institute, Singapore National Eye Centre, 20 College Road, The Academia, Level 6, Discovery Tower, Singapore, 169856, Singapore.
Jacqueline Chua *Singapore Eye Research Institute, Singapore National Eye Centre, 20 College Road, The Academia, Level 6, Discovery Tower, Singapore, 169856, Singapore.
Florian SchwarzhansCenter for Medical Statistics Informatics and Intelligent Systems, Section for Medical Information Management, Medical University Vienna, Vienna, Austria.
Rahat HusainSingapore Eye Research Institute, Singapore National Eye Centre, 20 College Road, The Academia, Level 6, Discovery Tower, Singapore, 169856, Singapore.
Michaël J A GirardSingapore Eye Research Institute, Singapore National Eye Centre, 20 College Road, The Academia, Level 6, Discovery Tower, Singapore, 169856, Singapore.
Shivani MajithiaSingapore Eye Research Institute, Singapore National Eye Centre, 20 College Road, The Academia, Level 6, Discovery Tower, Singapore, 169856, Singapore.
Yih-Chung ThamSingapore Eye Research Institute, Singapore National Eye Centre, 20 College Road, The Academia, Level 6, Discovery Tower, Singapore, 169856, Singapore.
Ching-Yu ChengSingapore Eye Research Institute, Singapore National Eye Centre, 20 College Road, The Academia, Level 6, Discovery Tower, Singapore, 169856, Singapore.
Tin AungSingapore Eye Research Institute, Singapore National Eye Centre, 20 College Road, The Academia, Level 6, Discovery Tower, Singapore, 169856, Singapore.
Georg FischerCenter for Medical Statistics Informatics and Intelligent Systems, Section for Medical Information Management, Medical University Vienna, Vienna, Austria.
Clemens VassDepartment of Ophthalmology and Optometry, Medical University Vienna, Vienna, Austria.
Inna BujorCarol Davila University of Medicine and Pharmacy, Bucharest, Romania.
Chee Keong KwohSchool of Computer Science and Engineering, Nanyang Technological University, Singapore, Singapore.
Alina Popa-CherecheanuCarol Davila University of Medicine and Pharmacy, Bucharest, Romania.
Leopold SchmettererSingapore Eye Research Institute, Singapore National Eye Centre, 20 College Road, The Academia, Level 6, Discovery Tower, Singapore, 169856, Singapore.
Damon WongSingapore Eye Research Institute, Singapore National Eye Centre, 20 College Road, The Academia, Level 6, Discovery Tower, Singapore, 169856, Singapore. damon.wong@ntu.edu.sg.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Studies using machine learning (ML) approaches have reported high diagnostic accuracies for glaucoma detection. However, none assessed model performance across ethnicities. The aim of the study is to externally validate ML models for glaucoma detection from optical coherence tomography (OCT) data. We performed a prospective, cross-sectional study, where 514 Asians (257 glaucoma/257 controls) were enrolled to construct ML models for glaucoma detection, which was then tested on 356 Asians (183 glaucoma/173 controls) and 138 Caucasians (57 glaucoma/81 controls). We used the retinal nerve fibre layer (RNFL) thickness values produced by the compensation model, which is a multiple regression model fitted on healthy subjects that corrects the RNFL profile for anatomical factors and the original OCT data (measured) to build two classifiers, respectively. Both the ML models (area under the receiver operating [AUC] = 0.96 and accuracy = 92%) outperformed the measured data (AUC = 0.93; P < 0.001) for glaucoma detection in the Asian dataset. However, in the Caucasian dataset, the ML model trained with compensated data (AUC = 0.93 and accuracy = 84%) outperformed the ML model trained with original data (AUC = 0.83 and accuracy = 79%; P < 0.001) and measured data (AUC = 0.82; P < 0.001) for glaucoma detection. The performance with the ML model trained on measured data showed poor reproducibility across different datasets, whereas the performance of the compensated data was maintained. Care must be taken when ML models are applied to patient cohorts of different ethnicities.

Indexed as

GlaucomaRetinal Ganglion CellsCross-Sectional StudiesHumansIntraocular PressureMachine LearningProspective StudiesReproducibility of ResultsROC CurveSensitivity and SpecificityTomography, Optical Coherence

Identifiers

PMID36631567
PMCPMC9834286

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.