Evidence map›Paper›PMID 36746615›Full record

ArticleThe British journal of ophthalmology2024

Validation of a deep learning system for the detection of diabetic retinopathy in Indigenous Australians.

Mark A Chia, Fred Hersch, Rory Sayres, Pinal Bavishi, Richa Tiwari, Pearse A Keane, Angus W Turner

Open access · hybridAbstract read
In one paragraph

Article in The British journal of ophthalmology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
4.1field-weighted citation impact, top 6% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 18 citations in OpenAlex.

  1. Article
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Foundation models in ophthalmology.The British journal of ophthalmology · 2024
    Review
  9. Review
  10. Review
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 3 institutions in 3 countries.

Mark A ChiaInstitute of Ophthalmology, University College London, London, UK mark.a.chia@outlook.com.ORCID 0000-0003-0339-5186
Fred HerschGoogle Health, Palo Alto, California, USA.
Rory SayresGoogle Health, Palo Alto, California, USA.
Pinal BavishiGoogle Health, Palo Alto, California, USA.
Richa TiwariGoogle Health, Palo Alto, California, USA.
Pearse A KeaneInstitute of Ophthalmology, University College London, London, UK.ORCID 0000-0002-9239-745X
Angus W TurnerLions Outback Vision, Lions Eye Institute, Nedlands, Western Australia, Australia.ORCID 0000-0001-5949-7451
Google (United States) · USLions Eye Institute · AUMoorfields Eye Hospital NHS Foundation Trust · GB

Funding

Medical Research Council MR/T019050/1
6 · The paper itself

Abstract

BACKGROUND/

aimsDeep learning systems (DLSs) for diabetic retinopathy (DR) detection show promising results but can underperform in racial and ethnic minority groups, therefore external validation within these populations is critical for health equity. This study evaluates the performance of a DLS for DR detection among Indigenous Australians, an understudied ethnic group who suffer disproportionately from DR-related blindness.

methodsWe performed a retrospective external validation study comparing the performance of a DLS against a retinal specialist for the detection of more-than-mild DR (mtmDR), vision-threatening DR (vtDR) and all-cause referable DR. The validation set consisted of 1682 consecutive, single-field, macula-centred retinal photographs from 864 patients with diabetes (mean age 54.9 years, 52.4% women) at an Indigenous primary care service in Perth, Australia. Three-person adjudication by a panel of specialists served as the reference standard.

resultsFor mtmDR detection, sensitivity of the DLS was superior to the retina specialist (98.0% (95% CI, 96.5 to 99.4) vs 87.1% (95% CI, 83.6 to 90.6), McNemar's test p<0.001) with a small reduction in specificity (95.1% (95% CI, 93.6 to 96.4) vs 97.0% (95% CI, 95.9 to 98.0), p=0.006). For vtDR, the DLS's sensitivity was again superior to the human grader (96.2% (95% CI, 93.4 to 98.6) vs 84.4% (95% CI, 79.7 to 89.2), p<0.001) with a slight drop in specificity (95.8% (95% CI, 94.6 to 96.9) vs 97.8% (95% CI, 96.9 to 98.6), p=0.002). For all-cause referable DR, there was a substantial increase in sensitivity (93.7% (95% CI, 91.8 to 95.5) vs 74.4% (95% CI, 71.1 to 77.5), p<0.001) and a smaller reduction in specificity (91.7% (95% CI, 90.0 to 93.3) vs 96.3% (95% CI, 95.2 to 97.4), p<0.001).

conclusionThe DLS showed improved sensitivity and similar specificity compared with a retina specialist for DR detection. This demonstrates its potential to support DR screening among Indigenous Australians, an underserved population with a high burden of diabetic eye disease.

Indexed as

Australasian PeopleDeep LearningDiabetes MellitusDiabetic RetinopathyAustraliaAustralian Aboriginal and Torres Strait Islander PeoplesEthnicityFemaleHumansMaleMiddle AgedMinority GroupsRetrospective StudiesDiagnostic tests/InvestigationImagingRetina

Identifiers

PMID36746615
PMCPMC10850716
OpenAlexW4319304754

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.