Evidence map›Paper›PMID 38135351›Full record

ArticleBMJ open ophthalmology2023

Real-world evaluation of smartphone-based artificial intelligence to screen for diabetic retinopathy in Dominica: a clinical validation study.

Oliver Kemp, Covadonga Bascaran, Edyta Cartwright, Lauren McQuillan, Nanda Matthew, Hazel Shillingford-Ricketts, Marcia Zondervan, Allen Foster, Matthew Burton

Open access · goldAbstract read
PubMed Publisher
In one paragraph

Article in BMJ open ophthalmology, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
2.1field-weighted citation impact, top 12% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 9 citations in OpenAlex.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Article
  6. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 4 institutions in 2 countries.

Oliver KempLondon School of Hygiene and Tropical Medicine, London, UK.
Covadonga BascaranLondon School of Hygiene and Tropical Medicine, London, UK covadonga.bascaran@lshtm.ac.uk.ORCID 0000-0002-5662-3325
Edyta CartwrightUniversity Hospitals Sussex NHS Foundation Trust, Worthing, UK.
Lauren McQuillanUniversity Hospitals Sussex NHS Foundation Trust, Worthing, UK.
Nanda MatthewDominica China Friendship Hospital, Roseau, Dominica.
Hazel Shillingford-RickettsDominica China Friendship Hospital, Roseau, Dominica.
Marcia ZondervanLondon School of Hygiene and Tropical Medicine, London, UK.
Allen FosterLondon School of Hygiene and Tropical Medicine, London, UK.
Matthew BurtonLondon School of Hygiene and Tropical Medicine, London, UK.
London School of Hygiene & Tropical Medicine · GBDominica State College · DMUniversity Hospitals Sussex NHS Foundation Trust · GBMoorfields Eye Hospital NHS Foundation Trust · GB

Funding

Wellcome Trust
6 · The paper itself

Abstract

objectiveSeveral artificial intelligence (AI) systems for diabetic retinopathy screening have been validated but there is limited evidence on their performance in real-world settings. This study aimed to assess the performance of an AI software deployed within the diabetic retinopathy screening programme in Dominica. METHODS AND ANALYSIS: We conducted a prospective, cross-sectional clinical validation study. Patients with diabetes aged 18 years and above attending the diabetic retinopathy screening in primary care facilities in Dominica from 5 June to 3 July 2021 were enrolled.Grading was done at the point of care by the field grader, followed by counselling and referral to the eye clinic. Images were then graded by an AI system. Sensitivity, specificity with 95% CIs and area under the curve (AUC) were calculated for comparing the AI to field grader as gold standard.

resultsA total of 587 participants were screened. The AI had a sensitivity and specificity for detecting referable diabetic retinopathy of 77.5% and 91.5% compared with the grader, for all participants, including ungradable images. The AUC was 0.8455. Excluding 52 participants deemed ungradable by the grader, the AI had a sensitivity and specificity of 81.4% and 91.5%, with an AUC of 0.9648.

conclusionThis study provides evidence that AI has the potential to be deployed to assist a diabetic screening programme in a middle-income real-world setting and perform with reasonable accuracy compared with a specialist grader.

Indexed as

Diabetes MellitusDiabetic RetinopathyArtificial IntelligenceCross-Sectional StudiesDominicaHumansProspective StudiesSmartphoneDiagnostic tests/InvestigationEye (Globe)Retina

Identifiers

PMID38135351
OpenAlexW4390115889

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.