Evidence map›Paper›PMID 38212607›Full record

ArticleNPJ digital medicine2024

The performance of a deep learning system in assisting junior ophthalmologists in diagnosing 13 major fundus diseases: a prospective multi-center clinical trial.

Bing Li, Huan Chen, Weihong Yu, Ming Zhang, Fang Lu, Jingxue Ma, Yuhua Hao, Xiaorong Li, Bojie Hu, Lijun Shen and 6 more

Registry-linked trialOpen access · goldAbstract read
In one paragraph

Article in NPJ digital medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT04723160 (A Prospective, Multicenter, Blinded Reading, Self Controlled, Superiority Priority Clinical Trial of Assisted Fundus Image Diagnosis Software for the Diagnosis of Multiple Eye Fundus Diseases), which is not on this map. Cited by 16 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed, 1 pooled it
8.9field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04723160 completednot on this map

A Prospective, Multicenter, Blinded Reading, Self Controlled, Superiority Priority Clinical Trial of Assisted Fundus Image Diagnosis Software for the Diagnosis of Multiple Eye Fundus Diseases

TypeobservationalSponsorVisionary Intelligence Ltd.Ran2020 to 2021Enrolled748ConditionsDiabetic Retinopathy, Retinal Vein Occlusion, Retinal Artery Occlusion, Central Serous ChorioretinopathyArmsSoftware assisted imaging diagnosis
3 · Its place in the literature

Who cites it

16 citing papers in PubMed, 1 synthesis or guideline pooled it, 22 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Review
  15. Artificial intelligence in corneal diseases: A narrative review.Contact lens & anterior eye : the journal of the British Contact Lens Association · 2024
    Review
  16. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors at 6 institutions in 1 country.

Bing LiDepartment of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing, China.ORCID http://orcid.org/0000-0001-8958-2972
Huan ChenDepartment of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing, China.
Weihong YuDepartment of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing, China.
Ming ZhangDepartment of Ophthalmology, West China Hospital, Sichuan University, Chengdu, China.
Fang LuDepartment of Ophthalmology, West China Hospital, Sichuan University, Chengdu, China.
Jingxue MaDepartment of Ophthalmology, Second Hospital of Hebei Medical University, Shijiazhuang, China.
Yuhua HaoDepartment of Ophthalmology, Second Hospital of Hebei Medical University, Shijiazhuang, China.
Xiaorong LiDepartment of Retina, Tianjin Medical University Eye Hospital, Tianjin, China.
Bojie HuDepartment of Retina, Tianjin Medical University Eye Hospital, Tianjin, China.
Lijun ShenDepartment of Retina Center, Affiliated Eye Hospital of Wenzhou Medical University, Hangzhou, Zhejiang Province, China.
Jianbo MaoDepartment of Retina Center, Affiliated Eye Hospital of Wenzhou Medical University, Hangzhou, Zhejiang Province, China.
Xixi HeSchool of Information Science and Technology, North China University of Technology, Beijing, China.
Hao WangVisionary Intelligence Ltd., Beijing, China.
Dayong DingVisionary Intelligence Ltd., Beijing, China.
Xirong LiMoE Key Lab of DEKE, Renmin University of China, Beijing, China.ORCID http://orcid.org/0000-0002-0220-8310
Youxin ChenDepartment of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing, China. chenyx@pumch.cn.ORCID http://orcid.org/0000-0002-7231-5058
Chinese Academy of Medical Sciences & Peking Union Medical College · CNTianjin Medical University Eye Hospital · CNHebei Medical University · CNSichuan University · CNWenzhou Medical University · CNNorth China University of Technology · CN

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Artificial intelligence (AI)-based diagnostic systems have been reported to improve fundus disease screening in previous studies. This multicenter prospective self-controlled clinical trial aims to evaluate the diagnostic performance of a deep learning system (DLS) in assisting junior ophthalmologists in detecting 13 major fundus diseases. A total of 1493 fundus images from 748 patients were prospectively collected from five tertiary hospitals in China. Nine junior ophthalmologists were trained and annotated the images with or without the suggestions proposed by the DLS. The diagnostic performance was evaluated among three groups: DLS-assisted junior ophthalmologist group (test group), junior ophthalmologist group (control group) and DLS group. The diagnostic consistency was 84.9% (95%CI, 83.0% ~ 86.9%), 72.9% (95%CI, 70.3% ~ 75.6%) and 85.5% (95%CI, 83.5% ~ 87.4%) in the test group, control group and DLS group, respectively. With the help of the proposed DLS, the diagnostic consistency of junior ophthalmologists improved by approximately 12% (95% CI, 9.1% ~ 14.9%) with statistical significance (P < 0.001). For the detection of 13 diseases, the test group achieved significant higher sensitivities (72.2% ~ 100.0%) and comparable specificities (90.8% ~ 98.7%) comparing with the control group (sensitivities, 50% ~ 100%; specificities 96.7 ~ 99.8%). The DLS group presented similar performance to the test group in the detection of any fundus abnormality (sensitivity, 95.7%; specificity, 87.2%) and each of the 13 diseases (sensitivity, 83.3% ~ 100.0%; specificity, 89.0 ~ 98.0%). The proposed DLS provided a novel approach for the automatic detection of 13 major fundus diseases with high diagnostic consistency and assisted to improve the performance of junior ophthalmologists, resulting especially in reducing the risk of missed diagnoses. ClinicalTrials.gov NCT04723160.

Identifiers

PMID38212607
PMCPMC10784504
OpenAlexW4390739195

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.