Evidence map›Paper›PMID 38019564›Full record

ArticleJournal of medical Internet research2023

Developing and Evaluating an AI-Based Computer-Aided Diagnosis System for Retinal Disease: Diagnostic Study for Central Serous Chorioretinopathy.

Jeewoo Yoon, Jinyoung Han, Junseo Ko, Seong Choi, Ji In Park, Joon Seo Hwang, Jeong Mo Han, Daniel Duck-Jin Hwang

Open access · goldAbstract read
In one paragraph

Article in Journal of medical Internet research, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed, 1 pooled it
2.5field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 1 synthesis or guideline pooled it, 11 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Review
  4. Article
  5. Article
  6. Review
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 3 institutions in 1 country.

Jeewoo Yoon *Department of Applied Artificial Intelligence, Sungkyunkwan University, Seoul, Republic of Korea.ORCID 0000-0002-9067-8653
Jinyoung Han *Department of Applied Artificial Intelligence, Sungkyunkwan University, Seoul, Republic of Korea.ORCID 0000-0002-8911-2791
Junseo KoDepartment of Applied Artificial Intelligence, Sungkyunkwan University, Seoul, Republic of Korea.ORCID 0000-0002-4458-3987
Seong ChoiDepartment of Applied Artificial Intelligence, Sungkyunkwan University, Seoul, Republic of Korea.ORCID 0000-0003-2721-4706
Ji In ParkDepartment of Medicine, Kangwon National University School of Medicine, Kangwon National University Hospital, Chuncheon, Republic of Korea.ORCID 0000-0003-4662-3759
Joon Seo HwangSeoul Plus Eye Clinic, Seoul, Republic of Korea.ORCID 0000-0003-1175-7693
Jeong Mo HanSeoul Bombit Eye Clinic, Sejong, Republic of Korea.ORCID 0000-0002-6379-4536
Daniel Duck-Jin HwangDepartment of Ophthalmology, Hangil Eye Hospital, Incheon, Republic of Korea.ORCID 0000-0003-1808-3169
Sungkyunkwan University · KRKangwon National University Hospital · KRNune Eye Hospital · KR

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundAlthough previous research has made substantial progress in developing high-performance artificial intelligence (AI)-based computer-aided diagnosis (AI-CAD) systems in various medical domains, little attention has been paid to developing and evaluating AI-CAD system in ophthalmology, particularly for diagnosing retinal diseases using optical coherence tomography (OCT) images.

objectiveThis diagnostic study aimed to determine the usefulness of a proposed AI-CAD system in assisting ophthalmologists with the diagnosis of central serous chorioretinopathy (CSC), which is known to be difficult to diagnose, using OCT images.

methodsFor the training and evaluation of the proposed deep learning model, 1693 OCT images were collected and annotated. The data set included 929 and 764 cases of acute and chronic CSC, respectively. In total, 66 ophthalmologists (2 groups: 36 retina and 30 nonretina specialists) participated in the observer performance test. To evaluate the deep learning algorithm used in the proposed AI-CAD system, the training, validation, and test sets were split in an 8:1:1 ratio. Further, 100 randomly sampled OCT images from the test set were used for the observer performance test, and the participants were instructed to select a CSC subtype for each of these images. Each image was provided under different conditions: (1) without AI assistance, (2) with AI assistance with a probability score, and (3) with AI assistance with a probability score and visual evidence heatmap. The sensitivity, specificity, and area under the receiver operating characteristic curve were used to measure the diagnostic performance of the model and ophthalmologists.

resultsThe proposed system achieved a high detection performance (99% of the area under the curve) for CSC, outperforming the 66 ophthalmologists who participated in the observer performance test. In both groups, ophthalmologists with the support of AI assistance with a probability score and visual evidence heatmap achieved the highest mean diagnostic performance compared with that of those subjected to other conditions (without AI assistance or with AI assistance with a probability score). Nonretina specialists achieved expert-level diagnostic performance with the support of the proposed AI-CAD system.

conclusionsOur proposed AI-CAD system improved the diagnosis of CSC by ophthalmologists, which may support decision-making regarding retinal disease detection and alleviate the workload of ophthalmologists.

Indexed as

Central Serous ChorioretinopathyDiagnosis, Computer-AssistedAlgorithmsArtificial IntelligenceComputersDeep LearningHumansartificial intelligencecentral serous chorioretinopathycomputer aided diagnosiscomputer visiondeep learningdiagnostic studyimaging informaticsophthalmologyretinal disease

Identifiers

PMID38019564
PMCPMC10719821
OpenAlexW4388400661

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.