Evidence map›Paper›PMID 40116947›Full record

ArticleNeuroradiology2025

Deep learning-assisted detection of intracranial hemorrhage: validation and impact on reader performance.

Dong-Wan Kang, Museong Kim, Gi-Hun Park, Yong Soo Kim, Moon-Ku Han, Myungjae Lee, Dongmin Kim, Wi-Sun Ryu, Han-Gil Jeong

Abstract readValidation Study
In one paragraph

Article in Neuroradiology, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Dong-Wan KangDivision of Intensive Care Medicine, Seoul National University Bundang Hospital, Seoul National University College of Medicine, Seongnam, Republic of Korea.
Museong KimDepartment of Neurosurgery, Seoul National University Bundang Hospital, Seoul National University College of Medicine, Seongnam, Republic of Korea.
Gi-Hun ParkJLK Inc., Artificial Intelligence Research Center, Seoul, Republic of Korea.
Yong Soo KimDivision of Intensive Care Medicine, Seoul National University Bundang Hospital, Seoul National University College of Medicine, Seongnam, Republic of Korea.
Moon-Ku HanDivision of Intensive Care Medicine, Seoul National University Bundang Hospital, Seoul National University College of Medicine, Seongnam, Republic of Korea.
Myungjae LeeJLK Inc., Artificial Intelligence Research Center, Seoul, Republic of Korea.
Dongmin KimJLK Inc., Artificial Intelligence Research Center, Seoul, Republic of Korea.
Wi-Sun RyuJLK Inc., Artificial Intelligence Research Center, Seoul, Republic of Korea.
Han-Gil JeongDivision of Intensive Care Medicine, Seoul National University Bundang Hospital, Seoul National University College of Medicine, Seongnam, Republic of Korea. han.g.Jeong@gmail.com.

Funding

Korea Government RS-2020-KD000098/1711195742
6 · The paper itself

Abstract

purposeIntracranial hemorrhage (ICH) requires urgent treatment, and accurate and timely diagnosis is essential for improving outcomes. This pivotal clinical trial aimed to validate a deep learning algorithm for ICH detection and assess its clinical utility through a reader performance test.

methodsRetrospective CT scans from patients with and without ICH were collected from a tertiary hospital. Two experts evaluated all scans, with a third expert reviewing disagreements for the final diagnosis. We analyzed the performance of the deep learning algorithm, JLK-ICH, for all cases and ICH subtypes. Additional external validation was performed using a multi-ethnic U.S. DATASET: A reader performance study included six non-expert readers who evaluated 800 CT scans, with and without JLK-ICH assistance, following a washout period. ICH presence and five-point scale confidence level for decisions were rated.

resultsA total of 1,370 CT scans were evaluated. The deep learning model showed 98.7% sensitivity (95% confidence interval [CI] 97.8-99.3%), 88.5% specificity (95% CI, 83.6-92.3%), and an area under the receiver operating characteristic curve (AUROC) of 0.936 (95% CI, 0.915-0.957). The model maintained high accuracy across all ICH subtypes, and additional external validation confirmed these results. In the reader performance study, AUROC with JLK-ICH assistance (0.967 [0.953-0.981]) surpassed that without assistance (0.953 [0.938-0.957]; P = 0.009). JLK-ICH particularly improved performance when readers were highly uncertain.

conclusionThe JLK-ICH algorithm demonstrated high accuracy in detecting all ICH subtypes. Non-expert readers significantly improved diagnostic accuracy for brain CT scans with deep learning assistance.

Indexed as

Deep LearningIntracranial HemorrhagesRadiographic Image Interpretation, Computer-AssistedTomography, X-Ray ComputedAgedAged, 80 and overAlgorithmsFemaleHumansMaleMiddle AgedReproducibility of ResultsRetrospective StudiesSensitivity and SpecificityClinical utilityComputed tomographyDeep learning algorithmDiagnostic accuracyIntracranial hemorrhageReader performance

Identifiers

PMID40116947
PMCPMC12357807

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.