Evidence map›Paper›PMID 34843559›Full record

Trial reportPloS one2021

Deep learning algorithm in detecting intracranial hemorrhages on emergency computed tomographies.

Almut Kundisch, Alexander Hönning, Sven Mutze, Lutz Kreissl, Frederik Spohn, Johannes Lemcke, Maximilian Sitz, Paul Sparenberg, Leonie Goelz

Open access · goldAbstract readClinical TrialMulticenter Study
In one paragraph

Trial report in PloS one, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 26 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
26citing papers in PubMed, 2 pooled it
2.1field-weighted citation impact, top 11% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

26 citing papers in PubMed, 2 syntheses or guidelines pooled it, 60 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Review
  15. Review
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 2 institutions in 1 country.

Almut KundischCenter for Emergency Training, BG Klinikum Unfallkrankenhaus Berlin, Berlin, Germany.
Alexander HönningCenter for Clinical Research, BG Klinikum Unfallkrankenhaus Berlin, Berlin, Germany.
Sven MutzeDepartment of Radiology and Neuroradiology, BG Klinikum Unfallkrankenhaus Berlin, Berlin, Germany.
Lutz KreisslDepartment of Radiology and Neuroradiology, BG Klinikum Unfallkrankenhaus Berlin, Berlin, Germany.
Frederik SpohnDepartment of Radiology and Neuroradiology, BG Klinikum Unfallkrankenhaus Berlin, Berlin, Germany.
Johannes LemckeDepartment of Neurosurgery, BG Klinikum Unfallkrankenhaus Berlin, Berlin, Germany.
Maximilian SitzDepartment of Neurosurgery, BG Klinikum Unfallkrankenhaus Berlin, Berlin, Germany.
Paul SparenbergDepartment of Neurology, BG Klinikum Unfallkrankenhaus Berlin, Berlin, Germany.
Leonie GoelzDepartment of Radiology and Neuroradiology, BG Klinikum Unfallkrankenhaus Berlin, Berlin, Germany.ORCID 0000-0002-0011-2382
Unfallkrankenhaus Berlin · DEUniversitätsmedizin Greifswald · DE

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundHighly accurate detection of intracranial hemorrhages (ICH) on head computed tomography (HCT) scans can prove challenging at high-volume centers. This study aimed to determine the number of additional ICHs detected by an artificial intelligence (AI) algorithm and to evaluate reasons for erroneous results at a level I trauma center with teleradiology services.

methodsIn a retrospective multi-center cohort study, consecutive emergency non-contrast HCT scans were analyzed by a commercially available ICH detection software (AIDOC, Tel Aviv, Israel). Discrepancies between AI analysis and initial radiology report (RR) were reviewed by a blinded neuroradiologist to determine the number of additional ICHs detected and evaluate reasons leading to errors.

results4946 HCT (05/2020-09/2020) from 18 hospitals were included in the analysis. 205 reports (4.1%) were classified as hemorrhages by both radiology report and AI. Out of a total of 162 (3.3%) discrepant reports, 62 were confirmed as hemorrhages by the reference neuroradiologist. 33 ICHs were identified exclusively via RRs. The AI algorithm detected an additional 29 instances of ICH, missed 12.4% of ICH and overcalled 1.9%; RRs missed 10.9% of ICHs and overcalled 0.2%. Many of the ICHs missed by the AI algorithm were located in the subarachnoid space (42.4%) and under the calvaria (48.5%). 85% of ICHs missed by RRs occurred outside of regular working-hours. Calcifications (39.3%), beam-hardening artifacts (18%), tumors (15.7%), and blood vessels (7.9%) were the most common reasons for AI overcalls. ICH size, image quality, and primary examiner experience were not found to be significantly associated with likelihood of incorrect AI results.

conclusionComplementing human expertise with AI resulted in a 12.2% increase in ICH detection. The AI algorithm overcalled 1.9% HCT.

trial registrationGerman Clinical Trials Register (DRKS-ID: DRKS00023593).

Indexed as

Deep LearningTomography, X-Ray ComputedAgedAged, 80 and overAlgorithmsDiagnosis, Computer-AssistedFemaleHumansIntracranial HemorrhagesMaleMiddle AgedRetrospective Studies

Identifiers

PMID34843559
PMCPMC8629230
OpenAlexW3217170893

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.