Evidence map›Paper›PMID 37373699›Full record

ArticleJournal of clinical medicine2023

External Validation and Retraining of DeepBleed: The First Open-Source 3D Deep Learning Network for the Segmentation of Spontaneous Intracerebral and Intraventricular Hemorrhage.

Haoyin Cao, Andrea Morotti, Federico Mazzacane, Dmitriy Desser, Frieder Schlunk, Christopher Güttler, Helge Kniep, Tobias Penzkofer, Jens Fiehler, Uta Hanning and 2 more

Open access · goldAbstract read
In one paragraph

Article in Journal of clinical medicine, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 3 pooled it
2.1field-weighted citation impact, top 13% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 3 syntheses or guidelines pooled it, 10 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors at 5 institutions in 2 countries.

Haoyin CaoDepartment of Radiology, Charité-Universitätsmedizin Berlin, Freie Universität Berlin, Humboldt-Universität zu Berlin, Charitéplatz 1, 10117 Berlin, Germany.ORCID 0000-0001-8196-0385
Andrea MorottiNeurology Unit, Department of Neurological Sciences and Vision, ASST-Spedali Civili, 25123 Brescia, Italy.
Federico MazzacaneDepartment of Brain and Behavioral Sciences, University of Pavia, 27100 Pavia, Italy.ORCID 0000-0002-2224-8002
Dmitriy DesserDepartment of Neuroradiology, Charité School of Medicine and University Hospital Berlin, 10117 Berlin, Germany.ORCID 0000-0002-4642-3063
Frieder SchlunkDepartment of Neuroradiology, Charité School of Medicine and University Hospital Berlin, 10117 Berlin, Germany.
Christopher GüttlerDepartment of Neuroradiology, Charité School of Medicine and University Hospital Berlin, 10117 Berlin, Germany.
Helge KniepDepartment of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg Eppendorf, 20246 Hamburg, Germany.
Tobias PenzkoferDepartment of Radiology, Charité-Universitätsmedizin Berlin, Freie Universität Berlin, Humboldt-Universität zu Berlin, Charitéplatz 1, 10117 Berlin, Germany.
Jens FiehlerDepartment of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg Eppendorf, 20246 Hamburg, Germany.
Uta HanningDepartment of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg Eppendorf, 20246 Hamburg, Germany.
Andrea Dell'OrcoDepartment of Neuroradiology, Charité School of Medicine and University Hospital Berlin, 10117 Berlin, Germany.ORCID 0000-0002-3964-8360
Jawed NawabiDepartment of Radiology, Charité-Universitätsmedizin Berlin, Freie Universität Berlin, Humboldt-Universität zu Berlin, Charitéplatz 1, 10117 Berlin, Germany.ORCID 0000-0002-1137-0643
Charité - Universitätsmedizin Berlin · DEHumboldt-Universität zu Berlin · DEUniversität Hamburg · DEAzienda Socio Sanitaria Territoriale degli Spedali Civili di Brescia · ITUniversity of Pavia · IT

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe objective of this study was to assess the performance of the first publicly available automated 3D segmentation for spontaneous intracerebral hemorrhage (ICH) based on a 3D neural network before and after retraining.

methodsWe performed an independent validation of this model using a multicenter retrospective cohort. Performance metrics were evaluated using the dice score (DSC), sensitivity, and positive predictive values (PPV). We retrained the original model (OM) and assessed the performance via an external validation design. A multivariate linear regression model was used to identify independent variables associated with the model's performance. Agreements in volumetric measurements and segmentation were evaluated using Pearson's correlation coefficients (r) and intraclass correlation coefficients (ICC), respectively. With 1040 patients, the OM had a median DSC, sensitivity, and PPV of 0.84, 0.79, and 0.93, compared to thoseo f 0.83, 0.80, and 0.91 in the retrained model (RM). However, the median DSC for infratentorial ICH was relatively low and improved significantly after retraining, at

conclusionThe model demonstrated good generalization in an external validation cohort. Location-specific variances improved significantly after retraining. External validation and retraining are important steps to consider before applying deep learning models in new clinical settings.

Indexed as

automated segmentationdeep learningexternal validationintracerebral hemorrhagemulticenter

Identifiers

PMID37373699
PMCPMC10299035
OpenAlexW4380629433

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.