Evidence map›Paper›PMID 36712164›Full record

ArticleEuropean heart journal. Digital health2022

Improving explainability of deep neural network-based electrocardiogram interpretation using variational auto-encoders

Rutger R van de Leur, Max N Bos, Karim Taha, Arjan Sammani, Ming Wai Yeung, Stefan van Duijvenboden, Pier D Lambiase, Rutger J Hassink, Pim van der Harst, Pieter A Doevendans and 2 more

Open access · goldAbstract read
In one paragraph

Article in European heart journal. Digital health, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 33 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
33citing papers in PubMed, 1 pooled it
9.2field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

33 citing papers in PubMed, 1 synthesis or guideline pooled it, 62 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Review
  6. Review
  7. Discovering Interpretable Semantics from Radio Signals for Contactless Cardiac Monitoring.Advanced science (Weinheim, Baden-Wurttemberg, Germany) · 2026
    Article
  8. Article
  9. Review
  10. Review
  11. Article
  12. Article
  13. Article
  14. Observational
  15. Article
  16. Article
  17. Article
  18. Article
  19. Deep learning for electrocardiogram interpretation: Bench to bedside.European journal of clinical investigation · 2025
    Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors at 4 institutions in 3 countries.

Rutger R van de LeurDepartment of Cardiology, University Medical Center Utrecht, Internal ref E03.511, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands.
Max N BosDepartment of Cardiology, University Medical Center Utrecht, Internal ref E03.511, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands.
Karim TahaDepartment of Cardiology, University Medical Center Utrecht, Internal ref E03.511, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands.
Arjan SammaniDepartment of Cardiology, University Medical Center Utrecht, Internal ref E03.511, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands.ORCID https://orcid.org/0000-0002-5557-9342
Ming Wai YeungDepartment of Cardiology, University Medical Center Groningen, Hanzeplein 1. 9713 GZ Groningen, The Netherlands.ORCID https://orcid.org/0000-0001-9794-3109
Stefan van DuijvenbodenInstitute of Cardiovascular Science, University College London, 62 Huntley St, London Wc1E 6Dd, UK.
Pier D LambiaseInstitute of Cardiovascular Science, University College London, 62 Huntley St, London Wc1E 6Dd, UK.
Rutger J HassinkDepartment of Cardiology, University Medical Center Utrecht, Internal ref E03.511, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands.
Pim van der HarstDepartment of Cardiology, University Medical Center Utrecht, Internal ref E03.511, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands.ORCID https://orcid.org/0000-0002-2713-686X
Pieter A DoevendansDepartment of Cardiology, University Medical Center Utrecht, Internal ref E03.511, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands.
Deepak K GuptaInformatics Institute, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands.
René van EsDepartment of Cardiology, University Medical Center Utrecht, Internal ref E03.511, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands.
Heidelberg University · DEUniversity College London · GBUniversity Medical Center Groningen · NLUniversity of Amsterdam · NL

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Aims: Deep neural networks (DNNs) perform excellently in interpreting electrocardiograms (ECGs), both for conventional ECG interpretation and for novel applications such as detection of reduced ejection fraction (EF). Despite these promising developments, implementation is hampered by the lack of trustworthy techniques to explain the algorithms to clinicians. Especially, currently employed heatmap-based methods have shown to be inaccurate. Methods and results: We present a novel pipeline consisting of a variational auto-encoder (VAE) to learn the underlying factors of variation of the median beat ECG morphology (the FactorECG), which are subsequently used in common and interpretable prediction models. As the ECG factors can be made explainable by generating and visualizing ECGs on both the model and individual level, the pipeline provides improved explainability over heatmap-based methods. By training on a database with 1.1 million ECGs, the VAE can compress the ECG into 21 generative ECG factors, most of which are associated with physiologically valid underlying processes. Performance of the explainable pipeline was similar to 'black box' DNNs in conventional ECG interpretation [area under the receiver operating curve (AUROC) 0.94 vs. 0.96], detection of reduced EF (AUROC 0.90 vs. 0.91), and prediction of 1-year mortality (AUROC 0.76 vs. 0.75). Contrary to the 'black box' DNNs, our pipeline provided explainability on which morphological ECG changes were important for prediction. Results were confirmed in a population-based external validation dataset. Conclusions: Future studies on DNNs for ECGs should employ pipelines that are explainable to facilitate clinical implementation by gaining confidence in artificial intelligence and making it possible to identify biased models.

Indexed as

Artificial intelligenceDeep learningDeep neural networkElectrocardiogramExplainableInterpretable

Identifiers

PMID36712164
PMCPMC9707974
OpenAlexW4287578511

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.