Evidence map›Paper›PMID 35487111›Full record

ArticleMedical image analysis2022

A multimodal deep learning model for cardiac resynchronisation therapy response prediction.

Esther Puyol-Antón, Baldeep S Sidhu, Justin Gould, Bradley Porter, Mark K Elliott, Vishal Mehta, Christopher A Rinaldi, Andrew P King

Abstract read
In one paragraph

Article in Medical image analysis, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Review
  4. Review
  5. Review
  6. Artificial intelligence in heart failure.The Egyptian heart journal : (EHJ) : official bulletin of the Egyptian Society of Cardiology · 2026
    Review
  7. Article
  8. Review
  9. Review
  10. Review
  11. Article
  12. Article
  13. Article
  14. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Esther Puyol-AntónSchool of Biomedical Engineering & Imaging Sciences, King's College London, UK. Electronic address: esther.puyol_anton@kcl.ac.uk.
Baldeep S SidhuSchool of Biomedical Engineering & Imaging Sciences, King's College London, UK; Guy's and St Thomas' Hospital, London, UK.
Justin GouldSchool of Biomedical Engineering & Imaging Sciences, King's College London, UK; Guy's and St Thomas' Hospital, London, UK.
Bradley PorterSchool of Biomedical Engineering & Imaging Sciences, King's College London, UK; Guy's and St Thomas' Hospital, London, UK.
Mark K ElliottSchool of Biomedical Engineering & Imaging Sciences, King's College London, UK; Guy's and St Thomas' Hospital, London, UK.
Vishal MehtaSchool of Biomedical Engineering & Imaging Sciences, King's College London, UK; Guy's and St Thomas' Hospital, London, UK.
Christopher A RinaldiSchool of Biomedical Engineering & Imaging Sciences, King's College London, UK; Guy's and St Thomas' Hospital, London, UK.
Andrew P KingSchool of Biomedical Engineering & Imaging Sciences, King's College London, UK.

Funding

Medical Research Council MC_PC_17228Medical Research Council MC_QA137853Wellcome Trust 088641Wellcome Trust 203148Wellcome Trust 203148/Z/16/ZWellcome Trust WT203148/Z/16/Z
6 · The paper itself

Abstract

We present a novel multimodal deep learning framework for cardiac resynchronisation therapy (CRT) response prediction from 2D echocardiography and cardiac magnetic resonance (CMR) data. The proposed method first uses the 'nnU-Net' segmentation model to extract segmentations of the heart over the full cardiac cycle from the two modalities. Next, a multimodal deep learning classifier is used for CRT response prediction, which combines the latent spaces of the segmentation models of the two modalities. At test time, this framework can be used with 2D echocardiography data only, whilst taking advantage of the implicit relationship between CMR and echocardiography features learnt from the model. We evaluate our pipeline on a cohort of 50 CRT patients for whom paired echocardiography/CMR data were available, and results show that the proposed multimodal classifier results in a statistically significant improvement in accuracy compared to the baseline approach that uses only 2D echocardiography data. The combination of multimodal data enables CRT response to be predicted with 77.38% accuracy (83.33% sensitivity and 71.43% specificity), which is comparable with the current state-of-the-art in machine learning-based CRT response prediction. Our work represents the first multimodal deep learning approach for CRT response prediction.

Indexed as

Cardiac Resynchronization TherapyDeep LearningHeart FailureEchocardiographyHeartHumansCardiac resynchronisation therapyMulti-modality imagingMulti-view deep learningTreatment response prediction

Identifiers

PMID35487111
PMCPMC7616169

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.