Evidence map›Paper›PMID 39081946›Full record

ArticleEuropean heart journal. Digital health2024

Simple models vs. deep learning in detecting low ejection fraction from the electrocardiogram.

John Weston Hughes, Sulaiman Somani, Pierre Elias, James Tooley, Albert J Rogers, Timothy Poterucha, Christopher M Haggerty, Michael Salerno, David Ouyang, Euan Ashley and 2 more

Abstract read
In one paragraph

Article in European heart journal. Digital health, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Article
  5. Review
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

John Weston HughesDepartment of Computer Science, Stanford University, 353 Jane Stanford Way, Stanford, CA 94305, USA.ORCID https://orcid.org/0000-0002-7042-4031
Sulaiman SomaniDepartment of Medicine, Stanford University, 1265 Pasteur Dr, Stanford, CA 94305, USA.
Pierre EliasDepartment of Medicine, Columbia University Irving Medical Center, 622 W 168th St, New York, NY 10032, USA.ORCID https://orcid.org/0000-0002-9643-3024
James TooleyDepartment of Medicine, Stanford University, 1265 Pasteur Dr, Stanford, CA 94305, USA.
Albert J RogersDepartment of Medicine, Stanford University, 1265 Pasteur Dr, Stanford, CA 94305, USA.
Timothy PoteruchaDepartment of Medicine, Columbia University Irving Medical Center, 622 W 168th St, New York, NY 10032, USA.
Christopher M HaggertyDepartment of Medicine, Columbia University Irving Medical Center, 622 W 168th St, New York, NY 10032, USA.
Michael SalernoDepartment of Medicine, Stanford University, 1265 Pasteur Dr, Stanford, CA 94305, USA.
David OuyangCedars-Sinai Medical Center, Department of Cardiology, Smidt Heart Institute, 127 S San Vicente Blvd Pavilion, Suite A3600, Los Angeles, CA 90048, USA.
Euan AshleyDepartment of Medicine, Stanford University, 1265 Pasteur Dr, Stanford, CA 94305, USA.
James ZouDepartment of Biomedical Data Science, Stanford University, 1265 Welch Road, Stanford, CA 94305, USA.ORCID https://orcid.org/0000-0001-8880-4764
Marco V PerezDepartment of Medicine, Stanford University, 1265 Pasteur Dr, Stanford, CA 94305, USA.

Funding

Deep Learning Based Phenotyping and Outcomes Prediction for Valvular Heart DiseaseR01HL173526 · NHLBI · CEDARS-SINAI MEDICAL CENTER · PI David Ouyang · 2024 to 2026
$2.5M
Deep Learning Assessment of the Right Ventricle: Function, Etiology, and PrognosisR00HL157421 · NHLBI · KAISER FOUNDATION RESEARCH INSTITUTE · PI OUYANG, DAVID · 2023 to 2025
$747k
Electrical Mapping Signatures of Adverse Structural and Functional Remodeling in Ventricular ArrhythmiaK23HL166977 · NHLBI · STANFORD UNIVERSITY · PI Albert Joseph Rogers · 2023 to 2026
$680k
NHLBI NIH HHS K23 HL166977NHLBI NIH HHS L30 HL143631NHLBI NIH HHS R00 HL157421NHLBI NIH HHS R01 HL173526
6 · The paper itself

Abstract

Aims: Deep learning methods have recently gained success in detecting left ventricular systolic dysfunction (LVSD) from electrocardiogram (ECG) waveforms. Despite their high level of accuracy, they are difficult to interpret and deploy broadly in the clinical setting. In this study, we set out to determine whether simpler models based on standard ECG measurements could detect LVSD with similar accuracy to that of deep learning models. Methods and results: Using an observational data set of 40 994 matched 12-lead ECGs and transthoracic echocardiograms, we trained a range of models with increasing complexity to detect LVSD based on ECG waveforms and derived measurements. The training data were acquired from the Stanford University Medical Center. External validation data were acquired from the Columbia Medical Center and the UK Biobank. The Stanford data set consisted of 40 994 matched ECGs and echocardiograms, of which 9.72% had LVSD. A random forest model using 555 discrete, automated measurements achieved an area under the receiver operator characteristic curve (AUC) of 0.92 (0.91-0.93), similar to a deep learning waveform model with an AUC of 0.94 (0.93-0.94). A logistic regression model based on five measurements achieved high performance [AUC of 0.86 (0.85-0.87)], close to a deep learning model and better than N-terminal prohormone brain natriuretic peptide (NT-proBNP). Finally, we found that simpler models were more portable across sites, with experiments at two independent, external sites. Conclusion: Our study demonstrates the value of simple electrocardiographic models that perform nearly as well as deep learning models, while being much easier to implement and interpret.

Indexed as

Artificial intelligenceDeep learningElectrocardiogramsExplainabilityInterpretability

Identifiers

PMID39081946
PMCPMC11284011

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.