Evidence map›Paper›PMID 31456363›Full record

ArticleKorean circulation journal2020

Development and External Validation of a Deep Learning Algorithm for Prognostication of Cardiovascular Outcomes.

In Jeong Cho, Ji Min Sung, Hyeon Chang Kim, Sang Eun Lee, Myeong Hun Chae, Maryam Kavousi, Oscar L Rueda-Ochoa, M Arfan Ikram, Oscar H Franco, James K Min and 1 more

Registry-linked trialAbstract read
In one paragraph

Article in Korean circulation journal, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT02931500 (MachIne LEarning for Identification of Future Development of cardiovaScular and meTabOlic Disease), which is not on this map. Cited by 8 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT02931500 unknown statusnot on this map

MachIne LEarning for Identification of Future Development of cardiovaScular and meTabOlic Disease: a NationwidE Time-series Cohort Study (MILESTONE)

TypeobservationalSponsorYonsei UniversityRan2016 to 2018Enrolled510,000ConditionsCardiovascular Disease, Metabolic Disease
3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. The PREVENT Risk Equations and Cardiovascular Prevention in East Asia.Journal of atherosclerosis and thrombosis · 2026
    Review
  3. Review
  4. Review
  5. Article
  6. Survey and Evaluation of Hypertension Machine Learning Research.Journal of the American Heart Association · 2023
    Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

In Jeong ChoDivision of Cardiology, Department of Internal Medicine, Ewha Womans University Seoul Hospital, Ewha Womans University College of Medicine, Seoul, Korea.ORCID https://orcid.org/0000-0002-1209-5129
Ji Min SungDivision of Cardiology, Severance Cardiovascular Hospital, Yonsei University College of Medicine, Seoul, Korea.ORCID https://orcid.org/0000-0003-1958-7596
Hyeon Chang KimDivision of Cardiology, Severance Cardiovascular Hospital, Yonsei University College of Medicine, Seoul, Korea.ORCID https://orcid.org/0000-0001-7867-1240
Sang Eun LeeDivision of Cardiology, Severance Cardiovascular Hospital, Yonsei University College of Medicine, Seoul, Korea.ORCID https://orcid.org/0000-0001-6645-4038
Myeong Hun ChaeAI R&D Lab. of Selvas AI Inc., Seoul, Korea.ORCID https://orcid.org/0000-0001-6525-4827
Maryam KavousiDepartment of Epidemiology, Erasmus MC, Rotterdam, The Netherlands.ORCID https://orcid.org/0000-0001-5976-6519
Oscar L Rueda-OchoaDepartment of Epidemiology, Erasmus MC, Rotterdam, The Netherlands.ORCID https://orcid.org/0000-0003-2684-9005
M Arfan IkramDepartment of Epidemiology, Erasmus MC, Rotterdam, The Netherlands.ORCID https://orcid.org/0000-0003-0372-8585
Oscar H FrancoDepartment of Epidemiology, Erasmus MC, Rotterdam, The Netherlands.ORCID https://orcid.org/0000-0002-4606-4929
James K MinDepartment of Radiology and Medicine, Weill Cornell Medical College, Dalio Institute of Cardiovascular Imaging, New York-Presbyterian Hospital, New York, NY, USA.ORCID https://orcid.org/0000-0001-8812-7388
Hyuk Jae ChangDivision of Cardiology, Severance Cardiovascular Hospital, Yonsei University College of Medicine, Seoul, Korea.ORCID https://orcid.org/0000-0002-6139-7545

Funding

AXACOLCIENCIASErasmus MCErasmus University RotterdamEuropean Commission (DG XII)Institute for Information and communications Technology Promotion 2017-0-00255Institute for Information and communications Technology Promotion 2018-0-00861Metagenics Inc.Ministry for Health, Welfare and SportsNestec Ltd.Netherlands Organisation for Scientific ResearchNetherlands Organisation for Scientific Research 91616079Netherlands Organisation for the Health Research and DevelopmentResearch Institute for Diseases in the ElderlyThe Municipality of RotterdamUniversidad Industrial de Santander
6 · The paper itself

Abstract

BACKGROUND AND

objectivesWe aim to explore the additional discriminative accuracy of a deep learning (DL) algorithm using repeated-measures data for identifying people at high risk for cardiovascular disease (CVD), compared to Cox hazard regression.

methodsTwo CVD prediction models were developed from National Health Insurance Service-Health Screening Cohort (NHIS-HEALS): a Cox regression model and a DL model. Performance of each model was assessed in the internal and 2 external validation cohorts in Koreans (National Health Insurance Service-National Sample Cohort; NHIS-NSC) and in Europeans (Rotterdam Study). A total of 412,030 adults in the NHIS-HEALS; 178,875 adults in the NHIS-NSC; and the 4,296 adults in Rotterdam Study were included.

resultsMean ages was 52 years (46% women) and there were 25,777 events (6.3%) in NHIS-HEALS during the follow-up. In internal validation, the DL approach demonstrated a C-statistic of 0.896 (95% confidence interval, 0.886-0.907) in men and 0.921 (0.908-0.934) in women and improved reclassification compared with Cox regression (net reclassification index [NRI], 24.8% in men, 29.0% in women). In external validation with NHIS-NSC, DL demonstrated a C-statistic of 0.868 (0.860-0.876) in men and 0.889 (0.876-0.898) in women, and improved reclassification compared with Cox regression (NRI, 24.9% in men, 26.2% in women). In external validation applied to the Rotterdam Study, DL demonstrated a C-statistic of 0.860 (0.824-0.897) in men and 0.867 (0.830-0.903) in women, and improved reclassification compared with Cox regression (NRI, 36.9% in men, 31.8% in women).

conclusionsA DL algorithm exhibited greater discriminative accuracy than Cox model approaches.

trial registrationClinicalTrials.gov Identifier: NCT02931500.

Indexed as

Artificial intelligenceCardiovascular diseases

Identifiers

PMID31456363
PMCPMC6923233

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.