Evidence map›Paper›PMID 36698064›Full record

Observational studyBMC medical research methodology2023

Multivariate longitudinal data for survival analysis of cardiovascular event prediction in young adults: insights from a comparative explainable study.

Hieu T Nguyen, Henrique D Vasconcellos, Kimberley Keck, Jared P Reis, Cora E Lewis, Steven Sidney, Donald M Lloyd-Jones, Pamela J Schreiner, Eliseo Guallar, Colin O Wu and 2 more

Registry-linked trialAbstract readObservational Study
In one paragraph

Observational study in BMC medical research methodology, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT00005130 (Coronary Artery Risk Development in Young Adults), which is not on this map. Cited by 5 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT00005130 active not recruitingnot on this map

Coronary Artery Risk Development in Young Adults (CARDIA)

TypeobservationalSponsorNational Heart, Lung, and Blood Institute (NHLBI)Ran1984 to 2033Enrolled5,115ConditionsCardiovascular Diseases, Coronary Disease, Hypertension, Heart Diseases
3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Hieu T NguyenDepartment of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA. hnguye78@jh.edu.
Henrique D VasconcellosDepartment of Cardiology, Johns Hopkins University, Baltimore, MD, USA.
Kimberley KeckDepartment of Cardiology, Johns Hopkins University, Baltimore, MD, USA.
Jared P ReisNational Heart, Lung, and Blood Institute, Bethesda, MD, USA.
Cora E LewisDepartment of Epidemiology, School of Public Health, University of Alabama at Birmingham, Birmingham, AL, USA.
Steven SidneyDivision of Research, Kaiser Permanente, Oakland, CA, USA.
Donald M Lloyd-JonesDepartment of Preventive Medicine, Northwestern University, Chicago, IL, USA.
Pamela J SchreinerSchool of Public Health, University of Minnesota, Minneapolis, MN, USA.
Eliseo GuallarDepartment of Epidemiology, Johns Hopkins University School of Public Health, Baltimore, MD, USA.
Colin O WuNational Heart, Lung, and Blood Institute, Bethesda, MD, USA.
João A C LimaDepartment of Cardiology, Johns Hopkins University, Baltimore, MD, USA.
Bharath Ambale-VenkateshDepartment of Radiology, Johns Hopkins University, Baltimore, MD, USA. bambale1@jhmi.edu.

Funding

NHLBI NIH HHS HHSN268201800003INHLBI NIH HHS HHSN268201800004INHLBI NIH HHS HHSN268201800005INHLBI NIH HHS HHSN268201800006INIH HHS HHSN268201800007I
6 · The paper itself

Abstract

backgroundMultivariate longitudinal data are under-utilized for survival analysis compared to cross-sectional data (CS - data collected once across cohort). Particularly in cardiovascular risk prediction, despite available methods of longitudinal data analysis, the value of longitudinal information has not been established in terms of improved predictive accuracy and clinical applicability.

methodsWe investigated the value of longitudinal data over and above the use of cross-sectional data via 6 distinct modeling strategies from statistics, machine learning, and deep learning that incorporate repeated measures for survival analysis of the time-to-cardiovascular event in the Coronary Artery Risk Development in Young Adults (CARDIA) cohort. We then examined and compared the use of model-specific interpretability methods (Random Survival Forest Variable Importance) and model-agnostic methods (SHapley Additive exPlanation (SHAP) and Temporal Importance Model Explanation (TIME)) in cardiovascular risk prediction using the top-performing models.

resultsIn a cohort of 3539 participants, longitudinal information from 35 variables that were repeatedly collected in 6 exam visits over 15 years improved subsequent long-term (17 years after) risk prediction by up to 8.3% in C-index compared to using baseline data (0.78 vs. 0.72), and up to approximately 4% compared to using the last observed CS data (0.75). Time-varying AUC was also higher in models using longitudinal data (0.86-0.87 at 5 years, 0.79-0.81 at 10 years) than using baseline or last observed CS data (0.80-0.86 at 5 years, 0.73-0.77 at 10 years). Comparative model interpretability analysis revealed the impact of longitudinal variables on model prediction on both the individual and global scales among different modeling strategies, as well as identifying the best time windows and best timing within that window for event prediction. The best strategy to incorporate longitudinal data for accuracy was time series massive feature extraction, and the easiest interpretable strategy was trajectory clustering.

conclusionOur analysis demonstrates the added value of longitudinal data in predictive accuracy and epidemiological utility in cardiovascular risk survival analysis in young adults via a unified, scalable framework that compares model performance and explainability. The framework can be extended to a larger number of variables and other longitudinal modeling methods.

trial registrationClinicalTrials.gov Identifier: NCT00005130, Registration Date: 26/05/2000.

Indexed as

Cardiovascular DiseasesCross-Sectional StudiesHumansSurvival AnalysisYoung AdultCARDIAExplainable AILongitudinal dataPersonalized medicineRepeated measuresRisk predictionSHAPSurvival analysisTIMETime-varying covariates

Identifiers

PMID36698064
PMCPMC9878947

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.