Evidence map›Paper›PMID 39733260›Full record

ArticleGenetics in medicine : official journal of the American College of Medical Genetics2025

Evaluating the impact of modeling choices on the performance of integrated genetic and clinical models.

Theodore J Morley, Drew Willimitis, Michael Ripperger, Hyunjoon Lee, Yu Zhou, Lide Han, Jooeun Kang, William U Meyerson, Jordan W Smoller, Karmel W Choi and 2 more

Abstract read
In one paragraph

Article in Genetics in medicine : official journal of the American College of Medical Genetics, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

12 authors.

Theodore J MorleyVanderbilt Genetics Institute, Vanderbilt University Medical Center, Nashville TN; Center for Digital Genomic Medicine, Department of Medicine, Vanderbilt University Medical Center, Nashville TN.
Drew WillimitisDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville TN.
Michael RippergerDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville TN.
Hyunjoon LeePsychiatric and Neurodevelopmental Genetics Unit, Center for Genomic Medicine, Massachusetts General Hospital, Boston MA; Center for Precision Psychiatry, Department of Psychiatry, Massachusetts General Hospital, Boston MA.
Yu ZhouPsychiatric and Neurodevelopmental Genetics Unit, Center for Genomic Medicine, Massachusetts General Hospital, Boston MA; Center for Precision Psychiatry, Department of Psychiatry, Massachusetts General Hospital, Boston MA.
Lide HanVanderbilt Genetics Institute, Vanderbilt University Medical Center, Nashville TN; Center for Digital Genomic Medicine, Department of Medicine, Vanderbilt University Medical Center, Nashville TN.
Jooeun KangVanderbilt Genetics Institute, Vanderbilt University Medical Center, Nashville TN.
William U MeyersonCenter for Precision Psychiatry, Department of Psychiatry, Massachusetts General Hospital, Boston MA; Department of Biomedical Informatics, Harvard Medical School, Boston, MA.
Jordan W SmollerPsychiatric and Neurodevelopmental Genetics Unit, Center for Genomic Medicine, Massachusetts General Hospital, Boston MA; Center for Precision Psychiatry, Department of Psychiatry, Massachusetts General Hospital, Boston MA; Stanley Center for Psychiatric Research, Broad Institute, Cambridge, MA.
Karmel W ChoiPsychiatric and Neurodevelopmental Genetics Unit, Center for Genomic Medicine, Massachusetts General Hospital, Boston MA; Center for Precision Psychiatry, Department of Psychiatry, Massachusetts General Hospital, Boston MA.
Colin G WalshVanderbilt Genetics Institute, Vanderbilt University Medical Center, Nashville TN; Center for Digital Genomic Medicine, Department of Medicine, Vanderbilt University Medical Center, Nashville TN; Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville TN; Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, TN. Electronic address: colin.walsh@vumc.org.
Douglas M RuderferVanderbilt Genetics Institute, Vanderbilt University Medical Center, Nashville TN; Center for Digital Genomic Medicine, Department of Medicine, Vanderbilt University Medical Center, Nashville TN; Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville TN; Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, TN. Electronic address: douglas.ruderfer@vumc.org.

Funding

Vanderbilt Institute for Clinical and Translational Research (VICTR) -Identifying correlates of functional immunity in SARS-CoV-2 convalescent plasmaUL1TR002243 · NCATS · VANDERBILT UNIVERSITY MEDICAL CENTER · PI Paul A. Harris, Wesley H Self · 2017 to 2026
$130.7M
VANDERBILT UNIVERSITY CTSA FOR PEDIATRIC RESEARCHUL1RR024975 · NCRR · VANDERBILT UNIVERSITY · PI BERNARD, GORDON RAPHAEL · 2007 to 2011
$45.7M
The Vanderbilt Institute for Clinical and Translational Research (VICTR)UL1TR000445 · NCATS · VANDERBILT UNIVERSITY MEDICAL CENTER · PI BERNARD, GORDON RAPHAEL · 2012 to 2016
$41.4M
Pharmacogenomics of Arrhythmia TherapyU19HL065962 · NHLBI · VANDERBILT UNIVERSITY MEDICAL CENTER · PI RODEN, DAN M · 2010 to 2014
$17.4M
Understanding and preventing HLA-associated drug reactionsP50GM115305 · NIGMS · VANDERBILT UNIVERSITY MEDICAL CENTER · PI DENNY, JOSHUA C. · 2015 to 2019
$13.0M
The Genetic Epemiology of Multiple SclerosisR01NS032830 · NINDS · VANDERBILT UNIVERSITY · PI HAINES, JONATHAN L · 1995 to 2010
$8.9M
Epidemiologic Architecture for Genes Linked to Environment (EAGLE)U01HG004798 · NHGRI · VANDERBILT UNIVERSITY · PI CRAWFORD, DANA C · 2008 to 2013
$8.8M
VESPA: Vanderbilt Electronic Systems for Pharmacogenomic AssessmentRC2GM092618 · NIGMS · VANDERBILT UNIVERSITY · PI DENNY, JOSHUA C., RODEN, DAN M · 2009 to 2010
$6.4M
Vanderbilt Genome Electronic Records ProjectU01HG006378 · NHGRI · VANDERBILT UNIVERSITY · PI RODEN, DAN M · 2011 to 2014
$4.0M
PsycheMERGE: Leveraging electronic health records and genomics for mental health researchR01MH118233 · NIMH · MASSACHUSETTS GENERAL HOSPITAL · PI DAVIS, LEA K, SMOLLER, JORDAN W · 2019 to 2022
$3.1M
Understanding the genetic risk underlying racial disparities in uterine fibroids - Diversity SupplementR01HD074711 · NICHD · VANDERBILT UNIVERSITY MEDICAL CENTER · PI VELEZ EDWARDS, DIGNA R · 2013 to 2017
$2.9M
Distinguishing Clinical and Genetic Risk of Suicidal Ideation from Attempts to Inform PreventionR01MH121455 · NIMH · VANDERBILT UNIVERSITY MEDICAL CENTER · PI RUDERFER, DOUGLAS, WALSH, COLIN GEORGE · 2020 to 2024
$2.7M
NCATS NIH HHS UL1 TR000445NCATS NIH HHS UL1 TR002243NCRR NIH HHS S10 RR025141NCRR NIH HHS UL1 RR024975NHGRI NIH HHS U01 HG004798NHGRI NIH HHS U01 HG006378NHLBI NIH HHS U19 HL065962NICHD NIH HHS R01 HD074711NIGMS NIH HHS P50 GM115305NIGMS NIH HHS RC2 GM092618NIH HHS S10 OD017985NIH HHS S10 OD025092NIMH NIH HHS K08 MH127413NIMH NIH HHS R01 MH116269NIMH NIH HHS R01 MH118233NIMH NIH HHS R01 MH121455NINDS NIH HHS R01 NS032830
6 · The paper itself

Abstract

purposeThe value of genetic information for improving the performance of clinical risk prediction models has yielded variable conclusions. Many methodological decisions have the potential to contribute to differential results. We performed multiple modeling experiments integrating clinical and demographic data from electronic health records with genetic data to understand which decisions may affect performance.

methodsClinical data in the form of structured diagnostic codes, medications, procedural codes, and demographics were extracted from 2 large independent health systems, and polygenic risk scores (PRS) were generated across all patients of European ancestry with genetic data in the corresponding biobanks. Crohn's disease was studied based on its substantial genetic component, established electronic health records-based definition, and sufficient prevalence for training and testing. We investigated the impact of choices regarding the PRS integration method, training sample, model complexity, and performance metrics.

resultsOverall, our results showed that including PRS resulted in higher performance, but this gain was only robust in situations with limited clinical information. We found consistent performance increases from more compute-intensive models, such as random forest, but the impact of other decisions varied by site.

conclusionThis work highlights the importance of considering methodological decision points in interpreting the impact of PRS on prediction performance in clinical models.

Indexed as

Crohn DiseaseModels, GeneticElectronic Health RecordsFemaleGenetic Predisposition to DiseaseGenetic TestingHumansMaleMultifactorial InheritanceRisk AssessmentEHRGeneticsGenomicsMachine learningPRS

Identifiers

PMID39733260
PMCPMC13183356

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.