Evidence map›Paper›PMID 38951922›Full record

ArticleGenome biology2024

Benchmarking computational variant effect predictors by their ability to infer human traits.

Daniel R Tabet, Da Kuang, Megan C Lancaster, Roujia Li, Karen Liu, Jochen Weile, Atina G Coté, Yingzhou Wu, Robert A Hegele, Dan M Roden and 1 more

Abstract read
In one paragraph

Article in Genome biology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed.

  1. MultimodalCirculation · 2026
    Article
  2. Article
  3. Review
  4. Article
  5. Article
  6. Review
  7. Article
  8. Predicting Pathogenicity ofInternational journal of molecular sciences · 2026
    Article
  9. Article
  10. Article
  11. Article
  12. Mapping the Functional Landscape ofmedRxiv : the preprint server for health sciences · 2025
    Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Daniel R Tabet *Donnelly Centre, University of Toronto, Toronto, ON, Canada.
Da Kuang *Donnelly Centre, University of Toronto, Toronto, ON, Canada.
Megan C Lancaster *Division of Cardiovascular Medicine, Department of Medicine, Vanderbilt University Medical Center, Nashville, TN, USA.
Roujia LiDonnelly Centre, University of Toronto, Toronto, ON, Canada.
Karen LiuDonnelly Centre, University of Toronto, Toronto, ON, Canada.
Jochen WeileDonnelly Centre, University of Toronto, Toronto, ON, Canada.
Atina G CotéDonnelly Centre, University of Toronto, Toronto, ON, Canada.
Yingzhou WuDonnelly Centre, University of Toronto, Toronto, ON, Canada.
Robert A HegeleDepartment of Medicine, Department of Biochemistry, Schulich School of Medicine and Dentistry, Robarts Research Institute, Western University, London, ON, Canada.
Dan M RodenDivision of Cardiovascular Medicine, Department of Medicine, Vanderbilt University Medical Center, Nashville, TN, USA.
Frederick P RothDonnelly Centre, University of Toronto, Toronto, ON, Canada. fritz@pitt.edu.ORCID 0000-0002-6628-649X

Funding

Technology to Empower Changes in Health (TECH) Network Participant Technologies CenterU24OD023176 · OD · SCRIPPS RESEARCH INSTITUTE, THE · PI TOPOL, ERIC JEFFREY · 2016 to 2022
$204.7M
Precision Medicine Initiative Cohort Program BiobankU24OD023121 · OD · MAYO CLINIC ROCHESTER · PI CEKANOVA, MARIA, CICEK, MINE · 2016 to 2024
$185.5M
Enhancing All of Us Data Resources for Nutrition Precision Health: the All of Us Data and Research CenterU2COD023196 · OD · VANDERBILT UNIVERSITY MEDICAL CENTER · PI GLAZER, DAVID, HARRIS, PAUL A. · 2016 to 2022
$143.7M
Adaptive Platform for Personalized EngagementU24OD023163 · OD · VIGNET, INC. · PI JAIN, PRADUMAN · 2017 to 2020
$102.6M
University of Arizona-Banner Health All of Us Research Program OT2OD026549 · OD · UNIVERSITY OF ARIZONA · PI MORENO, FRANCISCO A, REIMAN, ERIC MICHAEL · 2018 to 2023
$78.9M
California Precision Medicine Research Program ConsortiumOT2OD026552 · OD · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI ANTON-CULVER, HODA A, OHNO-MACHADO, LUCILA · 2018 to 2023
$73.4M
All of Us PennsylvaniaOT2OD026554 · OD · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI REIS, STEVEN E, VISWESWARAN, SHYAM · 2018 to 2023
$72.1M
New York City Consortium for Precision MedicineOT2OD026556 · OD · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI BIER, LOUISE E, GHARAVI, ALI G · 2018 to 2023
$67.3M
SouthEast Enrollment Center (SEEC) OT2OD026551 · OD · UNIVERSITY OF MIAMI SCHOOL OF MEDICINE · PI CARRASQUILLO, OLVEEN, COLON, VIVIAN · 2018 to 2023
$62.8M
Southern All of Us NetworkOT2OD026548 · OD · UNIVERSITY OF ALABAMA AT BIRMINGHAM · PI FOUAD, MONA N., KORF, BRUCE R · 2018 to 2023
$60.5M
Illinois Precision Medicine Consortium OT2OD026557 · OD · NORTHWESTERN UNIVERSITY AT CHICAGO · PI AHSAN, HABIBUL, ARGOS, MARIA · 2018 to 2023
$60.5M
The New England Precision Medicine Consortium of the All of Us Research ProgramOT2OD026553 · OD · MASSACHUSETTS GENERAL HOSPITAL · PI CLARK, CHERYL RENEE, KARLSON, ELIZABETH W · 2018 to 2023
$58.8M
American Heart Association-American Stroke AssociationNHGRI NIH HHS RM1 HG010461NHGRI NIH HHS RM1HG010461NHGRI NIH HHS T32 HG008341NHGRI NIH HHS UM1 HG011989NHGRI NIH HHS UM1HG011989NHLBI NIH HHS R01 HL164675NHLBI NIH HHS R01HL164675NIGMS NIH HHS T32 GM007569NIH HHS OT2 OD023205NIH HHS OT2 OD023206NIH HHS OT2 OD025276NIH HHS OT2 OD025315NIH HHS OT2 OD025337NIH HHS OT2 OD026548NIH HHS OT2 OD026549NIH HHS OT2 OD026550NIH HHS OT2 OD026551NIH HHS OT2 OD026552NIH HHS OT2 OD026553NIH HHS OT2 OD026554NIH HHS OT2 OD026555NIH HHS OT2 OD026556NIH HHS OT2 OD026557NIH HHS U24 OD023121NIH HHS U24 OD023163NIH HHS U24 OD023176NIH HHS U2C OD023196
6 · The paper itself

Abstract

backgroundComputational variant effect predictors offer a scalable and increasingly reliable means of interpreting human genetic variation, but concerns of circularity and bias have limited previous methods for evaluating and comparing predictors. Population-level cohorts of genotyped and phenotyped participants that have not been used in predictor training can facilitate an unbiased benchmarking of available methods. Using a curated set of human gene-trait associations with a reported rare-variant burden association, we evaluate the correlations of 24 computational variant effect predictors with associated human traits in the UK Biobank and All of Us cohorts.

resultsAlphaMissense outperformed all other predictors in inferring human traits based on rare missense variants in UK Biobank and All of Us participants. The overall rankings of computational variant effect predictors in these two cohorts showed a significant positive correlation.

conclusionWe describe a method to assess computational variant effect predictors that sidesteps the limitations of previous evaluations. This approach is generalizable to future predictors and could continue to inform predictor choice for personal and clinical genetics.

Indexed as

BenchmarkingGenetic VariationComputational BiologyGenotypeHumansPhenotypeAll of UsBenchmarkingPersonal genomicsRare missense variationUK BiobankVariant effect predictors

Identifiers

PMID38951922
PMCPMC11218265

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.