Evidence map›Paper›PMID 38742457›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2024

To weight or not to weight? The effect of selection bias in 3 large electronic health record-linked biobanks and recommendations for practice.

Maxwell Salvatore, Ritoban Kundu, Xu Shi, Christopher R Friese, Seunggeun Lee, Lars G Fritsche, Alison M Mondul, David Hanauer, Celeste Leigh Pearce, Bhramar Mukherjee

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Revisiting representativeness.International journal of epidemiology · 2025
    Article
  9. Article
  10. Article
  11. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

10 authors.

Maxwell SalvatoreDepartment of Epidemiology, University of Michigan, Ann Arbor, MI 48109-2029, United States.ORCID 0000-0002-3659-1514
Ritoban KunduCenter for Precision Health Data Science, Department of Biostatistics, University of Michigan, Ann Arbor, MI 48109-2029, United States.
Xu ShiDepartment of Biostatistics, University of Michigan, Ann Arbor, MI 48109-2029, United States.
Christopher R FrieseRogel Cancer Center, Michigan Medicine, University of Michigan, Ann Arbor, MI 48109-2029, United States.
Seunggeun LeeDepartment of Biostatistics, University of Michigan, Ann Arbor, MI 48109-2029, United States.
Lars G FritscheCenter for Precision Health Data Science, Department of Biostatistics, University of Michigan, Ann Arbor, MI 48109-2029, United States.
Alison M MondulDepartment of Epidemiology, University of Michigan, Ann Arbor, MI 48109-2029, United States.
David HanauerDepartment of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI 48109-2054, United States.
Celeste Leigh PearceDepartment of Epidemiology, University of Michigan, Ann Arbor, MI 48109-2029, United States.
Bhramar MukherjeeDepartment of Epidemiology, University of Michigan, Ann Arbor, MI 48109-2029, United States.ORCID 0000-0003-0118-4561

Funding

Technology to Empower Changes in Health (TECH) Network Participant Technologies CenterU24OD023176 · OD · SCRIPPS RESEARCH INSTITUTE, THE · PI TOPOL, ERIC JEFFREY · 2016 to 2022
$204.7M
Precision Medicine Initiative Cohort Program BiobankU24OD023121 · OD · MAYO CLINIC ROCHESTER · PI CEKANOVA, MARIA, CICEK, MINE · 2016 to 2024
$185.5M
XenograftP30CA046592 · NCI · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI THEODORE S LAWRENCE · 1988 to 2026
$178.2M
Enhancing All of Us Data Resources for Nutrition Precision Health: the All of Us Data and Research CenterU2COD023196 · OD · VANDERBILT UNIVERSITY MEDICAL CENTER · PI GLAZER, DAVID, HARRIS, PAUL A. · 2016 to 2022
$143.7M
Adaptive Platform for Personalized EngagementU24OD023163 · OD · VIGNET, INC. · PI JAIN, PRADUMAN · 2017 to 2020
$102.6M
University of Arizona-Banner Health All of Us Research Program OT2OD026549 · OD · UNIVERSITY OF ARIZONA · PI MORENO, FRANCISCO A, REIMAN, ERIC MICHAEL · 2018 to 2023
$78.9M
California Precision Medicine Research Program ConsortiumOT2OD026552 · OD · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI ANTON-CULVER, HODA A, OHNO-MACHADO, LUCILA · 2018 to 2023
$73.4M
All of Us PennsylvaniaOT2OD026554 · OD · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI REIS, STEVEN E, VISWESWARAN, SHYAM · 2018 to 2023
$72.1M
New York City Consortium for Precision MedicineOT2OD026556 · OD · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI BIER, LOUISE E, GHARAVI, ALI G · 2018 to 2023
$67.3M
SouthEast Enrollment Center (SEEC) OT2OD026551 · OD · UNIVERSITY OF MIAMI SCHOOL OF MEDICINE · PI CARRASQUILLO, OLVEEN, COLON, VIVIAN · 2018 to 2023
$62.8M
Southern All of Us NetworkOT2OD026548 · OD · UNIVERSITY OF ALABAMA AT BIRMINGHAM · PI FOUAD, MONA N., KORF, BRUCE R · 2018 to 2023
$60.5M
Illinois Precision Medicine Consortium OT2OD026557 · OD · NORTHWESTERN UNIVERSITY AT CHICAGO · PI AHSAN, HABIBUL, ARGOS, MARIA · 2018 to 2023
$60.5M
NCI NIH HHS P30 CA046592NCI NIH HHS P30CA046592NCI NIH HHS UG3 CA267907NCI NIH HHS UH3 CA267907NIH HHS OT2 OD023205NIH HHS OT2 OD023206NIH HHS OT2 OD025276NIH HHS OT2 OD025277NIH HHS OT2 OD025315NIH HHS OT2 OD025337NIH HHS OT2 OD026548NIH HHS OT2 OD026549NIH HHS OT2 OD026550NIH HHS OT2 OD026551NIH HHS OT2 OD026552NIH HHS OT2 OD026553NIH HHS OT2 OD026554NIH HHS OT2 OD026555NIH HHS OT2 OD026556NIH HHS OT2 OD026557NIH HHS U24 OD023121NIH HHS U24 OD023163NIH HHS U24 OD023176NIH HHS U2C OD023196Training, Education, and Career Development Graduate Student ScholarshipUniversity of Michigan Rogel Cancer Center
6 · The paper itself

Abstract

objectivesTo develop recommendations regarding the use of weights to reduce selection bias for commonly performed analyses using electronic health record (EHR)-linked biobank data. MATERIALS AND

methodsWe mapped diagnosis (ICD code) data to standardized phecodes from 3 EHR-linked biobanks with varying recruitment strategies: All of Us (AOU; n = 244 071), Michigan Genomics Initiative (MGI; n = 81 243), and UK Biobank (UKB; n = 401 167). Using 2019 National Health Interview Survey data, we constructed selection weights for AOU and MGI to represent the US adult population more. We used weights previously developed for UKB to represent the UKB-eligible population. We conducted 4 common analyses comparing unweighted and weighted results.

resultsFor AOU and MGI, estimated phecode prevalences decreased after weighting (weighted-unweighted median phecode prevalence ratio [MPR]: 0.82 and 0.61), while UKB estimates increased (MPR: 1.06). Weighting minimally impacted latent phenome dimensionality estimation. Comparing weighted versus unweighted phenome-wide association study for colorectal cancer, the strongest associations remained unaltered, with considerable overlap in significant hits. Weighting affected the estimated log-odds ratio for sex and colorectal cancer to align more closely with national registry-based estimates. DISCUSSION: Weighting had a limited impact on dimensionality estimation and large-scale hypothesis testing but impacted prevalence and association estimation. When interested in estimating effect size, specific signals from untargeted association analyses should be followed up by weighted analysis.

conclusionEHR-linked biobanks should report recruitment and selection mechanisms and provide selection weights with defined target populations. Researchers should consider their intended estimands, specify source and target populations, and weight EHR-linked biobank analyses accordingly.

Indexed as

Biological Specimen BanksElectronic Health RecordsAdultAgedFemaleHumansMaleMedical Record LinkageMichiganMiddle AgedSelection BiasUnited KingdomUnited Statesbiobankelectronic health recordsICD codesphenomeselection bias

Identifiers

PMID38742457
PMCPMC11187425

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.