Evidence map›Paper›PMID 36809550›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2023

Managing re-identification risks while providing access to the All of Us research program.

Weiyi Xia, Melissa Basford, Robert Carroll, Ellen Wright Clayton, Paul Harris, Murat Kantacioglu, Yongtai Liu, Steve Nyemba, Yevgeniy Vorobeychik, Zhiyu Wan and 1 more

Erratum issuedAbstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 12 papers.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed.

  1. Review
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. DIRI: Adversarial Patient Reidentification with Large Language Models for Evaluating Clinical Text Anonymization.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2025
    Article
  8. Review
  9. Article
  10. Article
  11. The Costs of Anonymization: Case Study Using Clinical Data.Journal of medical Internet research · 2024
    Article
  12. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

11 authors.

Weiyi XiaDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.ORCID 0000-0003-0406-4944
Melissa BasfordVanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Robert CarrollDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Ellen Wright ClaytonLaw School, Vanderbilt University, Nashville, Tennessee, USA.ORCID 0000-0002-0308-4110
Paul HarrisDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Murat KantaciogluDepartment of Computer Science, University of Texas at Dallas, Dallas, Texas, USA.
Yongtai LiuDepartment of Computer Science, Vanderbilt University, Nashville, Tennessee, USA.
Steve NyembaDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Yevgeniy VorobeychikDepartment of Computer Science and Engineering, Washington University in St. Louis, St. Louis, Missouri, USA.
Zhiyu WanDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.
Bradley A MalinDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA.

Funding

Enhancing All of Us Data Resources for Nutrition Precision Health: the All of Us Data and Research CenterU2COD023196 · OD · VANDERBILT UNIVERSITY MEDICAL CENTER · PI GLAZER, DAVID, HARRIS, PAUL A. · 2016 to 2022
$143.7M
Genetic Privacy and Identity in Community Settings - GetPreCiSeRM1HG009034 · NHGRI · VANDERBILT UNIVERSITY MEDICAL CENTER · PI CLAYTON, ELLEN WRIGHT, MALIN, BRADLEY A. · 2016 to 2024
$8.3M
NHGRI NIH HHS RM1 HG009034NIH HHS U2C OD023196
6 · The paper itself

Abstract

objectiveThe All of Us Research Program makes individual-level data available to researchers while protecting the participants' privacy. This article describes the protections embedded in the multistep access process, with a particular focus on how the data was transformed to meet generally accepted re-identification risk levels.

methodsAt the time of the study, the resource consisted of 329 084 participants. Systematic amendments were applied to the data to mitigate re-identification risk (eg, generalization of geographic regions, suppression of public events, and randomization of dates). We computed the re-identification risk for each participant using a state-of-the-art adversarial model specifically assuming that it is known that someone is a participant in the program. We confirmed the expected risk is no greater than 0.09, a threshold that is consistent with guidelines from various US state and federal agencies. We further investigated how risk varied as a function of participant demographics.

resultsThe results indicated that 95th percentile of the re-identification risk of all the participants is below current thresholds. At the same time, we observed that risk levels were higher for certain race, ethnic, and genders.

conclusionsWhile the re-identification risk was sufficiently low, this does not imply that the system is devoid of risk. Rather, All of Us uses a multipronged data protection strategy that includes strong authentication practices, active monitoring of data misuse, and penalization mechanisms for users who violate terms of service.

Indexed as

Population HealthComputer SecurityFemaleHumansMalePrivacyResearch PersonnelRisk ManagementAll of Us Research Programdata privacydata sharingelectronic health records

Identifiers

PMID36809550
PMCPMC10114067

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.