Evidence map›Paper›PMID 36494374›Full record

ArticleNature communications2022

A Multifaceted benchmarking of synthetic electronic health record generation models.

Chao Yan, Yao Yan, Zhiyu Wan, Ziqi Zhang, Larsson Omberg, Justin Guinney, Sean D Mooney, Bradley A Malin

Abstract read
In one paragraph

Article in Nature communications, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 47 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
47citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

47 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Synthetic health data in Canada: A scoping review of methods, applications, and data sources.Canadian journal of public health = Revue canadienne de sante publique · 2026
    Article
  11. Review
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Artificial Intelligence Large Language Models in Cardiology.Reviews in cardiovascular medicine · 2025
    Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Chao Yan *Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA.ORCID http://orcid.org/0000-0002-6719-1388
Yao Yan *Sage Bionetworks, Seattle, WA, USA.ORCID http://orcid.org/0000-0002-6544-1478
Zhiyu Wan *Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA.ORCID http://orcid.org/0000-0003-3752-5778
Ziqi ZhangDepartment of Computer Science, Vanderbilt University, Nashville, TN, USA.ORCID http://orcid.org/0000-0002-3184-0147
Larsson OmbergSage Bionetworks, Seattle, WA, USA.ORCID http://orcid.org/0000-0002-4719-9120
Justin GuinneyDepartment of Biomedical Informatics and Medical Education, University of Washington, Seattle, WA, USA.
Sean D MooneyDepartment of Biomedical Informatics and Medical Education, University of Washington, Seattle, WA, USA. sdmooney@uw.edu.
Bradley A MalinDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA. b.malin@vumc.org.ORCID http://orcid.org/0000-0003-3040-5175

Funding

AIM-AHEAD Coordinating Center - All Four CoresOT2OD032581 · OD · UNIVERSITY OF NORTH TEXAS HLTH SCI CTR · PI Paul Avillach, Bettina M. Beech · 2021 to 2026
$168.7M
Enhancing All of Us Data Resources for Nutrition Precision Health: the All of Us Data and Research CenterU2COD023196 · OD · VANDERBILT UNIVERSITY MEDICAL CENTER · PI GLAZER, DAVID, HARRIS, PAUL A. · 2016 to 2022
$143.7M
Vanderbilt Institute for Clinical and Translational Research (VICTR) -Identifying correlates of functional immunity in SARS-CoV-2 convalescent plasmaUL1TR002243 · NCATS · VANDERBILT UNIVERSITY MEDICAL CENTER · PI Paul A. Harris, Wesley H Self · 2017 to 2026
$130.7M
Transform Dissemination and Implementation Science in CTSA ProgramsUL1TR002319 · NCATS · UNIVERSITY OF WASHINGTON · PI John K. Amory · 2017 to 2026
$100.0M
THERAPEUTIC EFFECTS OF INTRA-NASAL INSULIN DETEMIRP50AG005136 · NIA · UNIVERSITY OF WASHINGTON · PI GRABOWSKI, THOMAS J. · 1985 to 2019
$57.2M
Ethics Core (FABRIC)U54HG012510 · NHGRI · YALE UNIVERSITY · PI MALIN, BRADLEY A. · 2022 to 2025
$11.2M
UW Core Center for Clinical Research of Musculoskeletal ConditionsP30AR072572 · NIAMS · UNIVERSITY OF WASHINGTON · PI Pradeep Suri · 2017 to 2026
$8.3M
Genetic Privacy and Identity in Community Settings - GetPreCiSeRM1HG009034 · NHGRI · VANDERBILT UNIVERSITY MEDICAL CENTER · PI CLAYTON, ELLEN WRIGHT, MALIN, BRADLEY A. · 2016 to 2024
$8.3M
NCATS NIH HHS UL1 TR002243NCATS NIH HHS UL1 TR002319NHGRI NIH HHS RM1 HG009034NHGRI NIH HHS U54 HG012510NIAMS NIH HHS P30 AR072572NIA NIH HHS P50 AG005136NIH HHS OT2 OD032581NIH HHS U2C OD023196U.S. Department of Health & Human Services | National Institutes of Health (NIH) UL1TR002243
6 · The paper itself

Abstract

Synthetic health data have the potential to mitigate privacy concerns in supporting biomedical research and healthcare applications. Modern approaches for data generation continue to evolve and demonstrate remarkable potential. Yet there is a lack of a systematic assessment framework to benchmark methods as they emerge and determine which methods are most appropriate for which use cases. In this work, we introduce a systematic benchmarking framework to appraise key characteristics with respect to utility and privacy metrics. We apply the framework to evaluate synthetic data generation methods for electronic health records data from two large academic medical centers with respect to several use cases. The results illustrate that there is a utility-privacy tradeoff for sharing synthetic health data and further indicate that no method is unequivocally the best on all criteria in each use case, which makes it evident why synthetic data generation methods need to be assessed in context.

Indexed as

Biomedical ResearchElectronic Health RecordsBenchmarkingPrivacy

Identifiers

PMID36494374
PMCPMC9734113

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.