Evidence map›Paper›PMID 38750290›Full record

ArticleNPJ digital medicine2024

An in-depth evaluation of federated learning on biomedical natural language processing for information extraction.

Le Peng, Gaoxiang Luo, Sicheng Zhou, Jiandong Chen, Ziyue Xu, Ju Sun, Rui Zhang

Abstract read
In one paragraph

Article in NPJ digital medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Observational
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Le PengDepartment of Computer Science and Engineering, University of Minnesota, Minneapolis, MN, USA.ORCID http://orcid.org/0000-0001-5728-5965
Gaoxiang LuoDepartment of Computer and Information Science, University of Pennsylvania, Philadelphia, PA, USA.ORCID http://orcid.org/0000-0001-6172-9784
Sicheng ZhouInstitute for Health Informatics, University of Minnesota, Minneapolis, MN, USA.
Jiandong ChenInstitute for Health Informatics, University of Minnesota, Minneapolis, MN, USA.
Ziyue XuNvidia Corporation, Santa Clara, CA, USA.
Ju SunDepartment of Computer Science and Engineering, University of Minnesota, Minneapolis, MN, USA. jusun@umn.edu.ORCID http://orcid.org/0000-0002-2017-5903
Rui ZhangDivision of Computational Health Sciences, Department of Surgery, University of Minnesota, Minneapolis, MN, USA. zhan1386@umn.edu.ORCID http://orcid.org/0000-0001-8258-3585

Funding

A Translational Informatics Framework to Mine Efficacy and Safety of Dietary SupplementsR01AT009457 · NCCIH · UNIVERSITY OF MINNESOTA · PI RUI ZHANG · 2017 to 2026
$4.1M
SCH: A New Computational Framework for Learning from Imbalanced Biomedical DataR01CA287413 · NCI · UNIVERSITY OF MINNESOTA · PI CUI, YING, SUN, JU · 2023 to 2025
$1.2M
Cisco Systems (Cisco Systems, Inc.) 1085646 PO USA000EP390223NCCIH NIH HHS R01 AT009457NCI NIH HHS R01 CA287413
6 · The paper itself

Abstract

Language models (LMs) such as BERT and GPT have revolutionized natural language processing (NLP). However, the medical field faces challenges in training LMs due to limited data access and privacy constraints imposed by regulations like the Health Insurance Portability and Accountability Act (HIPPA) and the General Data Protection Regulation (GDPR). Federated learning (FL) offers a decentralized solution that enables collaborative learning while ensuring data privacy. In this study, we evaluated FL on 2 biomedical NLP tasks encompassing 8 corpora using 6 LMs. Our results show that: (1) FL models consistently outperformed models trained on individual clients' data and sometimes performed comparably with models trained with polled data; (2) with the fixed number of total data, FL models training with more clients produced inferior performance but pre-trained transformer-based models exhibited great resilience. (3) FL models significantly outperformed pre-trained LLMs with few-shot prompting.

Identifiers

PMID38750290
PMCPMC11096157

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.