Evidence map›Paper›PMID 40379919›Full record

ArticleNPJ digital medicine2025

Social determinants of health extraction from clinical notes across institutions using large language models.

Vipina K Keloth, Salih Selek, Qingyu Chen, Christopher Gilman, Sunyang Fu, Yifang Dang, Xinghan Chen, Xinyue Hu, Yujia Zhou, Huan He and 6 more

Abstract read
In one paragraph

Article in NPJ digital medicine, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 18 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
18citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

18 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Comparing LLM and Fine-Tuned Model Performance on NVDRS Circumstance Extraction with Varying Prompt Complexity.Proceedings. IEEE International Conference on Healthcare Informatics · 2026
    Article
  12. Review
  13. Review
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

16 authors.

Vipina K KelothDepartment of Biomedical Informatics and Data Science, Yale School of Medicine, New Haven, CT, USA.
Salih SelekDepartment of Psychiatry and Behavioral Sciences, UTHealth McGovern Medical School, Houston, TX, USA.
Qingyu ChenDepartment of Biomedical Informatics and Data Science, Yale School of Medicine, New Haven, CT, USA.
Christopher GilmanDepartment of Biomedical Informatics and Data Science, Yale School of Medicine, New Haven, CT, USA.
Sunyang FuMcWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX, USA.ORCID http://orcid.org/0000-0003-1691-5179
Yifang DangMcWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX, USA.ORCID http://orcid.org/0000-0002-4014-2957
Xinghan ChenSchool of Public Health, University of Texas Health Science Center at Houston, Houston, TX, USA.
Xinyue HuDepartment of Artificial Intelligence and Informatics, Mayo Clinic, Jacksonville, FL, USA.
Yujia ZhouDepartment of Biomedical Informatics and Data Science, Yale School of Medicine, New Haven, CT, USA.
Huan HeDepartment of Biomedical Informatics and Data Science, Yale School of Medicine, New Haven, CT, USA.
Jungwei W FanDepartment of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN, USA.ORCID http://orcid.org/0000-0001-6349-3752
Karen WangDepartment of Biomedical Informatics and Data Science, Yale School of Medicine, New Haven, CT, USA.ORCID http://orcid.org/0000-0002-7866-9498
Cynthia BrandtDepartment of Biomedical Informatics and Data Science, Yale School of Medicine, New Haven, CT, USA.
Cui TaoDepartment of Artificial Intelligence and Informatics, Mayo Clinic, Jacksonville, FL, USA.
Hongfang LiuMcWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX, USA.ORCID http://orcid.org/0000-0003-2570-3741
Hua XuDepartment of Biomedical Informatics and Data Science, Yale School of Medicine, New Haven, CT, USA. hua.xu@yale.edu.

Funding

Genetic & Social Determinants of Health: Center for Admixture Science and TechnologyRM1HG011558 · NHGRI · YALE UNIVERSITY · PI FRAZER, KELLY A, GYMREK, MELISSA · 2021 to 2025
$11.2M
Leveraging Longitudinal Data and Informatics Technology to Understand the Role of Bilingualism in Cognitive Resilience, Aging and DementiaR01AG080429 · NIA · BRIGHAM AND WOMEN'S HOSPITAL · PI Michelle L Dossett, HUA XU · 2023 to 2026
$5.5M
ACTS (AD Clinical Trial Simulation): Developing Advanced Informatics Approaches for an Alzheimer's Disease Clinical Trial Simulation SystemR01AG084236 · NIA · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI Jiang Bian, Cui Tao · 2023 to 2026
$4.1M
An end-to-end informatics framework to study Multiple Chronic Conditions (MCC)'s impact on Alzheimer's disease using harmonized electronic health recordsR01AG083039 · NIA · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI BIAN, JIANG, JIANG, XIAOQIAN · 2023 to 2025
$3.4M
Facilitate Observational Studies of Alzheimer's Disease and Alzheimer's Disease-Related Dementias Using Ontology and Natural Language ProcessingRF1AG072799 · NIA · YALE UNIVERSITY · PI LIU, HONGFANG, TAO, CUI · 2021 to 2021
$2.4M
Facilitate Observational Studies of Alzheimer's Disease and Alzheimer's Disease-Related Dementias Using Ontology and Natural Language ProcessingR01AG072799 · NIA · YALE UNIVERSITY · PI HONGFANG LIU, Cui Tao · 2025 to 2026
$1.7M
NHGRI NIH HHS RM1 HG011558NIA NIH HHS R01 AG072799NIA NIH HHS R01 AG080429NIA NIH HHS R01 AG083039NIA NIH HHS R01 AG084236NIA NIH HHS RF1 AG072799U.S. Department of Health & Human Services | NIH | National Human Genome Research Institute (NHGRI) RM1HG011558U.S. Department of Health & Human Services | NIH | National Institute on Aging (U.S. National Institute on Aging) R01AG080429U.S. Department of Health & Human Services | NIH | National Institute on Aging (U.S. National Institute on Aging) R01AG083039U.S. Department of Health & Human Services | NIH | National Institute on Aging (U.S. National Institute on Aging) R01AG084236U.S. Department of Health & Human Services | NIH | National Institute on Aging (U.S. National Institute on Aging) RF1AG072799
6 · The paper itself

Abstract

Detailed social determinants of health (SDoH) is often buried within clinical text in EHRs. Most current NLP efforts for SDoH have limitations, investigating limited factors, deriving data from a single institution, using specific patient cohorts/note types, with reduced focus on generalizability. We aim to address these issues by creating cross-institutional corpora and developing and evaluating the generalizability of classification models, including large language models (LLMs), for detecting SDoH factors using data from four institutions. Clinical notes were annotated with 21 SDoH factors at two levels: level 1 (SDoH factors only) and level 2 (SDoH factors and associated values). Compared to other models, instruction tuned LLM achieved top performance with micro-averaged F1 over 0.9 on level 1 corpora and over 0.84 on level 2 corpora. While models performed well when trained and tested on individual datasets, cross-dataset generalization highlighted remaining obstacles. Access to trained models will be made available at https://github.com/BIDS-Xu-Lab/LLMs4SDoH .

Identifiers

PMID40379919
PMCPMC12084648

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.