Evidence map›Paper›PMID 42155986›Full record

ArticleJMIR medical informatics2026

Extracting Social Determinants of Health From Electronic Health Records: Development and Comparison of Rule-Based and Large Language Model Methods.

Bo Wang, Dia Kabir, Cheryl Renee Clark, Karmel W Choi, Jordan W Smoller

Abstract read
In one paragraph

Article in JMIR medical informatics, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Using reasoning LLMs to extract SDOH events from clinical notes.Proceedings. IEEE International Conference on Healthcare Informatics · 2026
    Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

5 authors.

Bo WangCenter for Precision Psychiatry, Massachusetts General Hospital, Boston, MA, United States.ORCID 0000-0002-3412-3768
Dia KabirCenter for Precision Psychiatry, Massachusetts General Hospital, Boston, MA, United States.ORCID 0009-0006-6740-7464
Cheryl Renee ClarkDepartment of Medicine, Brigham and Women's Hospital, Boston, MA, United States.ORCID 0000-0001-6782-6382
Karmel W ChoiCenter for Precision Psychiatry, Massachusetts General Hospital, Boston, MA, United States.ORCID 0000-0002-3914-2431
Jordan W SmollerCenter for Precision Psychiatry, Massachusetts General Hospital, Boston, MA, United States.ORCID 0000-0002-0381-6334

Funding

Project-001P50MH129699 · NIMH · MASSACHUSETTS GENERAL HOSPITAL · PI Andrea S Foulkes · 2023 to 2026
$16.6M
PsycheMERGE: Leveraging electronic health records and genomics for mental health researchR01MH118233 · NIMH · MASSACHUSETTS GENERAL HOSPITAL · PI DAVIS, LEA K, SMOLLER, JORDAN W · 2019 to 2022
$3.1M
2/7 PsycheMERGE: Advancing Precision PsychiatryR01MH137218 · NIMH · MASSACHUSETTS GENERAL HOSPITAL · PI JORDAN W SMOLLER · 2024 to 2026
$2.4M
Integrating Health Records, Genomic, and Social Data to Stratify Adolescent Depression RiskK08MH127413 · NIMH · MASSACHUSETTS GENERAL HOSPITAL · PI CHOI, KARMEL · 2021 to 2025
$987k
NIMH NIH HHS K08 MH127413NIMH NIH HHS P50 MH129699NIMH NIH HHS R01 MH118233NIMH NIH HHS R01 MH137218
6 · The paper itself

Abstract

backgroundSocial determinants of health (SDoH) are critical drivers of health outcomes but are often underdocumented in structured electronic health record (EHR) data. Instead, SDoH are more commonly recorded in unstructured clinical notes, and unlocking this information could have far-reaching implications for advancing population health research and informing clinical decision-making.

objectiveThis study develops and systematically evaluates cost-efficient methods for extracting SDoH information from unstructured clinical text using rule-based natural language processing (NLP) and large language model (LLM)-based approaches.

methodsWe constructed a gold-standard annotated corpus comprising clinical text segments from 171 patients in the Mass General Brigham Research Patient Data Registry, covering 7 SDoH domain categories and 23 subcategories. A rule-based system (RBS) was developed and evaluated alongside 7 OpenAI GPT models (GPT-4o, 4.1, 4.1-mini, o4-mini, GPT-5, GPT-5-mini, and o3) under zero-shot and few-shot settings using multiple prompting strategies. We additionally implemented late-fusion ensemble approaches that combined outputs from rule- and LLM-based methods. Performance was assessed using precision, recall, and F

resultsThe RBS achieved high precision for SDoH domain categories (0.96) but substantially lower recall (0.68). GPT-based models consistently outperformed the RBS in overall recall and F

conclusionsRecent GPT models with advanced reasoning capabilities, including the newly released mini models (eg, o4-mini and GPT-5-mini), demonstrated strong performance for SDoH extraction without task-specific fine-tuning and consistently outperformed the rule-based NLP system. Integrating rule- and LLM-based methods via late fusion further enhanced domain-level extraction performance. Our results demonstrate a cost-efficient framework for the accurate identification of SDoH from clinical text, facilitating downstream population health research and clinical informatics applications.

Indexed as

Data MiningElectronic Health RecordsNatural Language ProcessingSocial Determinants of HealthHumansLarge Language Modelselectronic health recordsinformation extractionlarge language modelnatural language processingrule-based systemsocial and behavioral determinants of healthsocial determinants of health

Identifiers

PMID42155986
PMCPMC13231107

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.