Evidence map›Paper›PMID 38239824›Full record

ArticleProceedings. IEEE International Conference on Healthcare Informatics2023

Benchmarking Transformer-Based Models for Identifying Social Determinants of Health in Clinical Notes.

Xiaoyu Wang, Dipankar Gupta, Michael Killian, Zhe He

Abstract read
In one paragraph

Article in Proceedings. IEEE International Conference on Healthcare Informatics, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Xiaoyu WangDepartment of Statistics Florida State University Tallahassee, FL, USA.
Dipankar GuptaCollege of Medicine University of Florida Gainesville, FL, Florida.
Michael KillianCollege of Social Work Florida State University Tallahassee, FL, USA.
Zhe HeSchool of Information Florida State University Tallahassee, FL, USA.

Funding

Using social networks to map and evaluate team science across CTSA hubsUL1TR001427 · NCATS · UNIVERSITY OF FLORIDA · PI MITCHELL, DUANE A. · 2015 to 2024
$37.2M
Prediction of Health Outcomes and Adverse Events in Pediatric Organ Transplantation in FloridaR21LM013911 · NLM · FLORIDA STATE UNIVERSITY · PI HE, ZHE, KILLIAN, MICHAEL · 2022 to 2023
$395k
NCATS NIH HHS UL1 TR001427NLM NIH HHS R21 LM013911
6 · The paper itself

Abstract

Electronic health records (EHR) have been widely used in building machine learning models for health outcomes prediction. However, many EHR-based models are inherently biased due to lack of risk factors on social determinants of health (SDoH), which are responsible for up to 40% preventive deaths. As SDoH information is often captured in clinical notes, recent efforts have been made to extract such information from notes with natural language processing and append it to other structured data. In this work, we benchmark 7 pre-trained transformer-based models, including BERT, ALBERT, BioBERT, BioClinicalBERT, RoBERTa, ELECTRA, and RoBERTa-MIMIC-Trial, for recognizing SDoH terms using a previously annotated corpus of MIMIC-III clinical notes. Our study shows that BioClinicalBERT model performs best on F-1 scores (0.911, 0.923) under both strict and relaxed criteria. This work shows the promise of using transformer-based models for recognizing SDoH information from clinical notes.

Indexed as

Named entity recognitionNatural language processingSocial determinants of health

Identifiers

PMID38239824
PMCPMC10795706

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.