ArticleProceedings of machine learning research2021
MIMIC-SBDH: A Dataset for Social and Behavioral Determinants of Health.
Article in Proceedings of machine learning research, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 20 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
20 citing papers in PubMed.
- Scalable extraction of social determinants of health from clinical notes in a sepsis cohort using instruction-tuned language models.JAMIA open · 2026Article
- ClinNoteAgents: An LLM Multi-Agent System for Predicting and Interpreting Heart Failure 30-Day Readmission from Clinical Notes.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2026Article
- SDoH-GPT: using large language models to extract social determinants of health.Journal of the American Medical Informatics Association : JAMIA · 2026Article
- Predicting suicide death among veterans after psychiatric hospitalization using transformer based models with social determinants and NLP.Scientific reports · 2025Article
- Synth-SBDH: A Synthetic Dataset of Social and Behavioral Determinants of Health for Clinical Text.Proceedings of the Conference on Empirical Methods in Natural Language Processing. Conference on Empirical Methods in Natural Language Processing · 2025Article
- Predicting Behavioral Determinants of Health from Clinical Text Using Transformer Models and BiLSTM.medRxiv : the preprint server for health sciences · 2025Article
- SBDH-Reader: a large language model-powered method for extracting social and behavioral determinants of health from clinical notes.Journal of the American Medical Informatics Association : JAMIA · 2025Article
- The Role of the Multidisciplinary Team for Opioid Stewardship: A Scoping Review.Journal of multidisciplinary healthcare · 2025Review
- Integrating Social Determinants of Health into Knowledge Graphs: Evaluating Prediction Bias and Fairness in Healthcare.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2025Article
- ODD: A Benchmark Dataset for the Natural Language Processing Based Opioid Related Aberrant Behavior Detection.Proceedings of the conference. Association for Computational Linguistics. North American Chapter. Meeting · 2024Article
- Stressful life events in electronic health records: a scoping review.Journal of the American Medical Informatics Association : JAMIA · 2024Article
- Question-answering system extracts information on injection drug use from clinical notes.Communications medicine · 2024Article
- Utilizing patient-nurse verbal communication in building risk identification models: the missing critical data stream in home healthcare.Journal of the American Medical Informatics Association : JAMIA · 2024Article
- Boosting Social Determinants of Health Extraction with Semantic Knowledge Augmented Large Language Model.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2024Article
- Realizing the potential of social determinants data in EHR systems: A scoping review of approaches for screening, linkage, extraction, analysis, and interventions.Journal of clinical and translational science · 2024Article
- Stressful life events in electronic health records: a scoping review.Research square · 2023Article
- Automated identification of eviction status from electronic health record notes.Journal of the American Medical Informatics Association : JAMIA · 2023Article
- Benchmarking Transformer-Based Models for Identifying Social Determinants of Health in Clinical Notes.Proceedings. IEEE International Conference on Healthcare Informatics · 2023Article
- Capturing Individual-level Social Determinants from Clinical Text.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2023Article
- Balancing Model Complexity and Clinical Deployability in Deep Learning for Sociodemographic Information Extraction.Journal of primary care & community healthArticle
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
4 authors.
Funding
Abstract
Social and Behavioral Determinants of Health (SBDHs) are environmental and behavioral factors that have a profound impact on health and related outcomes. Given their importance, physicians document SBDHs of their patients in Electronic Health Records (EHRs). However, SBDHs are mostly documented in unstructured EHR notes. Determining the status of the SBDHs requires manually reviewing the notes which can be a tedious process. Therefore, there is a need to automate identifying the patients' SBDH status in EHR notes. In this work, we created MIMIC-SBDH, the first publicly available dataset of EHR notes annotated for patients' SBDH status. Specifically, we annotated 7,025 discharge summary notes for the status of 7 SBDHs as well as marked SBDH-related keywords. Using this annotated data for training and evaluation, we evaluated the performance of three machine learning models (Random Forest, XGBoost, and Bio-ClinicalBERT) on the task of identifying SBDH status in EHR notes. The performance ranged from the lowest 0.69 F1 score for Drug Use to the highest 0.96 F1 score for Community-Present. In addition to standard evaluation metrics such as the F1 score, we evaluated four capabilities that a model must possess to perform well on the task using the CheckList tool (Ribeiro et al., 2020). The results revealed several shortcomings of the models. Our results highlighted the need to perform more capability-centric evaluations in addition to standard metric comparisons.
Identifiers
35005628PMC8734043What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.