Evidence map›Paper›PMID 41726483›Full record

ArticleAMIA ... Annual Symposium proceedings. AMIA Symposium2024

Facilitating Clinical Information Extraction with Synthetic Data and Ontology using Large Language Models.

Yan Hu, Huan He, Qingyu Chen, Xiaoqian Jiang, Kirk Roberts, Hua Xu

Abstract read
In one paragraph

Article in AMIA ... Annual Symposium proceedings. AMIA Symposium, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Yan HuMcwilliam School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA.
Huan HeDepartment of Biomedical Informatics and Data Science, Yale School of Medicine, Yale University, New Haven, USA.
Qingyu ChenDepartment of Biomedical Informatics and Data Science, Yale School of Medicine, Yale University, New Haven, USA.
Xiaoqian JiangMcwilliam School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA.
Kirk RobertsMcwilliam School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA.
Hua XuDepartment of Biomedical Informatics and Data Science, Yale School of Medicine, Yale University, New Haven, USA.

Funding

Yale Study Support Suite (YES3): Dashboard and Web Portal Software Supporting Research Workflow through integrated, customizable REDCap External ModulesP30AG021342 · NIA · YALE UNIVERSITY · PI Albert C Shaw · 2002 to 2026
$37.9M
Leveraging Longitudinal Data and Informatics Technology to Understand the Role of Bilingualism in Cognitive Resilience, Aging and DementiaR01AG080429 · NIA · BRIGHAM AND WOMEN'S HOSPITAL · PI Michelle L Dossett, HUA XU · 2023 to 2026
$5.5M
AIM-AI: an Actionable, Integrated and Multiscale genetic map of Alzheimer's disease via deep learningU01AG079847 · NIA · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI Christopher A. Gaiteri, Xiaoqian Jiang · 2023 to 2026
$5.1M
Finding Combinatorial Drug Repositioning Therapy For Alzheimer'S Disease And Related DementiasR01AG066749 · NIA · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI JIANG, XIAOQIAN, ZHENG, WENJIN JIM · 2020 to 2024
$4.4M
Detecting synergistic effects of pharmacological and non-pharmacological interventions for AD/ADRDR01AG078154 · NIA · UNIVERSITY OF MINNESOTA · PI HUA XU, RUI ZHANG · 2022 to 2026
$4.2M
Facilitate Observational Studies of Alzheimer's Disease and Alzheimer's Disease-Related Dementias Using Ontology and Natural Language ProcessingRF1AG072799 · NIA · YALE UNIVERSITY · PI LIU, HONGFANG, TAO, CUI · 2021 to 2021
$2.4M
Harmonizing multiple clinical trials for Alzheimer's disease to investigate differential responses to treatment via federated counterfactual learningR01AG082721 · NIA · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI Xiaoqian Jiang, Yejin Kim · 2023 to 2026
$2.0M
NIA NIH HHS P30 AG021342NIA NIH HHS R01 AG066749NIA NIH HHS R01 AG078154NIA NIH HHS R01 AG080429NIA NIH HHS R01 AG082721NIA NIH HHS RF1 AG072799NIA NIH HHS U01 AG079847
6 · The paper itself

Abstract

The rapid growth of unstructured clinical text in electronic health records necessitates robust information extraction systems, yet their development is hindered by the scarcity of high-quality annotated data. This study explores the potential of large language models to generate synthetic data for clinical named entity recognition and examines its impact on model performance. We propose a novel framework that integrates self-verified synthetic data generation with domain-specific semantic mapping using SNOMED-CT. By leveraging GPT-4o-mini for synthetic data creation and refining its quality through iterative verification and anomaly detection, we systematically evaluate the influence of synthetic data quality and quantity on fine-tuning LLaMA-3-8B. Experimental results across four datasets (MTSamples, UTP, MIMIC-III, and i2b2) demonstrate that self-verification and semantic mapping significantly enhance synthetic data utility, improving model generalizability. Our findings highlight the importance of balancing human-annotated and synthetic data, with a 1:1 ratio emerging as the optimal configuration for performance gains. This study advances clinical NLP by providing a scalable approach to mitigating annotation challenges while improving model performance.

Indexed as

Biological OntologiesElectronic Health RecordsInformation Storage and RetrievalLarge Language ModelsHumansSemanticsSystematized Nomenclature of Medicine

Identifiers

PMID41726483
PMCPMC12919538

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.