Evidence map›Paper›PMID 33320104›Full record

ArticleJMIR medical informatics2020

Extracting Family History of Patients From Clinical Narratives: Exploring an End-to-End Solution With Deep Learning Models.

Xi Yang, Hansi Zhang, Xing He, Jiang Bian, Yonghui Wu

Abstract read
In one paragraph

Article in JMIR medical informatics, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed.

  1. Article
  2. AI in Childbirth and Emerging Alternatives to Traditional Fertility Treatments.Reproductive sciences (Thousand Oaks, Calif.) · 2026
    Review
  3. Review
  4. Article
  5. Article
  6. Zero-shot Learning with Minimum Instruction to Extract Social Determinants and Family History from Clinical Notes using GPT Model.Proceedings : ... IEEE International Conference on Big Data. IEEE International Conference on Big Data · 2023
    Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Xi YangDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL, United States.ORCID https://orcid.org/0000-0003-2981-3972
Hansi ZhangDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL, United States.ORCID https://orcid.org/0000-0003-4585-0888
Xing HeDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL, United States.ORCID https://orcid.org/0000-0003-0290-8058
Jiang BianDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL, United States.ORCID https://orcid.org/0000-0002-2238-5429
Yonghui WuDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL, United States.ORCID https://orcid.org/0000-0002-6780-6135

Funding

Using social networks to map and evaluate team science across CTSA hubsUL1TR001427 · NCATS · UNIVERSITY OF FLORIDA · PI MITCHELL, DUANE A. · 2015 to 2024
$37.2M
University of Florida Older Americans Independence Center (OAIC)P30AG028740 · NIA · UNIVERSITY OF FLORIDA · PI CHRISTIAAN LEEUWENBURGH · 2007 to 2026
$22.8M
The benefits and harms of lung cancer screening in FloridaR01CA246418 · NCI · UNIVERSITY OF FLORIDA · PI BIAN, JIANG, GUO, YI · 2020 to 2023
$1.7M
Using Real-world Data to Assess the Burden of Diabetes in Children and Adolescents in FloridaU18DP006512 · DP · UNIVERSITY OF FLORIDA · PI BIAN, JIANG, GUO, YI · 2020 to 2024
$1.4M
Systematic Analysis of Clinical Study Generalizability Assessment Methods with InformaticsR21AG061431 · NIA · FLORIDA STATE UNIVERSITY · PI BIAN, JIANG, HE, ZHE · 2019 to 2020
$793k
ACL HHS U18DP006512NCATS NIH HHS UL1 TR001427NCCDPHP CDC HHS U18 DP006512NCI NIH HHS R01 CA246418NIA NIH HHS P30 AG028740NIA NIH HHS R21 AG061431
6 · The paper itself

Abstract

backgroundPatients' family history (FH) is a critical risk factor associated with numerous diseases. However, FH information is not well captured in the structured database but often documented in clinical narratives. Natural language processing (NLP) is the key technology to extract patients' FH from clinical narratives. In 2019, the National NLP Clinical Challenge (n2c2) organized shared tasks to solicit NLP methods for FH information extraction.

objectiveThis study presents our end-to-end FH extraction system developed during the 2019 n2c2 open shared task as well as the new transformer-based models that we developed after the challenge. We seek to develop a machine learning-based solution for FH information extraction without task-specific rules created by hand.

methodsWe developed deep learning-based systems for FH concept extraction and relation identification. We explored deep learning models including long short-term memory-conditional random fields and bidirectional encoder representations from transformers (BERT) as well as developed ensemble models using a majority voting strategy. To further optimize performance, we systematically compared 3 different strategies to use BERT output representations for relation identification.

resultsOur system was among the top-ranked systems (3 out of 21) in the challenge. Our best system achieved micro-averaged F1 scores of 0.7944 and 0.6544 for concept extraction and relation identification, respectively. After challenge, we further explored new transformer-based models and improved the performances of both subtasks to 0.8249 and 0.6775, respectively. For relation identification, our system achieved a performance comparable to the best system (0.6810) reported in the challenge.

conclusionsThis study demonstrated the feasibility of utilizing deep learning methods to extract FH information from clinical narratives.

Indexed as

deep learningfamily historyinformation extractionnatural language processing

Identifiers

PMID33320104
PMCPMC7772072

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.