Evidence map›Paper›PMID 33664015›Full record

ArticleJMIR medical informatics2021

Extracting Family History Information From Electronic Health Records: Natural Language Processing Analysis.

Maciej Rybinski, Xiang Dai, Sonit Singh, Sarvnaz Karimi, Anthony Nguyen

Erratum issuedAbstract read
In one paragraph

Article in JMIR medical informatics, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 10 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Identifying family structures from obituaries and matching them to patients in an electronic heath record.Journal of the American Medical Informatics Association : JAMIA · 2025
    Article
  4. Enhancing patient representation learning with inferred family pedigrees improves disease risk prediction.Journal of the American Medical Informatics Association : JAMIA · 2025
    Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

5 authors.

Maciej RybinskiCommonwealth Scientific and Industrial Research Organisation, Sydney, Australia.ORCID https://orcid.org/0000-0002-0174-0567
Xiang DaiCommonwealth Scientific and Industrial Research Organisation, Sydney, Australia.ORCID https://orcid.org/0000-0002-6020-9688
Sonit SinghCommonwealth Scientific and Industrial Research Organisation, Sydney, Australia.ORCID https://orcid.org/0000-0002-6485-131X
Sarvnaz KarimiCommonwealth Scientific and Industrial Research Organisation, Sydney, Australia.ORCID https://orcid.org/0000-0002-4927-3937
Anthony NguyenCommonwealth Scientific and Industrial Research Organisation, Brisbane, Australia.ORCID https://orcid.org/0000-0002-6215-6954

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe prognosis, diagnosis, and treatment of many genetic disorders and familial diseases significantly improve if the family history (FH) of a patient is known. Such information is often written in the free text of clinical notes.

objectiveThe aim of this study is to develop automated methods that enable access to FH data through natural language processing.

methodsWe performed information extraction by using transformers to extract disease mentions from notes. We also experimented with rule-based methods for extracting family member (FM) information from text and coreference resolution techniques. We evaluated different transfer learning strategies to improve the annotation of diseases. We provided a thorough error analysis of the contributing factors that affect such information extraction systems.

resultsOur experiments showed that the combination of domain-adaptive pretraining and intermediate-task pretraining achieved an F1 score of 81.63% for the extraction of diseases and FMs from notes when it was tested on a public shared task data set from the National Natural Language Processing Clinical Challenges (N2C2), providing a statistically significant improvement over the baseline (P<.001). In comparison, in the 2019 N2C2/Open Health Natural Language Processing Shared Task, the median F1 score of all 17 participating teams was 76.59%.

conclusionsOur approach, which leverages a state-of-the-art named entity recognition model for disease mention detection coupled with a hybrid method for FM mention detection, achieved an effectiveness that was close to that of the top 3 systems participating in the 2019 N2C2 FH extraction challenge, with only the top system convincingly outperforming our approach in terms of precision.

Indexed as

clinical natural language processingdata augmentationinformation extractionnamed entity recognitionnatural language processingneural language modelingsequence tagging

Identifiers

PMID33664015
PMCPMC8092929

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.