Evidence map›Paper›PMID 31719024›Full record

ArticleJMIR medical informatics2019

Combining Contextualized Embeddings and Prior Knowledge for Clinical Named Entity Recognition: Evaluation Study.

Min Jiang, Todd Sanger, Xiong Liu

Abstract read
In one paragraph

Article in JMIR medical informatics, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. TAX-Corpus: Taxonomy based Annotations for Colonoscopy Evaluation.Biomedical engineering systems and technologies, international joint conference, BIOSTEC ... revised selected papers. BIOSTEC (Conference) · 2022
    Article
  5. The h-ANN Model: Comprehensive Colonoscopy Concept Compilation Using Combined Contextual Embeddings.Biomedical engineering systems and technologies, international joint conference, BIOSTEC ... revised selected papers. BIOSTEC (Conference) · 2022
    Article
  6. DeIDNER Model: A Neural Network Named Entity Recognition Model for Use in the De-identification of Clinical Notes.Biomedical engineering systems and technologies, international joint conference, BIOSTEC ... revised selected papers. BIOSTEC (Conference) · 2022
    Article
  7. Leveraging Semantic Type Dependencies for Clinical Named Entity Recognition.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2022
    Article
  8. Article
  9. Article
  10. Article
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Min JiangEli Lilly and Company, Indianapolis, IN, United States.ORCID https://orcid.org/0000-0002-1407-0961
Todd SangerEli Lilly and Company, Indianapolis, IN, United States.ORCID https://orcid.org/0000-0002-1020-6374
Xiong LiuEli Lilly and Company, Indianapolis, IN, United States.ORCID https://orcid.org/0000-0003-4522-7228

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundNamed entity recognition (NER) is a key step in clinical natural language processing (NLP). Traditionally, rule-based systems leverage prior knowledge to define rules to identify named entities. Recently, deep learning-based NER systems have become more and more popular. Contextualized word embedding, as a new type of representation of the word, has been proposed to dynamically capture word sense using context information and has proven successful in many deep learning-based systems in either general domain or medical domain. However, there are very few studies that investigate the effects of combining multiple contextualized embeddings and prior knowledge on the clinical NER task.

objectiveThis study aims to improve the performance of NER in clinical text by combining multiple contextual embeddings and prior knowledge.

methodsIn this study, we investigate the effects of combining multiple contextualized word embeddings with classic word embedding in deep neural networks to predict named entities in clinical text. We also investigate whether using a semantic lexicon could further improve the performance of the clinical NER system.

resultsBy combining contextualized embeddings such as ELMo and Flair, our system achieves the F-1 score of 87.30% when only training based on a portion of the 2010 Informatics for Integrating Biology and the Bedside NER task dataset. After incorporating the medical lexicon into the word embedding, the F-1 score was further increased to 87.44%. Another finding was that our system still could achieve an F-1 score of 85.36% when the size of the training data was reduced to 40%.

conclusionsCombined contextualized embedding could be beneficial for the clinical NER task. Moreover, the semantic lexicon could be used to further improve the performance of the clinical NER system.

Indexed as

contextualized word embeddingdeep learningnamed entity recognitionnatural language processingprior knowledgesemantic embedding

Identifiers

PMID31719024
PMCPMC6913757

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.