Evidence map›Paper›PMID 31197355›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2020

An ensemble of neural models for nested adverse drug events and medication extraction with subwords.

Meizhi Ju, Nhung T H Nguyen, Makoto Miwa, Sophia Ananiadou

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 18 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
18citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

18 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. AI-Based Automation for Medication Reconciliation: Scoping Review.Journal of medical Internet research · 2026
    Article
  3. Article
  4. Article
  5. Clinical concept and relation extraction using prompt-based machine reading comprehension.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  6. Article
  7. Machine learning approaches for electronic health records phenotyping: a methodical review.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Advancing the state of the art in automatic extraction of adverse drug events from narratives.Journal of the American Medical Informatics Association : JAMIA · 2020
    Article
  16. sig2db: a Workflow for Processing Natural Language from Prescription Instructions for Clinical Data Warehouses.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2020
    Article
  17. 2018 n2c2 shared task on adverse drug events and medication extraction in electronic health records.Journal of the American Medical Informatics Association : JAMIA · 2020
    Article
  18. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Meizhi JuNational Centre for Text Mining, School of Computer Science, The University of Manchester, Manchester, UK.
Nhung T H NguyenNational Centre for Text Mining, School of Computer Science, The University of Manchester, Manchester, UK.
Makoto MiwaToyota Technological Institute, Nagoya, Japan.
Sophia AnaniadouNational Centre for Text Mining, School of Computer Science, The University of Manchester, Manchester, UK.

Funding

National NLP Clinical Challenges (n2c2): Challenges in Natural Language Processing for Clinical NarrativesR13LM013127 · NLM · GEORGE MASON UNIVERSITY · PI UZUNER, OZLEM · 2019 to 2023
$100k
Challenges in Natural Language Processing in Clinical TextR13LM011411 · NLM · STATE UNIVERSITY OF NEW YORK AT ALBANY · PI UZUNER, OZLEM · 2012 to 2016
$98k
Medical Research Council MR/N00583X/1NLM NIH HHS R13 LM011411NLM NIH HHS R13 LM013127
6 · The paper itself

Abstract

objectiveThis article describes an ensembling system to automatically extract adverse drug events and drug related entities from clinical narratives, which was developed for the 2018 n2c2 Shared Task Track 2. MATERIALS AND

methodsWe designed a neural model to tackle both nested (entities embedded in other entities) and polysemous entities (entities annotated with multiple semantic types) based on MIMIC III discharge summaries. To better represent rare and unknown words in entities, we further tokenized the MIMIC III data set by splitting the words into finer-grained subwords. We finally combined all the models to boost the performance. Additionally, we implemented a featured-based conditional random field model and created an ensemble to combine its predictions with those of the neural model.

resultsOur method achieved 92.78% lenient micro F1-score, with 95.99% lenient precision, and 89.79% lenient recall, respectively. Experimental results showed that combining the predictions of either multiple models, or of a single model with different settings can improve performance. DISCUSSION: Analysis of the development set showed that our neural models can detect more informative text regions than feature-based conditional random field models. Furthermore, most entity types significantly benefit from subword representation, which also allows us to extract sparse entities, especially nested entities.

conclusionThe overall results have demonstrated that the ensemble method can accurately recognize entities, including nested and polysemous entities. Additionally, our method can recognize sparse entities by reconsidering the clinical narratives at a finer-grained subword level, rather than at the word level.

Indexed as

Drug-Related Side Effects and Adverse ReactionsElectronic Health RecordsNatural Language ProcessingNeural Networks, ComputerHumansInformation Storage and RetrievalNarrationadverse drug eventelectronic health recordinformation extractionnatural language processingnested named entity recognition

Identifiers

PMID31197355
PMCPMC6913208

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.