Evidence map›Paper›PMID 31390003›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2020

Adverse drug events and medication relation extraction in electronic health records with ensemble deep learning methods.

Fenia Christopoulou, Thy Thy Tran, Sunil Kumar Sahu, Makoto Miwa, Sophia Ananiadou

Open access · hybridAbstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 37 papers.

0numbers the graph read from it
0cells of the map it votes in
37citing papers in PubMed
5.6field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

37 citing papers in PubMed, 111 citations in OpenAlex.

  1. Review
  2. Review
  3. AI-Based Automation for Medication Reconciliation: Scoping Review.Journal of medical Internet research · 2026
    Article
  4. Review
  5. Article
  6. Efficient extraction of medication information from clinical notes: an evaluation in 2 languages.Journal of the American Medical Informatics Association : JAMIA · 2025
    Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. CACER: Clinical concept Annotations for Cancer Events and Relations.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
  13. Article
  14. Article
  15. Clinical concept and relation extraction using prompt-based machine reading comprehension.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  16. Review
  17. Article
  18. Article
  19. Article
  20. Improving medical term embeddings using UMLS Metathesaurus.BMC medical informatics and decision making · 2022
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 2 institutions in 2 countries.

Fenia ChristopoulouNational Centre for Text Mining, School of Computer Science, The University of Manchester, Manchester, United Kingdom.
Thy Thy TranNational Centre for Text Mining, School of Computer Science, The University of Manchester, Manchester, United Kingdom.
Sunil Kumar SahuNational Centre for Text Mining, School of Computer Science, The University of Manchester, Manchester, United Kingdom.
Makoto MiwaArtificial Intelligence Research Centre, National Institute of Advanced Industrial Science and Technology (AIST), Tokyo, Japan.
Sophia AnaniadouNational Centre for Text Mining, School of Computer Science, The University of Manchester, Manchester, United Kingdom.
University of Manchester · GBToyota Technological Institute · JP

Funding

National NLP Clinical Challenges (n2c2): Challenges in Natural Language Processing for Clinical NarrativesR13LM013127 · NLM · GEORGE MASON UNIVERSITY · PI UZUNER, OZLEM · 2019 to 2023
$100k
Challenges in Natural Language Processing in Clinical TextR13LM011411 · NLM · STATE UNIVERSITY OF NEW YORK AT ALBANY · PI UZUNER, OZLEM · 2012 to 2016
$98k
Biotechnology and Biological Sciences Research Council BB/M006891/1Medical Research Council MR/N00583X/1NLM NIH HHS R13 LM011411NLM NIH HHS R13 LM013127
6 · The paper itself

Abstract

objectiveIdentification of drugs, associated medication entities, and interactions among them are crucial to prevent unwanted effects of drug therapy, known as adverse drug events. This article describes our participation to the n2c2 shared-task in extracting relations between medication-related entities in electronic health records. MATERIALS AND

methodsWe proposed an ensemble approach for relation extraction and classification between drugs and medication-related entities. We incorporated state-of-the-art named-entity recognition (NER) models based on bidirectional long short-term memory (BiLSTM) networks and conditional random fields (CRF) for end-to-end extraction. We additionally developed separate models for intra- and inter-sentence relation extraction and combined them using an ensemble method. The intra-sentence models rely on bidirectional long short-term memory networks and attention mechanisms and are able to capture dependencies between multiple related pairs in the same sentence. For the inter-sentence relations, we adopted a neural architecture that utilizes the Transformer network to improve performance in longer sequences.

resultsOur team ranked third with a micro-averaged F1 score of 94.72% and 87.65% for relation and end-to-end relation extraction, respectively (Tracks 2 and 3). Our ensemble effectively takes advantages from our proposed models. Analysis of the reported results indicated that our proposed approach is more generalizable than the top-performing system, which employs additional training data- and corpus-driven processing techniques.

conclusionsWe proposed a relation extraction system to identify relations between drugs and medication-related entities. The proposed approach is independent of external syntactic tools. Analysis showed that by using latent Drug-Drug interactions we were able to significantly improve the performance of non-Drug-Drug pairs in EHRs.

Indexed as

Deep LearningDrug-Related Side Effects and Adverse ReactionsElectronic Health RecordsNatural Language ProcessingDrug InteractionsHumansInformation Storage and RetrievalNeural Networks, Computeradverse drug eventselectronic health recordsensemble methodsneural networksrelation extraction

Identifiers

PMID31390003
PMCPMC6913215
OpenAlexW2947596730

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.