Evidence map›Paper›PMID 31504605›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2020

Identifying relations of medications with adverse drug events using recurrent convolutional neural networks and gradient boosting.

Xi Yang, Jiang Bian, Ruogu Fang, Ragnhildur I Bjarnadottir, William R Hogan, Yonghui Wu

Abstract readComparative Study
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 30 papers.

0numbers the graph read from it
0cells of the map it votes in
30citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

30 citing papers in PubMed.

  1. AI-Based Automation for Medication Reconciliation: Scoping Review.Journal of medical Internet research · 2026
    Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Clinical concept and relation extraction using prompt-based machine reading comprehension.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  15. Article
  16. Machine learning approaches for electronic health records phenotyping: a methodical review.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Xi YangDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, Florida, USA.
Jiang BianDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, Florida, USA.
Ruogu FangJ. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, Florida, USA.
Ragnhildur I BjarnadottirDepartment of Family, Community and Health Systems Science, College of Nursing, University of Florida, Gainesville, Florida, USA.
William R HoganDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, Florida, USA.
Yonghui WuDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, Florida, USA.

Funding

Using social networks to map and evaluate team science across CTSA hubsUL1TR001427 · NCATS · UNIVERSITY OF FLORIDA · PI MITCHELL, DUANE A. · 2015 to 2024
$37.2M
University of Florida Older Americans Independence Center (OAIC)P30AG028740 · NIA · UNIVERSITY OF FLORIDA · PI CHRISTIAAN LEEUWENBURGH · 2007 to 2026
$22.8M
Advancing Interdisciplinary Science of Aging through Identification of Iatrogenic Complications: The UF EHR Clinical Data Infrastructure for Enhanced Patient Safety among the Elderly (UF-ECLIPSE)R33AG062884 · NIA · UNIVERSITY OF FLORIDA · PI INGIBJARGARDOTTIR BJARNADOTTIR, RAGNHILDUR, LUCERO, ROBERT J · 2021 to 2023
$2.1M
Advancing Interdisciplinary Science of Aging through Identification of Iatrogenic Complications: The UF EHR Clinical Data Infrastructure for Enhanced Patient Safety among the Elderly (UF-ECLIPSE)R21AG062884 · NIA · UNIVERSITY OF FLORIDA · PI INGIBJARGARDOTTIR BJARNADOTTIR, RAGNHILDUR, LUCERO, ROBERT J · 2019 to 2020
$415k
National NLP Clinical Challenges (n2c2): Challenges in Natural Language Processing for Clinical NarrativesR13LM013127 · NLM · GEORGE MASON UNIVERSITY · PI UZUNER, OZLEM · 2019 to 2023
$100k
Challenges in Natural Language Processing in Clinical TextR13LM011411 · NLM · STATE UNIVERSITY OF NEW YORK AT ALBANY · PI UZUNER, OZLEM · 2012 to 2016
$98k
NCATS NIH HHS UL1 TR001427NIA NIH HHS P30 AG028740NIA NIH HHS R21 AG062884NIA NIH HHS R33 AG062884NLM NIH HHS R13 LM011411NLM NIH HHS R13 LM013127
6 · The paper itself

Abstract

objectiveTo develop a natural language processing system that identifies relations of medications with adverse drug events from clinical narratives. This project is part of the 2018 n2c2 challenge. MATERIALS AND

methodsWe developed a novel clinical named entity recognition method based on an recurrent convolutional neural network and compared it to a recurrent neural network implemented using the long-short term memory architecture, explored methods to integrate medical knowledge as embedding layers in neural networks, and investigated 3 machine learning models, including support vector machines, random forests and gradient boosting for relation classification. The performance of our system was evaluated using annotated data and scripts provided by the 2018 n2c2 organizers.

resultsOur system was among the top ranked. Our best model submitted during this challenge (based on recurrent neural networks and support vector machines) achieved lenient F1 scores of 0.9287 for concept extraction (ranked third), 0.9459 for relation classification (ranked fourth), and 0.8778 for the end-to-end relation extraction (ranked second). We developed a novel named entity recognition model based on a recurrent convolutional neural network and further investigated gradient boosting for relation classification. The new methods improved the lenient F1 scores of the 3 subtasks to 0.9292, 0.9633, and 0.8880, respectively, which are comparable to the best performance reported in this challenge.

conclusionThis study demonstrated the feasibility of using machine learning methods to extract the relations of medications with adverse drug events from clinical narratives.

Indexed as

Deep LearningDrug-Related Side Effects and Adverse ReactionsElectronic Health RecordsNatural Language ProcessingNeural Networks, ComputerHumansInformation Storage and RetrievalNarrationclinical natural language processingdeep learningnamed entity recognitionrecurrent convolutional neural networkrelation extraction

Identifiers

PMID31504605
PMCPMC7489076

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.