Evidence map›Paper›PMID 34423262›Full record

ArticleJAMIA open2021

Natural language processing for automated annotation of medication mentions in primary care visit conversations.

Craig H Ganoe, Weiyi Wu, Paul J Barr, William Haslett, Michelle D Dannenberg, Kyra L Bonasia, James C Finora, Jesse A Schoonmaker, Wambui M Onsando, James Ryan and 4 more

Open access · goldAbstract read
In one paragraph

Article in JAMIA open, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 1 pooled it
0.8field-weighted citation impact, top 28% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 1 synthesis or guideline pooled it, 12 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. AI-Based Automation for Medication Reconciliation: Scoping Review.Journal of medical Internet research · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Investigating the Fidelity of Digital Peer Support: A Preliminary Approach using Natural Language Processing to Scale High-Fidelity Digital Peer Support.Biomedical engineering systems and technologies, international joint conference, BIOSTEC ... revised selected papers. BIOSTEC (Conference) · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors at 1 institution in 1 country.

Craig H GanoeBiomedical Data Science Department, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, USA.
Weiyi WuBiomedical Data Science Department, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, USA.
Paul J BarrThe Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, USA.
William HaslettBiomedical Data Science Department, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, USA.
Michelle D DannenbergThe Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, USA.
Kyra L BonasiaThe Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, USA.
James C FinoraThe Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, USA.
Jesse A SchoonmakerThe Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, USA.
Wambui M OnsandoThe Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, USA.
James RyanRyan Family Practice, Ludington, Michigan, USA.
Glyn ElwynThe Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, USA.ORCID https://orcid.org/0000-0002-0917-6286
Martha L BruceThe Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, USA.
Amar K DasThe Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, USA.
Saeed HassanpourBiomedical Data Science Department, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, USA.ORCID https://orcid.org/0000-0001-9460-6414
Dartmouth College · US

Funding

Improving patient and caregiver engagement through the application of data science methods to audio recorded clinic visits stored in personal health librariesR01LM012815 · NLM · DARTMOUTH COLLEGE · PI BARR, PAUL JAMES, HASSANPOUR, SAEED · 2017 to 2020
$1.4M
NLM NIH HHS R01 LM012815
6 · The paper itself

Abstract

objectivesThe objective of this study is to build and evaluate a natural language processing approach to identify medication mentions in primary care visit conversations between patients and physicians. MATERIALS AND

methodsEight clinicians contributed to a data set of 85 clinic visit transcripts, and 10 transcripts were randomly selected from this data set as a development set. Our approach utilizes Apache cTAKES and Unified Medical Language System controlled vocabulary to generate a list of medication candidates in the transcribed text and then performs multiple customized filters to exclude common false positives from this list while including some additional common mentions of the supplements and immunizations.

resultsSixty-five transcripts with 1121 medication mentions were randomly selected as an evaluation set. Our proposed method achieved an F-score of 85.0% for identifying the medication mentions in the test set, significantly outperforming existing medication information extraction systems for medical records with F-scores ranging from 42.9% to 68.9% on the same test set. DISCUSSION: Our medication information extraction approach for primary care visit conversations showed promising results, extracting about 27% more medication mentions from our evaluation set while eliminating many false positives in comparison to existing baseline systems. We made our approach publicly available on the web as an open-source software.

conclusionIntegration of our annotation system with clinical recording applications has the potential to improve patients' understanding and recall of key information from their clinic visits, and, in turn, to positively impact health outcomes.

Indexed as

clinic visit recordingmedication information extractionnatural language processing

Identifiers

PMID34423262
PMCPMC8374372
OpenAlexW3195967506

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.