Evidence map›Paper›PMID 33196504›Full record

ArticleNursing research

Identifying Symptom Information in Clinical Notes Using Natural Language Processing.

Theresa A Koleck, Nicholas P Tatonetti, Suzanne Bakken, Shazia Mitha, Morgan M Henderson, Maureen George, Christine Miaskowski, Arlene Smaldone, Maxim Topaz

Open access · greenAbstract read
In one paragraph

Article in Nursing research. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 32 papers.

0numbers the graph read from it
0cells of the map it votes in
32citing papers in PubMed
2.4field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

32 citing papers in PubMed, 54 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Applying natural language processing to understand symptoms among older adult home healthcare patients with urinary incontinence.Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing · 2025
    Article
  10. Article
  11. Article
  12. Using Natural Language Processing to Identify Home Health Care Patients at Risk for Diagnosis of Alzheimer's Disease and Related Dementias.Journal of applied gerontology : the official journal of the Southern Gerontological Society · 2024
    Article
  13. Article
  14. Article
  15. Article
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 1 institution in 3 countries.

Theresa A Koleck
Nicholas P Tatonetti
Suzanne Bakken
Shazia Mitha
Morgan M Henderson
Maureen George
Christine Miaskowski
Arlene Smaldone
Maxim Topaz
Apple (Israel) · IL

Funding

Reaching Communities through the Design of Information Visualizations (ReDIVis) Toolbox to Address COVID-19 Vaccine Hesitancy and Uptake.P30NR016587 · NINR · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI BAKKEN, SUZANNE, SMALDONE, ARLENE M · 2016 to 2022
$4.3M
Precision Pharmacology and Pharmacovigilance: Leveraging AI to address drug safety knowledge gapsR35GM131905 · NIGMS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI Nicholas P Tatonetti · 2019 to 2026
$3.3M
Advancing Chronic Condition Symptom Cluster Science Through Use of Electronic Health Records and Data Science TechniquesR00NR017651 · NINR · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI KOLECK, THERESA ANN · 2020 to 2022
$722k
Advancing Chronic Condition Symptom Cluster Science Through Use of Electronic Health Records and Data Science TechniquesK99NR017651 · NINR · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI KOLECK, THERESA ANN · 2018 to 2019
$180k
NIGMS NIH HHS R35 GM131905NINR NIH HHS K99 NR017651NINR NIH HHS P30 NR016587NINR NIH HHS R00 NR017651
6 · The paper itself

Abstract

backgroundSymptoms are a core concept of nursing interest. Large-scale secondary data reuse of notes in electronic health records (EHRs) has the potential to increase the quantity and quality of symptom research. However, the symptom language used in clinical notes is complex. A need exists for methods designed specifically to identify and study symptom information from EHR notes.

objectivesWe aim to describe a method that combines standardized vocabularies, clinical expertise, and natural language processing to generate comprehensive symptom vocabularies and identify symptom information in EHR notes. We piloted this method with five diverse symptom concepts: constipation, depressed mood, disturbed sleep, fatigue, and palpitations.

methodsFirst, we obtained synonym lists for each pilot symptom concept from the Unified Medical Language System. Then, we used two large bodies of text (clinical notes from Columbia University Irving Medical Center and PubMed abstracts containing Medical Subject Headings or key words related to the pilot symptoms) to further expand our initial vocabulary of synonyms for each pilot symptom concept. We used NimbleMiner, an open-source natural language processing tool, to accomplish these tasks and evaluated NimbleMiner symptom identification performance by comparison to a manually annotated set of nurse- and physician-authored common EHR note types.

resultsCompared to the baseline Unified Medical Language System synonym lists, we identified up to 11 times more additional synonym words or expressions, including abbreviations, misspellings, and unique multiword combinations, for each symptom concept. Natural language processing system symptom identification performance was excellent. DISCUSSION: Using our comprehensive symptom vocabularies and NimbleMiner to label symptoms in clinical notes produced excellent performance metrics. The ability to extract symptom information from EHR notes in an accurate and scalable manner has the potential to greatly facilitate symptom science research.

Indexed as

Natural Language ProcessingVocabulary, ControlledConstipationDepressionElectronic Health RecordsFatigueHumansPattern Recognition, AutomatedSleep Wake DisordersSymptom AssessmentTachycardia

Identifiers

PMID33196504
PMCPMC9109773
OpenAlexW3103301438

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.