Evidence map›Paper›PMID 26171081›Full record

ArticleApplied clinical informatics2015

A Preliminary Study of Clinical Abbreviation Disambiguation in Real Time.

Y Wu, J C Denny, S T Rosenbloom, R A Miller, D A Giuse, M Song, H Xu

Abstract read
In one paragraph

Article in Applied clinical informatics, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. Article
  2. A case study in applying artificial intelligence-based named entity recognition to develop an automated ophthalmic disease registry.Graefe's archive for clinical and experimental ophthalmology = Albrecht von Graefes Archiv fur klinische und experimentelle Ophthalmologie · 2023
    Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Defining Phenotypes from Clinical Data to Drive Genomic Research.Annual review of biomedical data science · 2018
    Article
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Y WuSchool of Biomedical Informatics, The University of Texas Health Science Center at Houston , Houston, Texas, USA.
J C DennyDepartment of Biomedical Informatics Camridge, Vanderbilt University , Nashville, Tennessee, USA.
S T RosenbloomDepartment of Biomedical Informatics Camridge, Vanderbilt University , Nashville, Tennessee, USA.
R A MillerDepartment of Biomedical Informatics Camridge, Vanderbilt University , Nashville, Tennessee, USA.
D A GiuseDepartment of Biomedical Informatics Camridge, Vanderbilt University , Nashville, Tennessee, USA.
M SongDepartment of Library and Information Science, Yonsei University , Seoul, Korea.
H XuSchool of Biomedical Informatics, The University of Texas Health Science Center at Houston , Houston, Texas, USA.

Funding

Real-time Disambiguation of Abbreviations in Clinical NotesR01LM010681 · NLM · VANDERBILT UNIVERSITY · PI XU, HUA · 2010 to 2017
$3.1M
Natural language processing for clinical and translational researchR01GM102282 · NIGMS · MAYO CLINIC ROCHESTER · PI LIU, HONGFANG, PAKHOMOV, SERGUEI VS · 2013 to 2016
$2.5M
An in-silico method for epidemiological studies using Electronic Medical RecordsR01CA141307 · NCI · VANDERBILT UNIVERSITY · PI XU, HUA · 2009 to 2012
$1.0M
NCI NIH HHS R01 CA141307NCI NIH HHS R01CA141307NIGMS NIH HHS 1R01GM102282NIGMS NIH HHS R01 GM102282NLM NIH HHS R01 LM010681NLM NIH HHS R01LM010681-05
6 · The paper itself

Abstract

objectiveTo save time, healthcare providers frequently use abbreviations while authoring clinical documents. Nevertheless, abbreviations that authors deem unambiguous often confuse other readers, including clinicians, patients, and natural language processing (NLP) systems. Most current clinical NLP systems "post-process" notes long after clinicians enter them into electronic health record systems (EHRs). Such post-processing cannot guarantee 100% accuracy in abbreviation identification and disambiguation, since multiple alternative interpretations exist.

methodsAuthors describe a prototype system for real-time Clinical Abbreviation Recognition and Disambiguation (rCARD) - i.e., a system that interacts with authors during note generation to verify correct abbreviation senses. The rCARD system design anticipates future integration with web-based clinical documentation systems to improve quality of healthcare records. When clinicians enter documents, rCARD will automatically recognize each abbreviation. For abbreviations with multiple possible senses, rCARD will show a ranked list of possible meanings with the best predicted sense at the top. The prototype application embodies three word sense disambiguation (WSD) methods to predict the correct senses of abbreviations. We then conducted three experments to evaluate rCARD, including 1) a performance evaluation of different WSD methods; 2) a time evaluation of real-time WSD methods; and 3) a user study of typing clinical sentences with abbreviations using rCARD.

resultsUsing 4,721 sentences containing 25 commonly observed, highly ambiguous clinical abbreviations, our evaluation showed that the best profile-based method implemented in rCARD achieved a reasonable WSD accuracy of 88.8% (comparable to SVM - 89.5%) and the cost of time for the different WSD methods are also acceptable (ranging from 0.630 to 1.649 milliseconds within the same network). The preliminary user study also showed that the extra time costs by rCARD were about 5% of total document entry time and users did not feel a significant delay when using rCARD for clinical document entry.

conclusionThe study indicates that it is feasible to integrate a real-time, NLP-enabled abbreviation recognition and disambiguation module with clinical documentation systems.

Indexed as

Abbreviations as TopicNatural Language ProcessingDocumentationHealth PersonnelTime FactorsUser-Computer InterfaceClinical abbreviationclinical documentation systemmachine learning

Identifiers

PMID26171081
PMCPMC4493336

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.