Evidence map›Paper›PMID 23304375›Full record

ArticleAMIA ... Annual Symposium proceedings. AMIA Symposium2012

A comparative study of current Clinical Natural Language Processing systems on handling abbreviations in discharge summaries.

Yonghui Wu, Joshua C Denny, S Trent Rosenbloom, Randolph A Miller, Dario A Giuse, Hua Xu

Abstract readComparative Study
In one paragraph

Article in AMIA ... Annual Symposium proceedings. AMIA Symposium, 2012. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 34 papers.

0numbers the graph read from it
0cells of the map it votes in
34citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

34 citing papers in PubMed.

  1. Article
  2. Article
  3. Evaluating Large Language Models in Extracting Cognitive Exam Dates and Scores.medRxiv : the preprint server for health sciences · 2024
    Article
  4. Article
  5. Article
  6. Natural Language Processing in Nephrology.Advances in chronic kidney disease · 2022
    Review
  7. Article
  8. Drug knowledge discovery via multi-task learning and pre-trained models.BMC medical informatics and decision making · 2021
    Article
  9. Article
  10. Automated Mapping of Real-world Oncology Laboratory Data to LOINC.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2021
    Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Making sense of abbreviations in nursing notes: A case study on mortality prediction.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2019
    Article
  17. Evaluating the Impact of Dictionary Updates on Automatic Annotations Based on Clinical NLP Systems.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2019
    Article
  18. Article
  19. Expanding a radiology lexicon using contextual patterns in radiology reports.Journal of the American Medical Informatics Association : JAMIA · 2018
    Article
  20. The Data Gap in the EHR for Clinical Research Eligibility Screening.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2018
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Yonghui WuDepartment of Biomedical Informatics, School of Medicine, Vanderbilt University, Nashville, TN, USA.
Joshua C Denny
S Trent Rosenbloom
Randolph A Miller
Dario A Giuse
Hua Xu

Funding

VANDERBILT UNIVERSITY CTSA FOR PEDIATRIC RESEARCHUL1RR024975 · NCRR · VANDERBILT UNIVERSITY · PI BERNARD, GORDON RAPHAEL · 2007 to 2011
$45.7M
Real-time Disambiguation of Abbreviations in Clinical NotesR01LM010681 · NLM · VANDERBILT UNIVERSITY · PI XU, HUA · 2010 to 2017
$3.1M
NCRR NIH HHS 1UL1RR024975-01NCRR NIH HHS UL1 RR024975NLM NIH HHS R01 LM010681NLM NIH HHS R01LM010681
6 · The paper itself

Abstract

Clinical Natural Language Processing (NLP) systems extract clinical information from narrative clinical texts in many settings. Previous research mentions the challenges of handling abbreviations in clinical texts, but provides little insight into how well current NLP systems correctly recognize and interpret abbreviations. In this paper, we compared performance of three existing clinical NLP systems in handling abbreviations: MetaMap, MedLEE, and cTAKES. The evaluation used an expert-annotated gold standard set of clinical documents (derived from from 32 de-identified patient discharge summaries) containing 1,112 abbreviations. The existing NLP systems achieved suboptimal performance in abbreviation identification, with F-scores ranging from 0.165 to 0.601. MedLEE achieved the best F-score of 0.601 for all abbreviations and 0.705 for clinically relevant abbreviations. This study suggested that accurate identification of clinical abbreviations is a challenging task and that more advanced abbreviation recognition modules might improve existing clinical NLP systems.

Indexed as

Abbreviations as TopicNatural Language ProcessingPatient DischargePattern Recognition, AutomatedElectronic Health RecordsHumans

Identifiers

PMID23304375
PMCPMC3540461

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.