Evidence map›Paper›PMID 24441986›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA

Word sense disambiguation in the clinical domain: a comparison of knowledge-rich and knowledge-poor unsupervised methods.

Rachel Chasin, Anna Rumshisky, Ozlem Uzuner, Peter Szolovits

Abstract readComparative Study
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Article
  4. Article
  5. A novel framework for biomedical entity sense induction.Journal of biomedical informatics · 2018
    Article
  6. A bibliometric analysis of natural language processing in medical research.BMC medical informatics and decision making · 2018
    Article
  7. Knowledge-Based Biomedical Word Sense Disambiguation with Neural Concept EmbeddingsProceedings. IEEE International Symposium on Bioinformatics and Bioengineering · 2017
    Article
  8. Semantic annotation in biomedicine: the current landscape.Journal of biomedical semantics · 2017
    Review
  9. Distinction between medical and non-medical usages of short forms in clinical narratives.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2017
    Article
  10. Trends in biomedical informatics: automated topic analysis of JAMIA articles.Journal of the American Medical Informatics Association : JAMIA · 2015
    Article
  11. Article
  12. Article
  13. Concept Modeling-based Drug Repositioning.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2015
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Rachel ChasinMassachusetts Institute of Technology, Cambridge, Massachusetts, USA.
Anna RumshiskyDepartment of Computer Science, University of Massachusetts, Lowell, Massachusetts, USA.
Ozlem UzunerDepartment of Information Studies, University at Albany, SUNY, Albany, New York, USA.
Peter SzolovitsMassachusetts Institute of Technology, Cambridge, Massachusetts, USA.

Funding

Informatics for Integrating Biology/ the Bedside (RMI)U54LM008748 · NLM · BRIGHAM AND WOMEN'S HOSPITAL · PI KOHANE, ISAAC S. · 2004 to 2013
$39.0M
UC Davis Clinical and Translational Science CenterUL1TR000002 · NCATS · UNIVERSITY OF CALIFORNIA AT DAVIS · PI BERGLUND, LARS F · 2012 to 2015
$12.2M
Challenges in Natural Language Processing in Clinical TextR13LM011411 · NLM · STATE UNIVERSITY OF NEW YORK AT ALBANY · PI UZUNER, OZLEM · 2012 to 2016
$98k
NCATS NIH HHS UL1 TR000002NLM NIH HHS R13 LM011411NLM NIH HHS U54 LM008748NLM NIH HHS U54-LM008748
6 · The paper itself

Abstract

objectiveTo evaluate state-of-the-art unsupervised methods on the word sense disambiguation (WSD) task in the clinical domain. In particular, to compare graph-based approaches relying on a clinical knowledge base with bottom-up topic-modeling-based approaches. We investigate several enhancements to the topic-modeling techniques that use domain-specific knowledge sources. MATERIALS AND

methodsThe graph-based methods use variations of PageRank and distance-based similarity metrics, operating over the Unified Medical Language System (UMLS). Topic-modeling methods use unlabeled data from the Multiparameter Intelligent Monitoring in Intensive Care (MIMIC II) database to derive models for each ambiguous word. We investigate the impact of using different linguistic features for topic models, including UMLS-based and syntactic features. We use a sense-tagged clinical dataset from the Mayo Clinic for evaluation.

resultsThe topic-modeling methods achieve 66.9% accuracy on a subset of the Mayo Clinic's data, while the graph-based methods only reach the 40-50% range, with a most-frequent-sense baseline of 56.5%. Features derived from the UMLS semantic type and concept hierarchies do not produce a gain over bag-of-words features in the topic models, but identifying phrases from UMLS and using syntax does help. DISCUSSION: Although topic models outperform graph-based methods, semantic features derived from the UMLS prove too noisy to improve performance beyond bag-of-words.

conclusionsTopic modeling for WSD provides superior results in the clinical domain; however, integration of knowledge remains to be effectively exploited.

Indexed as

Data MiningNatural Language ProcessingUnified Medical Language SystemBayes TheoremHumansKnowledge BasesLinguisticsMedical InformaticsSystematized Nomenclature of MedicineTerminology as TopicClinical Language ProcessingMedical Language ProcessingNatural Language ProcessingWord Sense Disambiguation

Identifiers

PMID24441986
PMCPMC4147600

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.