Evidence map›Paper›PMID 25868462›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2015

Normalization of relative and incomplete temporal expressions in clinical narratives.

Weiyi Sun, Anna Rumshisky, Ozlem Uzuner

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Article
  3. Defining Phenotypes from Clinical Data to Drive Genomic Research.Annual review of biomedical data science · 2018
    Article
  4. A bibliometric analysis of natural language processing in medical research.BMC medical informatics and decision making · 2018
    Article
  5. Article
  6. An information model for computable cancer phenotypes.BMC medical informatics and decision making · 2016
    Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Weiyi SunDepartment of Informatics, University at Albany, SUNY. Albany, NY wsun2@albany.edu.
Anna RumshiskyDepartment of Computer Science, University of Massachusetts Lowell. Lowell, MA.
Ozlem UzunerDepartment of Information Studies, University at Albany, SUNY. Albany, NY.

Funding

Informatics for Integrating Biology/ the Bedside (RMI)U54LM008748 · NLM · BRIGHAM AND WOMEN'S HOSPITAL · PI KOHANE, ISAAC S. · 2004 to 2013
$39.0M
Challenges in Natural Language Processing in Clinical TextR13LM011411 · NLM · STATE UNIVERSITY OF NEW YORK AT ALBANY · PI UZUNER, OZLEM · 2012 to 2016
$98k
NLM NIH HHS 1R13LM01141101NLM NIH HHS 2U54LM008748NLM NIH HHS R13 LM011411NLM NIH HHS U54 LM008748
6 · The paper itself

Abstract

objectiveTo improve the normalization of relative and incomplete temporal expressions (RI-TIMEXes) in clinical narratives.

methodsWe analyzed the RI-TIMEXes in temporally annotated corpora and propose two hypotheses regarding the normalization of RI-TIMEXes in the clinical narrative domain: the anchor point hypothesis and the anchor relation hypothesis. We annotated the RI-TIMEXes in three corpora to study the characteristics of RI-TMEXes in different domains. This informed the design of our RI-TIMEX normalization system for the clinical domain, which consists of an anchor point classifier, an anchor relation classifier, and a rule-based RI-TIMEX text span parser. We experimented with different feature sets and performed an error analysis for each system component.

resultsThe annotation confirmed the hypotheses that we can simplify the RI-TIMEXes normalization task using two multi-label classifiers. Our system achieves anchor point classification, anchor relation classification, and rule-based parsing accuracy of 74.68%, 87.71%, and 57.2% (82.09% under relaxed matching criteria), respectively, on the held-out test set of the 2012 i2b2 temporal relation challenge. DISCUSSION: Experiments with feature sets reveal some interesting findings, such as: the verbal tense feature does not inform the anchor relation classification in clinical narratives as much as the tokens near the RI-TIMEX. Error analysis showed that underrepresented anchor point and anchor relation classes are difficult to detect.

conclusionsWe formulate the RI-TIMEX normalization problem as a pair of multi-label classification problems. Considering only RI-TIMEX extraction and normalization, the system achieves statistically significant improvement over the RI-TIMEX results of the best systems in the 2012 i2b2 challenge.

Indexed as

Electronic Health RecordsNatural Language ProcessingTimeHumansNarrationmedical language processingtemporal expression normalizationtemporal reasoning

Identifiers

PMID25868462
PMCPMC4986666

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.