Evidence map›Paper›PMID 26122527›Full record

ArticleJournal of biomedical informatics2015

The role of fine-grained annotations in supervised recognition of risk factors for heart disease from EHRs.

Kirk Roberts, Sonya E Shooshan, Laritza Rodriguez, Swapna Abhyankar, Halil Kilicoglu, Dina Demner-Fushman

Abstract read
In one paragraph

Article in Journal of biomedical informatics, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Review
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Inferring the Interactions of Risk Factors from EHRs.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2016
    Article
  12. Review
  13. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Kirk RobertsLister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, Bethesda, MD, USA. Electronic address: kirk.roberts@nih.gov.
Sonya E ShooshanLister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
Laritza RodriguezLister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
Swapna AbhyankarLister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
Halil KilicogluLister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
Dina Demner-FushmanLister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, Bethesda, MD, USA.

Funding

Challenges in Natural Language Processing in Clinical TextR13LM011411 · NLM · STATE UNIVERSITY OF NEW YORK AT ALBANY · PI UZUNER, OZLEM · 2012 to 2016
$98k
Intramural NIH HHS Z99 LM999999NLM NIH HHS R13 LM011411
6 · The paper itself

Abstract

This paper describes a supervised machine learning approach for identifying heart disease risk factors in clinical text, and assessing the impact of annotation granularity and quality on the system's ability to recognize these risk factors. We utilize a series of support vector machine models in conjunction with manually built lexicons to classify triggers specific to each risk factor. The features used for classification were quite simple, utilizing only lexical information and ignoring higher-level linguistic information such as syntax and semantics. Instead, we incorporated high-quality data to train the models by annotating additional information on top of a standard corpus. Despite the relative simplicity of the system, it achieves the highest scores (micro- and macro-F1, and micro- and macro-recall) out of the 20 participants in the 2014 i2b2/UTHealth Shared Task. This system obtains a micro- (macro-) precision of 0.8951 (0.8965), recall of 0.9625 (0.9611), and F1-measure of 0.9276 (0.9277). Additionally, we perform a series of experiments to assess the value of the annotated data we created. These experiments show how manually-labeled negative annotations can improve information extraction performance, demonstrating the importance of high-quality, fine-grained natural language annotations.

Indexed as

Natural Language ProcessingSupervised Machine LearningAgedCohort StudiesComorbidityComputer SecurityConfidentialityCoronary Artery DiseaseData MiningDiabetes ComplicationsElectronic Health RecordsFemaleHumansIncidenceLongitudinal StudiesMaleMachine learningNatural language annotationNatural language processing

Identifiers

PMID26122527
PMCPMC4988795

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.