Evidence map›Paper›PMID 24833775›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA

Patient-level temporal aggregation for text-based asthma status ascertainment.

Stephen T Wu, Young J Juhn, Sunghwan Sohn, Hongfang Liu

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

19 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Validating exacerbations of asthma in electronic health records: a systematic review.European respiratory review : an official journal of the European Respiratory Society · 2026
    Pooled it
  2. Trial
  3. Article
  4. Article
  5. Association of delayed asthma diagnosis with asthma exacerbations in children.The journal of allergy and clinical immunology. Global · 2025
    Article
  6. Article
  7. Review
  8. Extracting Smoking Status from Electronic Health Records Using NLP and Deep Learning.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2020
    Article
  9. Review
  10. Modeling asynchronous event sequences with RNNs.Journal of biomedical informatics · 2018
    Article
  11. Article
  12. Article
  13. Article
  14. Building a Natural Language Processing Tool to Identify Patients With High Clinical Suspicion for Kawasaki Disease from Emergency Department Notes.Academic emergency medicine : official journal of the Society for Academic Emergency Medicine · 2016
    Article
  15. Article
  16. Trends in biomedical informatics: automated topic analysis of JAMIA articles.Journal of the American Medical Informatics Association : JAMIA · 2015
    Article
  17. Automated methods for the summarization of electronic health records.Journal of the American Medical Informatics Association : JAMIA · 2015
    Review
  18. Semi-supervised Learning for Phenotyping Tasks.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2015
    Article
  19. Natural Language Processing for Asthma Ascertainment in Different Practice Settings.The journal of allergy and clinical immunology. In practice
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Stephen T WuDepartment of Health Sciences Research, Mayo Clinic, Rochester, Minnesota, USA.
Young J JuhnDepartment of Community Pediatric and Adolescent Medicine, Mayo Clinic, Rochester, Minnesota, USA.
Sunghwan SohnDepartment of Health Sciences Research, Mayo Clinic, Rochester, Minnesota, USA.
Hongfang LiuDepartment of Health Sciences Research, Mayo Clinic, Rochester, Minnesota, USA.

Funding

Mayo Clinic Center for Translational Science ActivitiesUL1TR000135 · NCATS · MAYO CLINIC ROCHESTER · PI KHOSLA, SUNDEEP · 2012 to 2015
$41.2M
STANFORD COMPOSITE(RMI)U54HG004028 · NHGRI · STANFORD UNIVERSITY · PI MUSEN, MARK A · 2005 to 2014
$36.2M
Natural language processing for clinical and translational researchR01GM102282 · NIGMS · MAYO CLINIC ROCHESTER · PI LIU, HONGFANG, PAKHOMOV, SERGUEI VS · 2013 to 2016
$2.5M
Onto-BioThesaurus: ontological representation of gene/protein names for biomedicaR01LM009959 · NLM · MAYO CLINIC ROCHESTER · PI LIU, HONGFANG · 2009 to 2010
$1.2M
Risk of Herpes Zoster Among Adults with AsthmaR21AI101277 · NIAID · MAYO CLINIC ROCHESTER · PI JUHN, YOUNG J · 2012 to 2013
$432k
NCATS NIH HHS UL1 TR000135NHGRI NIH HHS U54 HG004028NIAID NIH HHS R21 AI101277NICHD NIH HHS R21 HD075961NIGMS NIH HHS R01 GM102282NIGMS NIH HHS R01GM102282NLM NIH HHS R01 LM009959NLM NIH HHS R01LM009959
6 · The paper itself

Abstract

objectiveTo specify the problem of patient-level temporal aggregation from clinical text and introduce several probabilistic methods for addressing that problem. The patient-level perspective differs from the prevailing natural language processing (NLP) practice of evaluating at the term, event, sentence, document, or visit level.

methodsWe utilized an existing pediatric asthma cohort with manual annotations. After generating a basic feature set via standard clinical NLP methods, we introduce six methods of aggregating time-distributed features from the document level to the patient level. These aggregation methods are used to classify patients according to their asthma status in two hypothetical settings: retrospective epidemiology and clinical decision support.

resultsIn both settings, solid patient classification performance was obtained with machine learning algorithms on a number of evidence aggregation methods, with Sum aggregation obtaining the highest F1 score of 85.71% on the retrospective epidemiological setting, and a probability density function-based method obtaining the highest F1 score of 74.63% on the clinical decision support setting. Multiple techniques also estimated the diagnosis date (index date) of asthma with promising accuracy. DISCUSSION: The clinical decision support setting is a more difficult problem. We rule out some aggregation methods rather than determining the best overall aggregation method, since our preliminary data set represented a practical setting in which manually annotated data were limited.

conclusionResults contrasted the strengths of several aggregation algorithms in different settings. Multiple approaches exhibited good patient classification performance, and also predicted the timing of estimates with reasonable accuracy.

Indexed as

AlgorithmsNatural Language ProcessingArtificial IntelligenceAsthmaChildClassificationDecision Making, Computer-AssistedHumansMathematical ConceptsPediatricsTimeAsthma epidemiologyInformation extractionNatural language processingPatient classification

Identifiers

PMID24833775
PMCPMC4147607

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.