Evidence map›Paper›PMID 34791302›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2021

Development and validation of a prediction model for actionable aspects of frailty in the text of clinicians' encounter notes.

Jacob A Martin, Andrew Crane-Droesch, Folasade C Lapite, Joseph C Puhl, Tyler E Kmiec, Jasmine A Silvestri, Lyle H Ungar, Bruce P Kinosian, Blanca E Himes, Rebecca A Hubbard and 5 more

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. The use of natural language processing in detecting and predicting falls within the healthcare setting: a systematic review.International journal for quality in health care : journal of the International Society for Quality in Health Care · 2023
    Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Leveraging the electronic health record to identify delivery of goal-concordant care.medRxiv : the preprint server for health sciences · 2024
    Article
  9. Article
  10. Article
  11. Machine learning approaches for electronic health records phenotyping: a methodical review.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Jacob A MartinDivision of Cardiology, Department of Medicine, New York University Grossman School of Medicine, New York, New York, USA.ORCID 0000-0003-3515-132X
Andrew Crane-DroeschPalliative and Advanced Illness Research (PAIR) Center, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA.
Folasade C LapiteTulane University School of Medicine, New Orleans, Louisiana, USA.
Joseph C PuhlPalliative and Advanced Illness Research (PAIR) Center, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA.
Tyler E KmiecPalliative and Advanced Illness Research (PAIR) Center, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA.
Jasmine A SilvestriPalliative and Advanced Illness Research (PAIR) Center, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA.
Lyle H UngarDepartment of Computer and Information Science, University of Pennsylvania School of Engineering and Applied Science, Philadelphia, Pennsylvania, USA.
Bruce P KinosianLeonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pennsylvania, USA.ORCID 0000-0003-2098-6340
Blanca E HimesDepartment of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA.
Rebecca A HubbardDepartment of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA.
Joshua M DiamondPulmonary, Allergy, and Critical Care Division, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA.
Vivek AhyaPulmonary, Allergy, and Critical Care Division, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA.
Michael W SimsPulmonary, Allergy, and Critical Care Division, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA.
Scott D HalpernPalliative and Advanced Illness Research (PAIR) Center, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA.
Gary E WeissmanPalliative and Advanced Illness Research (PAIR) Center, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA.ORCID 0000-0001-9588-3819

Funding

The Penn-StARR Program for Research in ResidencyR38HL143613 · NHLBI · UNIVERSITY OF PENNSYLVANIA · PI KLEIN, PETER S · 2018 to 2021
$1.4M
Improving the fairness of RCTs among patients with acute and chronic respiratory failureK24HL143289 · NHLBI · UNIVERSITY OF PENNSYLVANIA · PI Scott D Halpern · 2018 to 2026
$1.1M
Using natural language processing and machine learning to identify potentially preventable hospital admissions among outpatients with chronic lung diseasesK23HL141639 · NHLBI · UNIVERSITY OF PENNSYLVANIA · PI WEISSMAN, GARY · 2018 to 2022
$933k
NHLBI NIH HHS K23 HL141639NHLBI NIH HHS K24 HL143289NHLBI NIH HHS R38 HL143613NIH HHS K23HL141639NIH HHS R38HL143613-01
6 · The paper itself

Abstract

objectiveFrailty is a prevalent risk factor for adverse outcomes among patients with chronic lung disease. However, identifying frail patients who may benefit from interventions is challenging using standard data sources. We therefore sought to identify phrases in clinical notes in the electronic health record (EHR) that describe actionable frailty syndromes. MATERIALS AND

methodsWe used an active learning strategy to select notes from the EHR and annotated each sentence for 4 actionable aspects of frailty: respiratory impairment, musculoskeletal problems, fall risk, and nutritional deficiencies. We compared the performance of regression, tree-based, and neural network models to predict the labels for each sentence. We evaluated performance with the scaled Brier score (SBS), where 1 is perfect and 0 is uninformative, and the positive predictive value (PPV).

resultsWe manually annotated 155 952 sentences from 326 patients. Elastic net regression had the best performance across all 4 frailty aspects (SBS 0.52, 95% confidence interval [CI] 0.49-0.54) followed by random forests (SBS 0.49, 95% CI 0.47-0.51), and multi-task neural networks (SBS 0.39, 95% CI 0.37-0.42). For the elastic net model, the PPV for identifying the presence of respiratory impairment was 54.8% (95% CI 53.3%-56.6%) at a sensitivity of 80%. DISCUSSION: Classification models using EHR notes can effectively identify actionable aspects of frailty among patients living with chronic lung disease. Regression performed better than random forest and neural network models.

conclusionsNLP-based models offer promising support to population health management programs that seek to identify and refer community-dwelling patients with frailty for evidence-based interventions.

Indexed as

FrailtyElectronic Health RecordsHumansMachine LearningNeural Networks, ComputerRisk Factorsclinicaldecision support systemsfrailtymachine learningnatural language processingpopulation health management

Identifiers

PMID34791302
PMCPMC8714261

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.