Evidence map›Paper›PMID 32590389›Full record

ArticleCritical care medicine2020

External Validation of an Acute Respiratory Distress Syndrome Prediction Model Using Radiology Reports.

Anoop Mayampurath, Matthew M Churpek, Xin Su, Sameep Shah, Elizabeth Munroe, Bhakti Patel, Dmitriy Dligach, Majid Afshar

Open access · greenAbstract read
In one paragraph

Article in Critical care medicine, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 1 pooled it
0.9field-weighted citation impact, top 22% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 1 synthesis or guideline pooled it, 14 citations in OpenAlex.

  1. Pooled it
  2. Observational
  3. Article
  4. Article
  5. Natural language processing in the intensive care unit: A scoping review.Critical care and resuscitation : journal of the Australasian Academy of Critical Care Medicine · 2024
    Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 2 institutions in 1 country.

Anoop MayampurathUniversity of Chicago, Chicago, IL.
Matthew M ChurpekUniversity of Chicago, Chicago, IL.
Xin SuLoyola University Chicago, Maywood, IL.
Sameep ShahLoyola University Chicago, Maywood, IL.
Elizabeth MunroeUniversity of Chicago, Chicago, IL.
Bhakti PatelUniversity of Chicago, Chicago, IL.
Dmitriy DligachLoyola University Chicago, Maywood, IL.
Majid AfsharLoyola University Chicago, Maywood, IL.
Loyola University Chicago · USUniversity of Chicago · US

Funding

RESEARCH TRAINING IN RESPIRATORY BIOLOGYT32HL007605 · NHLBI · UNIVERSITY OF CHICAGO · PI Yun Fang, Gokhan M. Mutlu · 1985 to 2026
$18.1M
Temporal relation discovery for clinical textR01LM010090 · NLM · BOSTON CHILDREN'S HOSPITAL · PI MARTIN, JAMES H., SAVOVA, GUERGANA K. · 2010 to 2022
$7.1M
Learning Universal Patient Representations with Hierarchical TransformersR01LM012973 · NLM · BOSTON CHILDREN'S HOSPITAL · PI Timothy A Miller · 2019 to 2026
$3.5M
Sepsis Early Prediction and Subphenotype Illumination Study (SEPSIS)R01GM123193 · NIGMS · UNIVERSITY OF WISCONSIN-MADISON · PI CHURPEK, MATTHEW MICHAEL · 2017 to 2021
$1.9M
CHANGE OF GRANTEE INSTITUTION 1 K23 AA024503 Alcohol, Burn-Injury, and Acute Respiratory Distress SyndromeK23AA024503 · NIAAA · UNIVERSITY OF WISCONSIN-MADISON · PI AFSHAR, MAJID · 2016 to 2020
$948k
Using Machine Learning to Predict Clinical Deterioration in Hospitalized ChildrenK01HL148390 · NHLBI · UNIVERSITY OF WISCONSIN-MADISON · PI MAYAMPURATH, ANOOP · 2019 to 2023
$738k
NHLBI NIH HHS K01 HL148390NHLBI NIH HHS T32 HL007605NIAAA NIH HHS K23 AA024503NIGMS NIH HHS R01 GM123193NLM NIH HHS R01 LM010090NLM NIH HHS R01 LM012973
6 · The paper itself

Abstract

objectivesAcute respiratory distress syndrome is frequently under recognized and associated with increased mortality. Previously, we developed a model that used machine learning and natural language processing of text from radiology reports to identify acute respiratory distress syndrome. The model showed improved performance in diagnosing acute respiratory distress syndrome when compared to a rule-based method. In this study, our objective was to externally validate the natural language processing model in patients from an independent hospital setting.

designSecondary analysis of data across five prospective clinical studies.

settingAn urban, tertiary care, academic hospital. PATIENTS: Adult patients admitted to the medical ICU and at-risk for acute respiratory distress syndrome.

interventionsNone. MEASUREMENTS AND MAIN

resultsThe natural language processing model was previously derived and internally validated in burn, trauma, and medical patients at Loyola University Medical Center. Two machine learning models were examined with the following text features from qualifying radiology reports: 1) word representations (n-grams) and 2) standardized clinical named entity mentions mapped from the National Library of Medicine Unified Medical Language System. The models were externally validated in a cohort of 235 patients at the University of Chicago Medicine, among which 110 (47%) were diagnosed with acute respiratory distress syndrome by expert annotation. During external validation, the n-gram model demonstrated good discrimination between acute respiratory distress syndrome and nonacute respiratory distress syndrome patients (C-statistic, 0.78; 95% CI, 0.72-0.84). The n-gram model had a higher discrimination for acute respiratory distress syndrome when compared with the standardized named entity model, although not statistically significant (C-statistic 0.78 vs 0.72; p = 0.09). The most important features in the model had good face validity for acute respiratory distress syndrome characteristics but differences in frequencies did occur between hospital settings.

conclusionsOur computable phenotype for acute respiratory distress syndrome had good discrimination in external validation and may be used by other health systems for case-identification. Discrepancies in feature representation are likely due to differences in characteristics of the patient cohorts.

Indexed as

Intensive Care UnitsAcademic Medical CentersAdultAgedAge FactorsFemaleHospital MortalityHospitals, UrbanHumansImage Processing, Computer-AssistedMachine LearningMaleMiddle AgedNatural Language ProcessingProspective StudiesRadiography, Thoracic

Identifiers

PMID32590389
PMCPMC7872467
OpenAlexW3037695516

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.