Evidence map›Paper›PMID 34800704›Full record

ArticleThe journal of allergy and clinical immunology. In practice2022

Artificial Intelligence Assesses Clinicians' Adherence to Asthma Guidelines Using Electronic Health Records.

Elham Sagheb, Chung-Il Wi, Jungwon Yoon, Hee Yun Seol, Pragya Shrestha, Euijung Ryu, Miguel Park, Barbara Yawn, Hongfang Liu, Jason Homme and 2 more

Abstract read
In one paragraph

Article in The journal of allergy and clinical immunology. In practice, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Review
  2. Review
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. AI model for predicting asthma prognosis in children.The journal of allergy and clinical immunology. Global · 2025
    Article
  9. Article
  10. Article
  11. Leveraging Electronic Health Records for Guideline-Based Asthma Documentation.The journal of allergy and clinical immunology. In practice · 2023
    Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

12 authors.

Elham SaghebDepartment of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, Minn.
Chung-Il WiDepartment of Pediatric and Adolescent Medicine, Mayo Clinic, Rochester, Minn.
Jungwon YoonDepartment of Pediatrics, Myongji Hospital, Goyang, South Korea.
Hee Yun SeolPusan National University, Yangsan Hospital, Yangsan, South Korea.
Pragya ShresthaDepartment of Pediatric and Adolescent Medicine, Mayo Clinic, Rochester, Minn.
Euijung RyuDepartment of Health Sciences Research, Mayo Clinic, Rochester, Minn.
Miguel ParkDivision of Allergic Diseases, Mayo Clinic, Rochester, Minn.
Barbara YawnDepartment of Family and Community Health, University of Minnesota, Minneapolis, Minn.
Hongfang LiuDepartment of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, Minn.
Jason HommeDepartment of Pediatric and Adolescent Medicine, Mayo Clinic, Rochester, Minn.
Young JuhnDepartment of Pediatric and Adolescent Medicine, Mayo Clinic, Rochester, Minn. Electronic address: Juhn.young@mayo.edu.
Sunghwan SohnDepartment of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, Minn. Electronic address: sohn.sunghwan@mayo.edu.

Funding

Identification and characterization of children with asthma-associated comorbidities through computational and immune phenotypingR01HL126667 · NHLBI · MAYO CLINIC ROCHESTER · PI JUHN, YOUNG J, LIU, HONGFANG · 2015 to 2022
$4.3M
Secondary use of EMR for residency training in asthma care and documentationR21AI142702 · NIAID · MAYO CLINIC ROCHESTER · PI JUHN, YOUNG J, SOHN, SUNGHWAN · 2019 to 2020
$437k
NHLBI NIH HHS R01 HL126667NIAID NIH HHS R21 AI142702
6 · The paper itself

Abstract

backgroundClinicians' asthma guideline adherence in asthma care is suboptimal. The effort to improve adherence can be enhanced by assessing and monitoring clinicians' adherence to guidelines reflected in electronic health records (EHRs), which require costly manual chart review because many care elements cannot be identified by structured data.

objectiveThis study was designed to demonstrate the feasibility of an artificial intelligence tool using natural language processing (NLP) leveraging the free text EHRs of pediatric patients to extract key components of the 2007 National Asthma Education and Prevention Program guidelines.

methodsThis is a retrospective cross-sectional study using a birth cohort with a diagnosis of asthma at Mayo Clinic between 2003 and 2016. We used 1,039 clinical notes with an asthma diagnosis from a random sample of 300 patients. Rule-based NLP algorithms were developed to identify asthma guideline-congruent elements by examining care description in EHR free text.

resultsNatural language processing algorithms demonstrated a sensitivity (0.82-1.0), specificity (0.95-1.0), positive predictive value (0.86-1.0), and negative predictive value (0.92-1.0) against manual chart review for asthma guideline-congruent elements. Assessing medication compliance and inhaler technique assessment were the most challenging elements to assess because of the complexity and wide variety of descriptions.

conclusionsNatural language processing technologies may enable the automated assessment of clinicians' documentation in EHRs regarding adherence to asthma guidelines and can be a useful population management and research tool to assess and monitor asthma care quality. Multisite studies with a larger sample size are needed to assess the generalizability of these NLP algorithms.

Indexed as

AsthmaElectronic Health RecordsAlgorithmsArtificial IntelligenceChildCross-Sectional StudiesHumansRetrospective StudiesAdherence to asthma guidelinesAutomated chart reviewDocumentation variationNational asthma education and prev4ention programNatural language processing

Identifiers

PMID34800704
PMCPMC9007821

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.