Evidence map›Paper›PMID 36826984›Full record

ArticleJMIR medical informatics2023

Near Real-time Natural Language Processing for the Extraction of Abdominal Aortic Aneurysm Diagnoses From Radiology Reports: Algorithm Development and Validation Study.

Simon Gaviria-Valencia, Sean P Murphy, Vinod C Kaggal, Robert D McBane Ii, Thom W Rooke, Rajeev Chaudhry, Mateo Alzate-Aguirre, Adelaide M Arruda-Olson

Open access · goldFull text read
In one paragraph

Article in JMIR medical informatics, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed, 1 pooled it
3.4field-weighted citation impact, top 7% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 1 synthesis or guideline pooled it, 13 citations in OpenAlex.

  1. Pooled it
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Benefits and Risks of AI in Health Care: Narrative Review.Interactive journal of medical research · 2024
    Review
  9. Article
  10. Article
  11. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 2 institutions in 1 country.

Simon Gaviria-ValenciaDivisions of Preventive Cardiology and Cardiovascular Ultrasound, Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0003-3156-2412
Sean P MurphyAdvanced Analytics Services Unit (Natural Language Processing), Department of Information Technology, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0002-6582-4065
Vinod C KaggalEnterprise Technology Services (Natural Language Processing), Department of Information Technology, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0003-0944-2211
Robert D McBane IiGonda Vascular Center, Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0001-8727-8029
Thom W RookeGonda Vascular Center, Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0003-3089-3156
Rajeev ChaudhryDepartment of Internal Medicine, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0003-1249-5656
Mateo Alzate-AguirreDivisions of Preventive Cardiology and Cardiovascular Ultrasound, Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0003-1129-238X
Adelaide M Arruda-OlsonDivisions of Preventive Cardiology and Cardiovascular Ultrasound, Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0001-9541-9899
Mayo Clinic · USMayo Clinic in Arizona · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundManagement of abdominal aortic aneurysms (AAAs) requires serial imaging surveillance to evaluate the aneurysm dimension. Natural language processing (NLP) has been previously developed to retrospectively identify patients with AAA from electronic health records (EHRs). However, there are no reported studies that use NLP to identify patients with AAA in near real-time from radiology reports.

objectiveThis study aims to develop and validate a rule-based NLP algorithm for near real-time automatic extraction of AAA diagnosis from radiology reports for case identification.

methodsThe AAA-NLP algorithm was developed and deployed to an EHR big data infrastructure for near real-time processing of radiology reports from May 1, 2019, to September 2020. NLP extracted named entities for AAA case identification and classified subjects as cases and controls. The reference standard to assess algorithm performance was a manual review of processed radiology reports by trained physicians following standardized criteria. Reviewers were blinded to the diagnosis of each subject. The AAA-NLP algorithm was refined in 3 successive iterations. For each iteration, the AAA-NLP algorithm was modified based on performance compared to the reference standard.

resultsA total of 360 reports were reviewed, of which 120 radiology reports were randomly selected for each iteration. At each iteration, the AAA-NLP algorithm performance improved. The algorithm identified AAA cases in near real-time with high positive predictive value (0.98), sensitivity (0.95), specificity (0.98), F1 score (0.97), and accuracy (0.97).

conclusionsImplementation of NLP for accurate identification of AAA cases from radiology reports with high performance in near real time is feasible. This NLP technique will support automated input for patient care and clinical decision support tools for the management of patients with AAA.  .

Indexed as

abdominal aortic aneurysmalgorithmbig dataelectronic health recordmedical recordsnatural language processingradiologyradiology reports

Identifiers

PMID36826984
PMCPMC10007015
OpenAlexW4320069765

What OpenQuestion holds

Textfull text, public
LicenceCC BY
measurements read9
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.