Evidence map›Paper›PMID 33820755›Full record

ArticleJMIR medical informatics2021

An Attention Model With Transfer Embeddings to Classify Pneumonia-Related Bilingual Imaging Reports: Algorithm Development and Validation.

Hyung Park, Min Song, Eun Byul Lee, Bo Kyung Seo, Chang Min Choi

Open access · goldAbstract read
In one paragraph

Article in JMIR medical informatics, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
0.6field-weighted citation impact, top 28% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed, 6 citations in OpenAlex.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 2 institutions in 1 country.

Hyung Park *Department of Pulmonary and Critical Care Medicine, Asan Medical Center, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0002-5523-5144
Min Song *Yonsei University, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0003-3255-1600
Eun Byul LeeYonsei University, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0002-4859-4480
Bo Kyung SeoYonsei University, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0002-4788-6748
Chang Min ChoiDepartment of Pulmonary and Critical Care Medicine, Asan Medical Center, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0002-2881-4669
Yonsei University · KRAsan Medical Center · KR

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundIn the analysis of electronic health records, proper labeling of outcomes is mandatory. To obtain proper information from radiologic reports, several studies were conducted to classify radiologic reports using deep learning. However, the classification of pneumonia in bilingual radiologic reports has not been conducted previously.

objectiveThe aim of this research was to classify radiologic reports into pneumonia or no pneumonia using a deep learning method.

methodsA data set of radiology reports for chest computed tomography and chest x-rays of surgical patients from January 2008 to January 2018 in the Asan Medical Center in Korea was retrospectively analyzed. The classification performance of our long short-term memory (LSTM)-Attention model was compared with various deep learning and machine learning methods. The area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve, sensitivity, specificity, accuracy, and F1 score for the models were compared.

resultsA total of 5450 radiologic reports were included that contained at least one pneumonia-related word. In the test set (n=1090), our proposed model showed 91.01% (992/1090) accuracy (AUROCs for negative, positive, and obscure were 0.98, 0.97, and 0.90, respectively). The top 3 performances of the models were based on FastText or LSTM. The convolutional neural network-based model showed a lower accuracy 73.03% (796/1090) than the other 2 algorithms. The classification of negative results had an F1 score of 0.96, whereas the classification of positive and uncertain results showed a lower performance (positive F1 score 0.83; uncertain F1 score 0.62). In the extra-validation set, our model showed 80.0% (642/803) accuracy (AUROCs for negative, positive, and obscure were 0.92, 0.96, and 0.84, respectively).

conclusionsOur method showed excellent performance in classifying pneumonia in bilingual radiologic reports. The method could enrich the research on pneumonia by obtaining exact outcomes from electronic health data.

Indexed as

attentionclassificationclinical datadeep learningelectronic health recordmachine learningmedical imagingmodelnatural language processpneumonia

Identifiers

PMID33820755
PMCPMC8167619
OpenAlexW3141562410

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.