Evidence map›Paper›PMID 34052882›Full record

ArticleEuropean radiology2021

COVID-19 classification of X-ray images using deep neural networks.

Daphna Keidar, Daniel Yaron, Elisha Goldstein, Yair Shachar, Ayelet Blass, Leonid Charbinsky, Israel Aharony, Liza Lifshitz, Dimitri Lumelsky, Ziv Neeman and 18 more

Abstract read
In one paragraph

Article in European radiology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 28 papers.

0numbers the graph read from it
0cells of the map it votes in
28citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

28 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. COVID-19 Classification on Chest X-ray Images Using Deep Learning Methods.International journal of environmental research and public health · 2023
    Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

28 authors.

Daphna Keidar *ETH Zürich, Department of Computer Science, Rämistrasse 101, 8092, Zürich, Switzerland.
Daniel Yaron *Department of Math and Computer Science, Weizmann Institute of Science, Rehovot, Israel.
Elisha GoldsteinBioinformatics Unit, Life Sciences Core Facilities, Weizmann Institute of Science, Rehovot, Israel.
Yair ShacharEyeway Vision Ltd., Yoni Netanyahu St 3, Or Yehuda, Israel.
Ayelet BlassDepartment of Math and Computer Science, Weizmann Institute of Science, Rehovot, Israel.
Leonid CharbinskyDepartment of Radiology, HaEmek Medical Center, Afula, Israel.
Israel AharonyDepartment of Radiology, HaEmek Medical Center, Afula, Israel.
Liza LifshitzDepartment of Radiology, HaEmek Medical Center, Afula, Israel.
Dimitri LumelskyDepartment of Radiology, HaEmek Medical Center, Afula, Israel.
Ziv NeemanDepartment of Radiology, HaEmek Medical Center, Afula, Israel.
Matti MizrachiDepartment of Otolaryngology, Head and Neck Surgery, Galilee Medical Center, Nahariya, Israel.
Majd HajoujDepartment of Otolaryngology, Head and Neck Surgery, Galilee Medical Center, Nahariya, Israel.
Nethanel EizenbachDepartment of Otolaryngology, Head and Neck Surgery, Galilee Medical Center, Nahariya, Israel.
Eyal SelaDepartment of Otolaryngology, Head and Neck Surgery, Galilee Medical Center, Nahariya, Israel.
Chedva S WeissCardiothoracic Imaging Unit, Shaare Zedek Medical Center, Jerusalem, Israel.
Philip LevinCardiothoracic Imaging Unit, Shaare Zedek Medical Center, Jerusalem, Israel.
Ofer BenjaminovCardiothoracic Imaging Unit, Shaare Zedek Medical Center, Jerusalem, Israel.
Gil N BacharRadiology Department, Rabin Medical Center, Jabotinsky Rd 39, Petah Tikva, Israel.
Shlomit TamirRadiology Department, Rabin Medical Center, Jabotinsky Rd 39, Petah Tikva, Israel.
Yael RapsonRadiology Department, Rabin Medical Center, Jabotinsky Rd 39, Petah Tikva, Israel.
Dror SuhamiRadiology Department, Rabin Medical Center, Jabotinsky Rd 39, Petah Tikva, Israel.
Eli AtarRadiology Department, Rabin Medical Center, Jabotinsky Rd 39, Petah Tikva, Israel.
Amiel A DrorDepartment of Otolaryngology, Head and Neck Surgery, Galilee Medical Center, Nahariya, Israel.
Naama R BogotCardiothoracic Imaging Unit, Shaare Zedek Medical Center, Jerusalem, Israel.
Ahuva GrubsteinRadiology Department, Rabin Medical Center, Jabotinsky Rd 39, Petah Tikva, Israel.
Nogah ShabshinDepartment of Radiology, HaEmek Medical Center, Afula, Israel.
Yishai M ElyadaMobileye Vision Technologies, Ltd., Hartom 13, Jerusalem, Israel.
Yonina C EldarDepartment of Math and Computer Science, Weizmann Institute of Science, Rehovot, Israel. yonina.eldar@weizmann.ac.il.ORCID http://orcid.org/0000-0003-4358-5304

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesIn the midst of the coronavirus disease 2019 (COVID-19) outbreak, chest X-ray (CXR) imaging is playing an important role in diagnosis and monitoring of patients with COVID-19. We propose a deep learning model for detection of COVID-19 from CXRs, as well as a tool for retrieving similar patients according to the model's results on their CXRs. For training and evaluating our model, we collected CXRs from inpatients hospitalized in four different hospitals.

methodsIn this retrospective study, 1384 frontal CXRs, of COVID-19 confirmed patients imaged between March and August 2020, and 1024 matching CXRs of non-COVID patients imaged before the pandemic, were collected and used to build a deep learning classifier for detecting patients positive for COVID-19. The classifier consists of an ensemble of pre-trained deep neural networks (DNNS), specifically, ReNet34, ReNet50¸ ReNet152, and vgg16, and is enhanced by data augmentation and lung segmentation. We further implemented a nearest-neighbors algorithm that uses DNN-based image embeddings to retrieve the images most similar to a given image.

resultsOur model achieved accuracy of 90.3%, (95% CI: 86.3-93.7%) specificity of 90% (95% CI: 84.3-94%), and sensitivity of 90.5% (95% CI: 85-94%) on a test dataset comprising 15% (350/2326) of the original images. The AUC of the ROC curve is 0.96 (95% CI: 0.93-0.97).

conclusionWe provide deep learning models, trained and evaluated on CXRs that can assist medical efforts and reduce medical staff workload in handling COVID-19. KEY POINTS: • A machine learning model was able to detect chest X-ray (CXR) images of patients tested positive for COVID-19 with accuracy and detection rate above 90%. • A tool was created for finding existing CXR images with imaging characteristics most similar to a given CXR, according to the model's image embeddings.

Indexed as

COVID-19HumansNeural Networks, ComputerRetrospective StudiesSARS-CoV-2X-RaysCOVID-19Machine learningRadiographyThoracicX-rays

Identifiers

PMID34052882
PMCPMC8164481

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.