Evidence map›Paper›PMID 34812397›Full record

ArticleIEEE access : practical innovations, open solutions2021

Improving Uncertainty Estimation With Semi-Supervised Deep Learning for COVID-19 Detection Using Chest X-Ray Images.

Saul Calderon-Ramirez, Shengxiang Yang, Armaghan Moemeni, Simon Colreavy-Donnelly, David A Elizondo, Luis Oala, Jorge Rodriguez-Capitan, Manuel Jimenez-Navarro, Ezequiel Lopez-Rubio, Miguel A Molina-Cabello

Open access · goldAbstract read
In one paragraph

Article in IEEE access : practical innovations, open solutions, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed, 1 pooled it
5.1field-weighted citation impact, top 4% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed, 1 synthesis or guideline pooled it, 42 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Review
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 5 institutions in 4 countries.

Saul Calderon-RamirezSchool of Computer Science and InformaticsDe Montfort University Leicester LE1 9BH U.K.
Shengxiang YangSchool of Computer Science and InformaticsDe Montfort University Leicester LE1 9BH U.K.
Armaghan MoemeniSchool of Computer ScienceUniversity of Nottingham Nottingham NG8 1BB U.K.
Simon Colreavy-DonnellySchool of Computer Science and InformaticsDe Montfort University Leicester LE1 9BH U.K.
David A ElizondoSchool of Computer Science and InformaticsDe Montfort University Leicester LE1 9BH U.K.
Luis OalaXAI GroupArtificial Intelligence DepartmentFraunhofer Heinrich Hertz Institute 10587 Berlin Germany.
Jorge Rodriguez-CapitanCIBERCVHospital Universitario Virgen de la Victoria 29010 Málaga Spain.
Manuel Jimenez-NavarroCIBERCVHospital Universitario Virgen de la Victoria 29010 Málaga Spain.
Ezequiel Lopez-RubioDepartment of Computer Languages and Computer ScienceUniversity of Málaga 29071 Málaga Spain.
Miguel A Molina-CabelloDepartment of Computer Languages and Computer ScienceUniversity of Málaga 29071 Málaga Spain.
De Montfort University · GBCentro de Investigación en Red en Enfermedades Cardiovasculares · ESFraunhofer Institute for Telecommunications, Heinrich Hertz Institute · DEInstituto Tecnológico de Costa Rica · CRUniversity of Nottingham · GB

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

In this work we implement a COVID-19 infection detection system based on chest X-ray images with uncertainty estimation. Uncertainty estimation is vital for safe usage of computer aided diagnosis tools in medical applications. Model estimations with high uncertainty should be carefully analyzed by a trained radiologist. We aim to improve uncertainty estimations using unlabelled data through the MixMatch semi-supervised framework. We test popular uncertainty estimation approaches, comprising Softmax scores, Monte-Carlo dropout and deterministic uncertainty quantification. To compare the reliability of the uncertainty estimates, we propose the usage of the Jensen-Shannon distance between the uncertainty distributions of correct and incorrect estimations. This metric is statistically relevant, unlike most previously used metrics, which often ignore the distribution of the uncertainty estimations. Our test results show a significant improvement in uncertainty estimates when using unlabelled data. The best results are obtained with the use of the Monte Carlo dropout method.

Indexed as

chest x-raycomputer aided diagnosisCoronavirusCovid-19MixMatchsemi-supervised deep learningUncertainty estimation

Identifiers

PMID34812397
PMCPMC8545186
OpenAlexW3171929138

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.