Evidence map›Paper›PMID 37032383›Full record

ArticleEuropean radiology experimental2023

A multicenter evaluation of a deep learning software (LungQuant) for lung parenchyma characterization in COVID-19 pneumonia.

Camilla Scapicchio, Andrea Chincarini, Elena Ballante, Luca Berta, Eleonora Bicci, Chandra Bortolotto, Francesca Brero, Raffaella Fiamma Cabini, Giuseppe Cristofalo, Salvatore Claudio Fanni and 25 more

Open access · goldAbstract readMulticenter Study
In one paragraph

Article in European radiology experimental, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
3.0field-weighted citation impact, top 9% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 13 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

35 authors at 9 institutions in 1 country.

Camilla Scapicchio *Physics Department, University of Pisa, Pisa, Italy. camilla.scapicchio@phd.unipi.it.ORCID 0000-0001-5984-0408
Andrea Chincarini *Genova Division, National Institute for Nuclear Physics, Genova, Italy.
Elena BallanteDepartment of Political and Social Sciences, University of Pavia, Pavia, Italy.
Luca BertaDepartment of Medical Physics, ASST Grande Ospedale Metropolitano Niguarda, Milan, Italy.
Eleonora BicciDepartment of Experimental and Clinical Biomedical Sciences, Radiodiagnostic Unit n. 2, University of Florence-Azienda Ospedaliero-Universitaria Careggi, Florence, Italy.
Chandra BortolottoUnit of Imaging and Radiotherapy, Department of Clinical-Surgical, Diagnostic and Pediatric Sciences, University of Pavia, Pavia, Italy.
Francesca BreroPavia Division, National Institute for Nuclear Physics, Pavia, Italy.
Raffaella Fiamma CabiniPavia Division, National Institute for Nuclear Physics, Pavia, Italy.
Giuseppe CristofaloDepartment of Biomedicine, Neuroscience and Advanced Diagnostic (BiND), University of Palermo, Palermo, Italy.
Salvatore Claudio FanniDepartment of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy.
Maria Evelina FantacciPhysics Department, University of Pisa, Pisa, Italy.
Silvia FiginiDepartment of Political and Social Sciences, University of Pavia, Pavia, Italy.
Massimo GaliaDepartment of Biomedicine, Neuroscience and Advanced Diagnostic (BiND), University of Palermo, Palermo, Italy.
Pietro GemmaPost-graduate School in Radiodiagnostics, University of Milan, Milan, Italy.
Emanuele GrassedonioDepartment of Biomedicine, Neuroscience and Advanced Diagnostic (BiND), University of Palermo, Palermo, Italy.
Alessandro LascialfariPavia Division, National Institute for Nuclear Physics, Pavia, Italy.
Cristina LenardiMilano Division, National Institute for Nuclear Physics, Milan, Italy.
Alice LionettiUnit of Imaging and Radiotherapy, Department of Clinical-Surgical, Diagnostic and Pediatric Sciences, University of Pavia, Pavia, Italy.
Francesca LizziPhysics Department, University of Pisa, Pisa, Italy.
Maurizio MarraleDepartment of Physics and Chemistry "Emilio Segrè", University of Palermo, Palermo, Italy.
Massimo MidiriDepartment of Biomedicine, Neuroscience and Advanced Diagnostic (BiND), University of Palermo, Palermo, Italy.
Cosimo NardiDepartment of Experimental and Clinical Biomedical Sciences, Radiodiagnostic Unit n. 2, University of Florence-Azienda Ospedaliero-Universitaria Careggi, Florence, Italy.
Piernicola OlivaCagliari Division, National Institute for Nuclear Physics, Monserrato, Cagliari, Italy.
Noemi PerilloPost-graduate School in Radiodiagnostics, University of Milan, Milan, Italy.
Ian PostumaPavia Division, National Institute for Nuclear Physics, Pavia, Italy.
Lorenzo PredaUnit of Imaging and Radiotherapy, Department of Clinical-Surgical, Diagnostic and Pediatric Sciences, University of Pavia, Pavia, Italy.
Vieri RastrelliDepartment of Experimental and Clinical Biomedical Sciences, Radiodiagnostic Unit n. 2, University of Florence-Azienda Ospedaliero-Universitaria Careggi, Florence, Italy.
Francesco RizzettoDepartment of Radiology, ASST Grande Ospedale Metropolitano Niguarda, Milan, Italy.
Nicola SpinaDepartment of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy.
Cinzia TalamontiDepartment Biomedical Experimental and Clinical Science "Mario Serio", University of Florence, Florence, Italy.
Alberto TorresinDepartment of Medical Physics, ASST Grande Ospedale Metropolitano Niguarda, Milan, Italy.
Angelo VanzulliDepartment of Medical Physics, ASST Grande Ospedale Metropolitano Niguarda, Milan, Italy.
Federica VolpiDepartment of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy.
Emanuele NeriDepartment of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy.
Alessandra ReticoPisa Division, National Institute for Nuclear Physics, Pisa, Italy.
Istituto Nazionale di Fisica Nucleare · ITUniversity of Pisa · ITUniversity of Milan · ITUniversity of Palermo · ITAzienda Ospedaliero-Universitaria Careggi · ITUniversity of Pavia · ITEuropean Society for Sexual Medicine · ITUniversity of Catania · ITUniversity of Sassari · IT

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe role of computed tomography (CT) in the diagnosis and characterization of coronavirus disease 2019 (COVID-19) pneumonia has been widely recognized. We evaluated the performance of a software for quantitative analysis of chest CT, the LungQuant system, by comparing its results with independent visual evaluations by a group of 14 clinical experts. The aim of this work is to evaluate the ability of the automated tool to extract quantitative information from lung CT, relevant for the design of a diagnosis support model.

methodsLungQuant segments both the lungs and lesions associated with COVID-19 pneumonia (ground-glass opacities and consolidations) and computes derived quantities corresponding to qualitative characteristics used to clinically assess COVID-19 lesions. The comparison was carried out on 120 publicly available CT scans of patients affected by COVID-19 pneumonia. Scans were scored for four qualitative metrics: percentage of lung involvement, type of lesion, and two disease distribution scores. We evaluated the agreement between the LungQuant output and the visual assessments through receiver operating characteristics area under the curve (AUC) analysis and by fitting a nonlinear regression model.

resultsDespite the rather large heterogeneity in the qualitative labels assigned by the clinical experts for each metric, we found good agreement on the metrics compared to the LungQuant output. The AUC values obtained for the four qualitative metrics were 0.98, 0.85, 0.90, and 0.81.

conclusionsVisual clinical evaluation could be complemented and supported by computer-aided quantification, whose values match the average evaluation of several independent clinical experts. KEY POINTS: We conducted a multicenter evaluation of the deep learning-based LungQuant automated software. We translated qualitative assessments into quantifiable metrics to characterize coronavirus disease 2019 (COVID-19) pneumonia lesions. Comparing the software output to the clinical evaluations, results were satisfactory despite heterogeneity of the clinical evaluations. An automatic quantification tool may contribute to improve the clinical workflow of COVID-19 pneumonia.

Indexed as

COVID-19Deep LearningPneumoniaHumansLungSARS-CoV-2SoftwareCOVID-19Deep LearningLungSoftware validationTomography (x-ray computed)

Identifiers

PMID37032383
PMCPMC10083148
OpenAlexW4362731287

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.