Evidence map›Paper›PMID 32997361›Full record

SynthesisThe Cochrane database of systematic reviews2020

Thoracic imaging tests for the diagnosis of COVID-19.

Jean-Paul Salameh, Mariska Mg Leeflang, Lotty Hooft, Nayaar Islam, Trevor A McGrath, Christian B van der Pol, Robert A Frank, Ross Prager, Samanjit S Hare, Carole Dennie and 13 more

Open access · bronzeAbstract readMeta-AnalysisSystematic Review
PubMed Publisher
In one paragraph

Synthesis in The Cochrane database of systematic reviews, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 49 papers, 8 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
49citing papers in PubMed, 8 pooled it
7.8field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

49 citing papers in PubMed, 8 syntheses or guidelines pooled it, 76 citations in OpenAlex.

  1. Thoracic imaging tests for the diagnosis of COVID-19.The Cochrane database of systematic reviews · 2022
    Pooled it
  2. Pooled it
  3. Pooled it
  4. Thoracic imaging tests for the diagnosis of COVID-19.The Cochrane database of systematic reviews · 2021
    Pooled it
  5. Pooled it
  6. Pooled it
  7. Routine laboratory testing to determine if a patient has COVID-19.The Cochrane database of systematic reviews · 2020
    Pooled it
  8. Pooled it
  9. Article
  10. Article
  11. Observational
  12. Article
  13. Article
  14. Review
  15. Article
  16. Review
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

23 authors at 10 institutions in 4 countries.

Jean-Paul SalamehDepartment of Radiology, University of Ottawa, Ottawa, Canada.
Mariska Mg LeeflangDepartment of Clinical Epidemiology, Biostatistics and Bioinformatics, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, Netherlands.
Lotty HooftCochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, Netherlands.
Nayaar IslamDepartment of Radiology, University of Ottawa, Ottawa, Canada.
Trevor A McGrathDepartment of Radiology, University of Ottawa, Ottawa, Canada.
Christian B van der PolDepartment of Radiology, McMaster University, Hamilton, Canada.
Robert A FrankDepartment of Radiology, University of Ottawa, Ottawa, Canada.
Ross PragerDepartment of Medicine, University of Ottawa, Ottawa, Canada.
Samanjit S HareDepartment of Radiology, Royal Free London NHS Trust, London, UK.
Carole DennieDepartment of Radiology, University of Ottawa, Ottawa, Canada.
René SpijkerCochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, Netherlands.
Jonathan J DeeksTest Evaluation Research Group, Institute of Applied Health Research, University of Birmingham, Birmingham, UK.
Jacqueline DinnesTest Evaluation Research Group, Institute of Applied Health Research, University of Birmingham, Birmingham, UK.
Kevin JenniskensCochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, Netherlands.
Daniël A KorevaarDepartment of Respiratory Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam, Netherlands.
Jérémie F CohenObstetrical, Perinatal and Pediatric Epidemiology Research Team (EPOPé), Centre de Recherche Épidémiologie et Statistique Sorbonne Paris Cité (CRESS), Inserm UMR1153, Paris Descartes University, Paris, France.
Ann Van den BruelNIHR Diagnostic Evidence Cooperative, University of Oxford, Oxford, UK.
Yemisi TakwoingiTest Evaluation Research Group, Institute of Applied Health Research, University of Birmingham, Birmingham, UK.
Janneke van de WijgertCochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, Netherlands.
Johanna Aag DamenCochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, Netherlands.
Junfeng WangJulius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrehct, Netherlands.
Cochrane COVID-19 Diagnostic Test Accuracy GroupNIHR Birmingham Biomedical Research Centre, University Hospitals Birmingham NHS Foundation Trust and University of Birmingham, Birmingham, UK.
Matthew Df McInnesDepartment of Radiology, University of Ottawa, Ottawa, Canada.
University of Ottawa · CAUtrecht University · NLUniversity Hospitals Birmingham NHS Foundation Trust · GBAmsterdam University Medical Centers · NLInserm · FRMcMaster University · CARoyal Free London NHS Foundation Trust · GBUniversity Medical Center Utrecht · NLUniversity of Liverpool · GBUniversity of Oxford · GB

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe diagnosis of infection by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) presents major challenges. Reverse transcriptase polymerase chain reaction (RT-PCR) testing is used to diagnose a current infection, but its utility as a reference standard is constrained by sampling errors, limited sensitivity (71% to 98%), and dependence on the timing of specimen collection. Chest imaging tests are being used in the diagnosis of COVID-19 disease, or when RT-PCR testing is unavailable.

objectivesTo determine the diagnostic accuracy of chest imaging (computed tomography (CT), X-ray and ultrasound) in people with suspected or confirmed COVID-19. SEARCH

methodsWe searched the COVID-19 Living Evidence Database from the University of Bern, the Cochrane COVID-19 Study Register, and The Stephen B. Thacker CDC Library. In addition, we checked repositories of COVID-19 publications. We did not apply any language restrictions. We conducted searches for this review iteration up to 5 May 2020. SELECTION CRITERIA: We included studies of all designs that produce estimates of test accuracy or provide data from which estimates can be computed. We included two types of cross-sectional designs: a) where all patients suspected of the target condition enter the study through the same route and b) where it is not clear up front who has and who does not have the target condition, or where the patients with the target condition are recruited in a different way or from a different population from the patients without the target condition. When studies used a variety of reference standards, we included all of them. DATA COLLECTION AND ANALYSIS: We screened studies and extracted data independently, in duplicate. We also assessed the risk of bias and applicability concerns independently, in duplicate, using the QUADAS-2 checklist and presented the results of estimated sensitivity and specificity, using paired forest plots, and summarised in tables. We used a hierarchical meta-analysis model where appropriate. We presented uncertainty of the accuracy estimates using 95% confidence intervals (CIs). MAIN

resultsWe included 84 studies, falling into two categories: studies with participants with confirmed diagnoses of COVID-19 at the time of recruitment (71 studies with 6331 participants) and studies with participants suspected of COVID-19 (13 studies with 1948 participants, including three case-control studies with 549 cases and controls). Chest CT was evaluated in 78 studies (8105 participants), chest X-ray in nine studies (682 COVID-19 cases), and chest ultrasound in two studies (32 COVID-19 cases). All evaluations of chest X-ray and ultrasound were conducted in studies with confirmed diagnoses only. Twenty-five per cent (21/84) of all studies were available only as preprints, 15/71 studies in the confirmed cases group and 6/13 of the studies in the suspected group. Among 71 studies that included confirmed cases, 41 studies had included symptomatic cases only, 25 studies had included cases regardless of their symptoms, five studies had included asymptomatic cases only, three of which included a combination of confirmed and suspected cases. Seventy studies were conducted in Asia, 2 in Europe, 2 in North America and one in South America. Fifty-one studies included inpatients while the remaining 24 studies were conducted in mixed or unclear settings. Risk of bias was high in most studies, mainly due to concerns about selection of participants and applicability. Among the 13 studies that included suspected cases, nine studies were conducted in Asia, and one in Europe. Seven studies included inpatients while the remaining three studies were conducted in mixed or unclear settings. In studies that included confirmed cases the pooled sensitivity of chest CT was 93.1% (95%CI: 90.2 - 95.0 (65 studies, 5759 cases); and for X-ray 82.1% (95%CI: 62.5 to 92.7 (9 studies, 682 cases). Heterogeneity judged by visual assessment of the ROC plots was considerable. Two studies evaluated the diagnostic accuracy of point-of-care ultrasound and both reported zero false negatives (with 10 and 22 participants having undergone ultrasound, respectively). These studies only reported True Positive and False Negative data, therefore it was not possible to pool and derive estimates of specificity. In studies that included suspected cases, the pooled sensitivity of CT was 86.2% (95%CI: 71.9 to 93.8 (13 studies, 2346 participants) and specificity was 18.1% (95%CI: 3.71 to 55.8). Heterogeneity judged by visual assessment of the forest plots was high. Chest CT may give approximately the same proportion of positive results for patients with and without a SARS-CoV-2 infection: the chances of getting a positive CT result are 86% (95% CI: 72 to 94) in patient with a SARS-CoV-2 infection and 82% (95% CI: 44 to 96) in patients without. AUTHORS'

conclusionsThe uncertainty resulting from the poor study quality and the heterogeneity of included studies limit our ability to confidently draw conclusions based on our results. Our findings indicate that chest CT is sensitive but not specific for the diagnosis of COVID-19 in suspected patients, meaning that CT may not be capable of differentiating SARS-CoV-2 infection from other causes of respiratory illness. This low specificity could also be the result of the poor sensitivity of the reference standard (RT-PCR), as CT could potentially be more sensitive than RT-PCR in some cases. Because of limited data, accuracy estimates of chest X-ray and ultrasound of the lungs for the diagnosis of COVID-19 should be carefully interpreted. Future diagnostic accuracy studies should avoid cases-only studies and pre-define positive imaging findings. Planned updates of this review will aim to: increase precision around the accuracy estimates for CT (ideally with low risk of bias studies); obtain further data to inform accuracy of chest X rays and ultrasound; and continue to search for studies that fulfil secondary objectives to inform the utility of imaging along different diagnostic pathways.

Indexed as

BetacoronavirusAdultChildClinical Laboratory TechniquesCoronavirus InfectionsCOVID-19COVID-19 TestingHumansLungPandemicsPneumonia, ViralRadiography, ThoracicSARS-CoV-2Sensitivity and SpecificityTomography, X-Ray ComputedUltrasonography

Identifiers

PMID32997361
OpenAlexW4205717379

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.