Evidence map›Paper›PMID 33778613›Full record

ArticleRadiology. Cardiothoracic imaging2020

Suboptimal Quality and High Risk of Bias in Diagnostic Test Accuracy Studies at Chest Radiography and CT in the Acute Setting of the COVID-19 Pandemic: A Systematic Review.

Dominika Suchá, Robbert W van Hamersvelt, Andor F van den Hoven, Pim A de Jong, Helena M Verkooijen

Open access · greenAbstract read
In one paragraph

Article in Radiology. Cardiothoracic imaging, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed, 1 pooled it
1.4field-weighted citation impact, top 15% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 1 synthesis or guideline pooled it, 17 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Review
  4. Review
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Diagnostic performance of the RSNA-proposed classification for COVID-19 pneumonia versus pre-pandemic controls.The Brazilian journal of infectious diseases : an official publication of the Brazilian Society of Infectious Diseases
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 1 institution in 2 countries.

Dominika SucháDepartment of Radiology (D.S., R.W.v.H., A.F.v.d.H., P.A.d.J., H.M.V.) and Imaging Division (H.M.V.), University Medical Center Utrecht, Heidelberglaan 100, 3508 GA, Utrecht, the Netherlands.ORCID 0000-0003-2331-7169
Robbert W van HamersveltDepartment of Radiology (D.S., R.W.v.H., A.F.v.d.H., P.A.d.J., H.M.V.) and Imaging Division (H.M.V.), University Medical Center Utrecht, Heidelberglaan 100, 3508 GA, Utrecht, the Netherlands.ORCID 0000-0002-6084-0656
Andor F van den HovenDepartment of Radiology (D.S., R.W.v.H., A.F.v.d.H., P.A.d.J., H.M.V.) and Imaging Division (H.M.V.), University Medical Center Utrecht, Heidelberglaan 100, 3508 GA, Utrecht, the Netherlands.ORCID 0000-0003-1218-0865
Pim A de JongDepartment of Radiology (D.S., R.W.v.H., A.F.v.d.H., P.A.d.J., H.M.V.) and Imaging Division (H.M.V.), University Medical Center Utrecht, Heidelberglaan 100, 3508 GA, Utrecht, the Netherlands.ORCID 0000-0003-4840-6854
Helena M VerkooijenDepartment of Radiology (D.S., R.W.v.H., A.F.v.d.H., P.A.d.J., H.M.V.) and Imaging Division (H.M.V.), University Medical Center Utrecht, Heidelberglaan 100, 3508 GA, Utrecht, the Netherlands.
Utrecht University · NL

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeTo synthesize the literature on diagnostic test accuracy of chest radiography, CT, and US for the diagnosis of coronavirus disease 2019 (COVID-19) in patients suspected of having COVID-19 in a hospital setting and evaluate the extent of suboptimal reporting and risk of bias. MATERIALS AND

methodsA systematic search was performed (April 26, 2020) in EMBASE, PubMed, and Cochrane to identify chest radiographic, CT, or US studies in adult patients suspected of having COVID-19, using reverse-transcription polymerase chain reaction test or clinical consensus as the standard of reference. Two × two contingency tables were reconstructed, and test sensitivity, specificity, positive predictive values, and negative predictive values were recalculated. Reporting quality was evaluated by adherence to the Standards for Reporting of Diagnostic Accuracy Studies (STARD), and risk of bias was evaluated by adherence to the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2).

resultsThirteen studies were eligible (CT = 12; chest radiography = 1; US = 0). Recalculated CT sensitivity and specificity ranged between 0.57 and 0.97, and 0.37 and 0.94, respectively, and positive predictive values and negative predictive values ranged between 0.59 and 0.92 and 0.57 and 0.96, respectively. On average, studies complied with only 35% of the STARD-guideline items. No study scored low risk of bias for all QUADAS-2 domains (patient selection, index test, reference test, and flow and timing). High risk of bias in more than one domain was scored in 10 of 13 studies (77%).

conclusionReported CT test accuracy for COVID-19 diagnosis varies substantially. The validity and generalizability of these findings is complicated by poor adherence to reporting guidelines and high risk of bias, which are most likely due to the need for urgent publication of findings in the first months of the COVID-19 pandemic.

Identifiers

PMID33778613
PMCPMC7393956
OpenAlexW3045932578

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.