Evidence map›Paper›PMID 33778625›Full record

ArticleRadiology. Cardiothoracic imaging2020

Implementation of the Radiological Society of North America Expert Consensus Guidelines on Reporting Chest CT Findings Related to COVID-19: A Multireader Performance Study.

Avik Som, Min Lang, Tristan Yeung, Denston Carey, Sherief Garrana, Dexter P Mendoza, Efren J Flores, Matthew D Li, Amita Sharma, Shaunagh McDermott and 2 more

Open access · greenAbstract read
PubMed Full text at PMC Publisher
In one paragraph

Article in Radiology. Cardiothoracic imaging, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed, 1 pooled it
2.7field-weighted citation impact, top 8% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed, 1 synthesis or guideline pooled it, 31 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Diagnostic performance of the RSNA-proposed classification for COVID-19 pneumonia versus pre-pandemic controls.The Brazilian journal of infectious diseases : an official publication of the Brazilian Society of Infectious Diseases
    Article
  17. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors at 1 institution in 1 country.

Avik SomDepartment of Radiology, Massachusetts General Hospital, Boston, MA, USA (A.S., M.L., S.G., D.P.M., E.J.F., M.D.L., A.S., S.M., J.A.O.S., B.P.L.); and Harvard Medical School, Boston, MA, USA (T.Y., D.C.).ORCID https://orcid.org/0000-0002-2198-7575
Min LangDepartment of Radiology, Massachusetts General Hospital, Boston, MA, USA (A.S., M.L., S.G., D.P.M., E.J.F., M.D.L., A.S., S.M., J.A.O.S., B.P.L.); and Harvard Medical School, Boston, MA, USA (T.Y., D.C.).ORCID https://orcid.org/0000-0002-3895-5342
Tristan YeungDepartment of Radiology, Massachusetts General Hospital, Boston, MA, USA (A.S., M.L., S.G., D.P.M., E.J.F., M.D.L., A.S., S.M., J.A.O.S., B.P.L.); and Harvard Medical School, Boston, MA, USA (T.Y., D.C.).ORCID https://orcid.org/0000-0003-1881-3870
Denston CareyDepartment of Radiology, Massachusetts General Hospital, Boston, MA, USA (A.S., M.L., S.G., D.P.M., E.J.F., M.D.L., A.S., S.M., J.A.O.S., B.P.L.); and Harvard Medical School, Boston, MA, USA (T.Y., D.C.).ORCID https://orcid.org/0000-0001-6270-0078
Sherief GarranaDepartment of Radiology, Massachusetts General Hospital, Boston, MA, USA (A.S., M.L., S.G., D.P.M., E.J.F., M.D.L., A.S., S.M., J.A.O.S., B.P.L.); and Harvard Medical School, Boston, MA, USA (T.Y., D.C.).
Dexter P MendozaDepartment of Radiology, Massachusetts General Hospital, Boston, MA, USA (A.S., M.L., S.G., D.P.M., E.J.F., M.D.L., A.S., S.M., J.A.O.S., B.P.L.); and Harvard Medical School, Boston, MA, USA (T.Y., D.C.).ORCID https://orcid.org/0000-0001-7571-740X
Efren J FloresDepartment of Radiology, Massachusetts General Hospital, Boston, MA, USA (A.S., M.L., S.G., D.P.M., E.J.F., M.D.L., A.S., S.M., J.A.O.S., B.P.L.); and Harvard Medical School, Boston, MA, USA (T.Y., D.C.).ORCID https://orcid.org/0000-0003-1398-0426
Matthew D LiDepartment of Radiology, Massachusetts General Hospital, Boston, MA, USA (A.S., M.L., S.G., D.P.M., E.J.F., M.D.L., A.S., S.M., J.A.O.S., B.P.L.); and Harvard Medical School, Boston, MA, USA (T.Y., D.C.).ORCID https://orcid.org/0000-0002-6207-4940
Amita SharmaDepartment of Radiology, Massachusetts General Hospital, Boston, MA, USA (A.S., M.L., S.G., D.P.M., E.J.F., M.D.L., A.S., S.M., J.A.O.S., B.P.L.); and Harvard Medical School, Boston, MA, USA (T.Y., D.C.).ORCID https://orcid.org/0000-0002-2510-4805
Shaunagh McDermottDepartment of Radiology, Massachusetts General Hospital, Boston, MA, USA (A.S., M.L., S.G., D.P.M., E.J.F., M.D.L., A.S., S.M., J.A.O.S., B.P.L.); and Harvard Medical School, Boston, MA, USA (T.Y., D.C.).ORCID https://orcid.org/0000-0003-0200-9159
Jo-Anne O ShepardDepartment of Radiology, Massachusetts General Hospital, Boston, MA, USA (A.S., M.L., S.G., D.P.M., E.J.F., M.D.L., A.S., S.M., J.A.O.S., B.P.L.); and Harvard Medical School, Boston, MA, USA (T.Y., D.C.).ORCID https://orcid.org/0000-0003-1932-7620
Brent P LittleDepartment of Radiology, Massachusetts General Hospital, Boston, MA, USA (A.S., M.L., S.G., D.P.M., E.J.F., M.D.L., A.S., S.M., J.A.O.S., B.P.L.); and Harvard Medical School, Boston, MA, USA (T.Y., D.C.).ORCID https://orcid.org/0000-0001-6657-8241
Massachusetts General Hospital · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundRSNA expert consensus guidelines provide a framework for reporting CT findings related to COVID-19, but have had limited multireader validation. PURPOSE: To assess the performance of the RSNA guidelines and quantify interobserver variability in application of the guidelines in patients undergoing chest CT for suspected COVID-19 pneumonia. MATERIALS AND

methodsA retrospective search from 1/15/20 to 3/30/20 identified 89 consecutive CT scans whose radiological report mentioned COVID-19. One positive or two negative RT-PCR tests for COVID-19 were considered the gold standard for diagnosis. Each chest CT scan was evaluated using RSNA guidelines by 9 readers (6 fellowship trained thoracic radiologists and 3 radiology resident trainees). Clinical information was obtained from the electronic medical record.

resultsThere was strong concordance of findings between radiology training levels with agreement ranging from 60 to 86% among attendings and trainees (kappa 0.43 to 0.86). Sensitivity and specificity of "typical" CT findings for COVID-19 per the RSNA guidelines were on average 86% (range 72%-94%) and 80.2% (range 75-93%), respectively. Combined "typical" and "indeterminate" findings had a sensitivity of 97.5% (range 94-100%) and specificity of 54.7% (range 37-62%). A total of 163 disagreements were seen out of 801 observations (79.6% total agreement). Uncertainty in classification primarily derived from difficulty in ascertaining peripheral distribution, multiple dominant disease processes, or minimal disease.

conclusionThe "typical appearance" category for COVID-19 CT reporting has an average sensitivity of 86% and specificity rate of 80%. There is reasonable interreader agreement and good reproducibility across various levels of experience.

Identifiers

PMID33778625
PMCPMC7484923
OpenAlexW3085805642

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.