Evidence map›Paper›PMID 34133794›Full record

ArticleAcademic emergency medicine : official journal of the Society for Academic Emergency Medicine2021

Inter-rater reliability and prospective validation of a clinical prediction rule for SARS-CoV-2 infection.

Adam E Nevel, Jeffrey A Kline

Open access · bronzeAbstract read
In one paragraph

Article in Academic emergency medicine : official journal of the Society for Academic Emergency Medicine, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
0.2field-weighted citation impact, top 44% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed, 1 citations in OpenAlex.

  1. Article
  2. Inter-rater reliability and prospective validation of a clinical prediction rule for SARS-CoV-2 infection.Academic emergency medicine : official journal of the Society for Academic Emergency Medicine · 2021
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors at 1 institution in 1 country.

Adam E NevelDepartment of Emergency Medicine, Indiana University School of Medicine, Indianapolis, Indiana, USA.
Jeffrey A KlineDepartment of Emergency Medicine, Indiana University School of Medicine, Indianapolis, Indiana, USA.ORCID 0000-0001-7190-3109
Indiana University School of Medicine

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesAccurate estimation of the risk of SARS-CoV-2 infection based on bedside data alone has importance to emergency department (ED) operations and throughput. The 13-item CORC (COVID [or coronavirus] Rule-out Criteria) rule had good overall diagnostic accuracy in retrospective derivation and validation. The objective of this study was to prospectively test the inter-rater reliability and diagnostic accuracy of the CORC score and rule (score ≤ 0 negative, > 0 positive) and compare the CORC rule performance with physician gestalt.

methodsThis noninterventional study was conducted at an urban academic ED from February 2021 to March 2021. Two practitioners were approached by research coordinators and asked to independently complete a form capturing the CORC criteria for their shared patient and their gestalt binary prediction of the SARS-CoV-2 test result and confidence (0%-100%). The criterion standard for SARS-CoV-2 was from reverse transcriptase polymerase chain reaction performed on a nasopharyngeal swab. The primary analysis was from weighted Cohen's kappa and likelihood ratios (LRs).

resultsFor 928 patients, agreement between observers was good for the total CORC score, κ = 0.613 (95% confidence interval [CI] = 0.579-0.646), and for the CORC rule, κ = 0.644 (95% CI = 0.591-0.697). The agreement for clinician gestalt binary determination of SARs-CoV-2 status was κ = 0.534 (95% CI = 0.437-0.632) with median confidence of 76% (first-third quartile = 66-88.5). For 425 patients who had the criterion standard, a negative CORC rule (both observers scored CORC < 0), the sensitivity was 88%, and specificity was 51%, with a negative LR (LR-) of 0.24 (95% CI = 0.10-0.50). Among patients with a mean CORC score of >4, the prevalence of a positive SARS-CoV-2 test was 58% (95% CI = 28%-85%) and positive LR was 13.1 (95% CI = 4.5-37.2). Clinician gestalt demonstrated a sensitivity of 51% and specificity of 86% with a LR- of 0.57 (95% CI = 0.39-0.74).

conclusionIn this prospective study, the CORC score and rule demonstrated good inter-rater reliability and reproducible diagnostic accuracy for estimating the pretest probability of SARs-CoV-2 infection.

Indexed as

COVID-19SARS-CoV-2Clinical Decision RulesHumansProspective StudiesReproducibility of ResultsRetrospective StudiesCOVID-19decision makingdiagnosismultivariable analysisprobabilityprognosisregistriesriskSARS-CoV-2

Identifiers

PMID34133794
PMCPMC8441807
OpenAlexW3172183290

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.