Evidence map›Paper›PMID 36920040›Full record

ArticleInfection control and hospital epidemiology2023

Electronic surveillance criteria for non-ventilator-associated hospital-acquired pneumonia: Assessment of reliability and validity.

Sarah E Stern, Matthew A Christensen, McKenna R Nevers, Jian Ying, Caroline McKenna, Shannon Munro, Chanu Rhee, Matthew H Samore, Michael Klompas, Barbara E Jones

Open access · greenAbstract read
In one paragraph

Article in Infection control and hospital epidemiology, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 1 pooled it
4.9field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 1 synthesis or guideline pooled it, 14 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Oral care in nonventilated hospitalized patients.American journal of infection control · 2025
    Article
  7. Preventability of Hospital Deaths in Patients With Non-Ventilator Hospital-Acquired Pneumonia.Clinical infectious diseases : an official publication of the Infectious Diseases Society of America · 2024
    Article
  8. Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 4 institutions in 1 country.

Sarah E SternDivision of Pulmonary & Critical Care Medicine, University of Utah, Salt Lake City, Utah.ORCID https://orcid.org/0000-0003-3671-4016
Matthew A ChristensenDivision of Allergy, Pulmonary, & Critical Care Medicine, Vanderbilt University Medical Center, Nashville, Tennessee.ORCID https://orcid.org/0000-0002-6021-8680
McKenna R NeversDivision of Epidemiology, University of Utah, Salt Lake City, Utah.
Jian YingDivision of Epidemiology, University of Utah, Salt Lake City, Utah.
Caroline McKennaDepartment of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, Massachusetts.
Shannon MunroDepartment of Veterans' Affairs Medical Center, Salem, Virginia.
Chanu RheeDepartment of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, Massachusetts.ORCID https://orcid.org/0000-0002-9537-4245
Matthew H SamoreDivision of Epidemiology, University of Utah, Salt Lake City, Utah.
Michael KlompasDepartment of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, Massachusetts.ORCID https://orcid.org/0000-0001-8641-4498
Barbara E JonesDivision of Pulmonary & Critical Care Medicine, University of Utah, Salt Lake City, Utah.
University of Utah · USBrigham and Women's Hospital · USHarvard University · USVanderbilt University Medical Center · US

Funding

HSRD VA I01 HX003500HSRD VA I50 HX001240HSRD VA IK2 HX001908
6 · The paper itself

Abstract

objectiveSurveillance of non-ventilator-associated hospital-acquired pneumonia (NV-HAP) is complicated by subjectivity and variability in diagnosing pneumonia. We compared a fully automatable surveillance definition using routine electronic health record data to manual determinations of NV-HAP according to surveillance criteria and clinical diagnoses.

methodsWe retrospectively applied an electronic surveillance definition for NV-HAP to all adults admitted to Veterans' Affairs (VA) hospitals from January 1, 2015, to November 30, 2020. We randomly selected 250 hospitalizations meeting NV-HAP surveillance criteria for independent review by 2 clinicians and calculated the percent of hospitalizations with (1) clinical deterioration, (2) CDC National Healthcare Safety Network (CDC-NHSN) criteria, (3) NV-HAP according to a reviewer, (4) NV-HAP according to a treating clinician, (5) pneumonia diagnosis in discharge summary; and (6) discharge diagnosis codes for HAP. We assessed interrater reliability by calculating simple agreement and the Cohen κ (kappa).

resultsAmong 3.1 million hospitalizations, 14,023 met NV-HAP electronic surveillance criteria. Among reviewed cases, 98% had a confirmed clinical deterioration; 67% met CDC-NHSN criteria; 71% had NV-HAP according to a reviewer; 60% had NV-HAP according to a treating clinician; 49% had a discharge summary diagnosis of pneumonia; and 82% had NV-HAP according to any definition according to at least 1 reviewer. Only 8% had diagnosis codes for HAP. Interrater agreement was 75% (κ = 0.50) for CDC-NHSN criteria and 78% (κ = 0.55) for reviewer diagnosis of NV-HAP.

conclusionsElectronic NV-HAP surveillance criteria correlated moderately with existing manual surveillance criteria. Reviewer variability for all manual assessments was high. Electronic surveillance using clinical data may therefore allow for more consistent and efficient surveillance with similar accuracy compared to manual assessments or diagnosis codes.

Identifiers

PMID36920040
PMCPMC12822673
OpenAlexW4324308148

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.