Evidence map›Paper›PMID 29248620›Full record

ArticleChest2018

Interobserver Reliability of the Berlin ARDS Definition and Strategies to Improve the Reliability of ARDS Diagnosis.

Michael W Sjoding, Timothy P Hofer, Ivan Co, Anthony Courey, Colin R Cooke, Theodore J Iwashyna

Open access · bronzeAbstract read
In one paragraph

Article in Chest, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 78 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
78citing papers in PubMed, 1 pooled it
10.4field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

78 citing papers in PubMed, 1 synthesis or guideline pooled it, 131 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Trial
  4. Trial
  5. Trial
  6. Trial
  7. Article
  8. Observational
  9. Article
  10. Observational
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Observational
  20. Article

18 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

6 authors at 2 institutions in 1 country.

Michael W SjodingDepartment of Internal Medicine, University of Michigan, Ann Arbor, MI; Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor, MI. Electronic address: msjoding@umich.edu.
Timothy P HoferDepartment of Internal Medicine, University of Michigan, Ann Arbor, MI; Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor, MI; VA Center for Clinical Management Research, Ann Arbor, MI.
Ivan CoDepartment of Internal Medicine, University of Michigan, Ann Arbor, MI; Department of Emergency Medicine, University of Michigan, Ann Arbor, MI.
Anthony CoureyDepartment of Internal Medicine, University of Michigan, Ann Arbor, MI.
Colin R CookeDepartment of Internal Medicine, University of Michigan, Ann Arbor, MI; Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor, MI.
Theodore J IwashynaDepartment of Internal Medicine, University of Michigan, Ann Arbor, MI; VA Center for Clinical Management Research, Ann Arbor, MI; Institute for Social Research, Ann Arbor, MI.
University of Michigan–Ann Arbor · USVA Center for Clinical Management Research · US

Funding

PULMONARY CELLULAR AND MOLECULAR BIOLOGY TRAININGT32HL007749 · NHLBI · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI Robert Pickett Dickson · 1993 to 2026
$19.9M
Data-Driven Identification of the Acute Respiratory Distress SyndromeK01HL136687 · NHLBI · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI SJODING, MICHAEL WILLIAM · 2017 to 2021
$862k
Understanding Variation in the Use of Critical Care ServicesK08HS020672 · AHRQ · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI COOKE, COLIN · 2012 to 2016
$768k
AHRQ HHS K08 HS020672NHLBI NIH HHS K01 HL136687NHLBI NIH HHS L30 HL138779NHLBI NIH HHS T32 HL007749
6 · The paper itself

Abstract

backgroundFailure to reliably diagnose ARDS may be a major driver of negative clinical trials and underrecognition and treatment in clinical practice. We sought to examine the interobserver reliability of the Berlin ARDS definition and examine strategies for improving the reliability of ARDS diagnosis.

methodsTwo hundred five patients with hypoxic respiratory failure from four ICUs were reviewed independently by three clinicians, who evaluated whether patients had ARDS, the diagnostic confidence of the reviewers, whether patients met individual ARDS criteria, and the time when criteria were met.

resultsInterobserver reliability of an ARDS diagnosis was "moderate" (kappa = 0.50; 95% CI, 0.40-0.59). Sixty-seven percent of diagnostic disagreements between clinicians reviewing the same patient was explained by differences in how chest imaging studies were interpreted, with other ARDS criteria contributing less (identification of ARDS risk factor, 15%; cardiac edema/volume overload exclusion, 7%). Combining the independent reviews of three clinicians can increase reliability to "substantial" (kappa = 0.75; 95% CI, 0.68-0.80). When a clinician diagnosed ARDS with "high confidence," all other clinicians agreed with the diagnosis in 72% of reviews. There was close agreement between clinicians about the time when a patient met all ARDS criteria if ARDS developed within the first 48 hours of hospitalization (median difference, 5 hours).

conclusionsThe reliability of the Berlin ARDS definition is moderate, driven primarily by differences in chest imaging interpretation. Combining independent reviews by multiple clinicians or improving methods to identify bilateral infiltrates on chest imaging are important strategies for improving the reliability of ARDS diagnosis.

Indexed as

Severity of Illness IndexAdultAgedFemaleHumansHypoxiaMaleMiddle AgedObserver VariationReproducibility of ResultsRespiratory Distress SyndromeRespiratory InsufficiencyRetrospective Studiesacute lung injuryARDSclinical trialsdiagnosis

Identifiers

PMID29248620
PMCPMC5815873
OpenAlexW2774525674

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.