Evidence map›Paper›PMID 27159648›Full record

ArticleAnnals of the American Thoracic Society2016

Acute Respiratory Distress Syndrome Measurement Error. Potential Effect on Clinical Study Results.

Michael W Sjoding, Colin R Cooke, Theodore J Iwashyna, Timothy P Hofer

Abstract read
In one paragraph

Article in Annals of the American Thoracic Society, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
24citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

24 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Trial
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

4 authors.

Michael W Sjoding1 Department of Internal Medicine and.
Colin R Cooke1 Department of Internal Medicine and.
Theodore J Iwashyna1 Department of Internal Medicine and.
Timothy P Hofer1 Department of Internal Medicine and.

Funding

PULMONARY CELLULAR AND MOLECULAR BIOLOGY TRAININGT32HL007749 · NHLBI · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI Robert Pickett Dickson · 1993 to 2026
$19.9M
Research BaseP30DK092926 · NIDDK · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI MARY ELLEN MICHELE HEISLER, ADESUWA B OLOMU · 2011 to 2026
$10.0M
Understanding Variation in the Use of Critical Care ServicesK08HS020672 · AHRQ · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI COOKE, COLIN · 2012 to 2016
$768k
AHRQ HHS K08 HS020672NHLBI NIH HHS T32 HL007749NIDDK NIH HHS P30 DK092926
6 · The paper itself

Abstract

rationaleIdentifying patients with acute respiratory distress syndrome (ARDS) is a recognized challenge. Experts often have only moderate agreement when applying the clinical definition of ARDS to patients. However, no study has fully examined the implications of low reliability measurement of ARDS on clinical studies.

objectivesTo investigate how the degree of variability in ARDS measurement commonly reported in clinical studies affects study power, the accuracy of treatment effect estimates, and the measured strength of risk factor associations.

methodsWe examined the effect of ARDS measurement error in randomized clinical trials (RCTs) of ARDS-specific treatments and cohort studies using simulations. We varied the reliability of ARDS diagnosis, quantified as the interobserver reliability (κ-statistic) between two reviewers. In RCT simulations, patients identified as having ARDS were enrolled, and when measurement error was present, patients without ARDS could be enrolled. In cohort studies, risk factors as potential predictors were analyzed using reviewer-identified ARDS as the outcome variable. MEASUREMENTS AND MAIN

resultsLower reliability measurement of ARDS during patient enrollment in RCTs seriously degraded study power. Holding effect size constant, the sample size necessary to attain adequate statistical power increased by more than 50% as reliability declined, although the result was sensitive to ARDS prevalence. In a 1,400-patient clinical trial, the sample size necessary to maintain similar statistical power increased to over 1,900 when reliability declined from perfect to substantial (κ = 0.72). Lower reliability measurement diminished the apparent effectiveness of an ARDS-specific treatment from a 15.2% (95% confidence interval, 9.4-20.9%) absolute risk reduction in mortality to 10.9% (95% confidence interval, 4.7-16.2%) when reliability declined to moderate (κ = 0.51). In cohort studies, the effect on risk factor associations was similar.

conclusionsARDS measurement error can seriously degrade statistical power and effect size estimates of clinical studies. The reliability of ARDS measurement warrants careful attention in future ARDS clinical studies.

Indexed as

AdultDiagnostic ErrorsHumansLogistic ModelsMultivariate AnalysisObservational Studies as TopicRandomized Controlled Trials as TopicReproducibility of ResultsRespiration, ArtificialRespiratory Distress SyndromeRisk Factorsacute lung injurybiasclinical trialdiagnosisobservational study

Identifiers

PMID27159648
PMCPMC5015753

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.