Evidence map›Paper›PMID 24461071›Full record

ArticleHealth services research2014

Statistical benchmarks for health care provider performance assessment: a comparison of standard approaches to a hierarchical Bayesian histogram-based method.

Susan M Paddock

Abstract readComparative Study
In one paragraph

Article in Health services research, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Accuracy of site benchmarking in clinical quality registries of varying size.Health information management : journal of the Health Information Management Association of Australia · 2026
    Article
  3. Article
  4. MEASURING PERFORMANCE FOR END-OF-LIFE CARE.The annals of applied statistics · 2022
    Article
  5. Article
  6. Regulator Loss Functions and Hierarchical Modeling for Safety Decision Making.Medical decision making : an international journal of the Society for Medical Decision Making · 2017
    Article
  7. 2016 Revision of the SCAI position statement on public reporting.Catheterization and cardiovascular interventions : official journal of the Society for Cardiac Angiography & Interventions · 2017
    Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

1 author.

Susan M PaddockRAND Corporation, 1776 Main Street, Santa Monica, CA, 90401.

Funding

Innovations in the Science of Public Reporting of Provider PerformanceR21HS021860 · AHRQ · RAND CORPORATION · PI PADDOCK, SUSAN M. · 2012 to 2014
$916k
AHRQ HHS R21 HS021860AHRQ HHS R21HS021860
6 · The paper itself

Abstract

objectiveExamine how widely used statistical benchmarks of health care provider performance compare with histogram-based statistical benchmarks obtained via hierarchical Bayesian modeling. DATA SOURCES: Publicly available data from 3,240 hospitals during April 2009-March 2010 on two process-of-care measures reported on the Medicare Hospital Compare website. STUDY

designSecondary data analyses of two process-of-care measures comparing statistical benchmark estimates and threshold exceedance determinations under various combinations of hospital performance measure estimates and benchmarking approaches. PRINCIPAL

findingsStatistical benchmarking approaches for determining top 10 percent performance varied with respect to which hospitals exceeded the performance benchmark; such differences were not found at the 50 percent threshold. Benchmarks derived from the histogram of provider performance under hierarchical Bayesian modeling provide a compromise between benchmarks based on direct (raw) estimates, which are overdispersed relative to the true distribution of provider performance and prone to high variance for small providers, and posterior mean provider performance, for which over-shrinkage and under-dispersion relative to the true provider performance distribution is a concern.

conclusionsGiven the rewards and penalties associated with characterizing top performance, the ability of statistical benchmarks to summarize key features of the provider performance distribution should be examined.

Indexed as

Quality of Health CareBayes TheoremBenchmarkingEmployee Performance AppraisalHealth PersonnelHumansBayesian statisticshierarchical modelprovider profilingpublic reportingstatistical benchmark

Identifiers

PMID24461071
PMCPMC4231585

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.