Evidence map›Paper›PMID 38753326›Full record

ArticleJAMA network open2024

Calculation of Overall Hospital Quality Star Ratings With and Without Inclusion of the Peer Grouping Step.

Cameron J Gettel, Kyle Bagshaw, Li Qin, Zhenqiu Lin, Eve Rothenberg, Prince Omotosho, Demetri P Goutos, Jeph Herrin, Lisa G Suter, Michelle Schreiber and 3 more

Erratum issuedAbstract read
In one paragraph

Article in JAMA network open, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 6 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Author Omitted.JAMA network open · 2024
    Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

13 authors.

Cameron J GettelDepartment of Emergency Medicine, Yale School of Medicine, New Haven, Connecticut.
Kyle BagshawCenter for Outcomes Research and Evaluation, Yale New Haven Health Services Corporation, New Haven, Connecticut.
Li QinSection of Cardiology, Department of Medicine, Yale School of Medicine, New Haven, Connecticut.
Zhenqiu LinCenter for Outcomes Research and Evaluation, Yale New Haven Health Services Corporation, New Haven, Connecticut.
Eve RothenbergCenter for Outcomes Research and Evaluation, Yale New Haven Health Services Corporation, New Haven, Connecticut.
Prince OmotoshoCenter for Outcomes Research and Evaluation, Yale New Haven Health Services Corporation, New Haven, Connecticut.
Demetri P GoutosDepartment of Health Law, Policy, and Management, Boston University School of Public Health, Boston, Massachusetts.
Jeph HerrinSection of Cardiology, Department of Medicine, Yale School of Medicine, New Haven, Connecticut.
Lisa G SuterCenter for Outcomes Research and Evaluation, Yale New Haven Health Services Corporation, New Haven, Connecticut.
Michelle SchreiberUS Centers for Medicare & Medicaid Services, Department of Health and Human Services, Baltimore, Maryland.
Lee A FleisherUS Centers for Medicare & Medicaid Services, Department of Health and Human Services, Baltimore, Maryland.
Raquel MyersUS Centers for Medicare & Medicaid Services, Department of Health and Human Services, Baltimore, Maryland.
Arjun K VenkateshDepartment of Emergency Medicine, Yale School of Medicine, New Haven, Connecticut.

Funding

Yale Clinical and Translational Science Award (U Component)UL1TR001863 · NCATS · YALE UNIVERSITY · PI John H. Krystal, LUCILA OHNO-MACHADO · 2016 to 2026
$102.9M
NCATS NIH HHS UL1 TR001863
6 · The paper itself

Abstract

Importance: The Centers for Medicare & Medicaid Services (CMS) Overall Star Rating is widely used by patients and consumers, and there is continued stakeholder curiosity surrounding the inclusion of a peer grouping step, implemented to the 2021 Overall Star Rating methods. Objective: To calculate hospital star rating scores with and without the peer grouping step, with the former approach stratifying hospitals into 3-, 4-, and 5-measure group peer groups based on the number of measure groups with at least 3 reported measures. Design, Setting, and Participants: This cross-sectional study used Care Compare website data from January 2023 for 3076 hospitals that received a star rating in 2023. Data were analyzed from April 2023 to December 2023. Exposure: Peer grouping vs no peer grouping. Main Outcomes and Measures: The primary outcome was the distribution of star ratings, with 1 star being the lowest-performing hospitals and 5 stars, the highest. Analyses additionally identified the number of hospitals with a higher, lower, or identical star rating with the use of the peer grouping step compared with its nonuse, stratified by certain hospital characteristics. Results: Among 3076 hospitals that received a star rating in 2023, most were nonspecialty (1994 hospitals [64.8%]), nonteaching (1807 hospitals [58.7%]), non-safety net (2326 hospitals [75.6%]), non-critical access (2826 hospitals [91.9%]) hospitals with fewer than 200 beds (1822 hospitals [59.2%]) and located in an urban geographic designations (1935 hospitals [62.9%]). The presence of the peer grouping step resulted in 585 hospitals (19.0%) being assigned a different star rating than if the peer grouping step was absent, including considerably more hospitals receiving a higher star rating (517 hospitals) rather than a lower (68 hospitals) star rating. Hospital characteristics associated with a higher star rating included urbanicity (351 hospitals [67.9%]), non-safety net status (414 hospitals [80.1%]), and fewer than 200 beds (287 hospitals [55.6%]). Collectively, the presence of the peer grouping step supports a like-to-like comparison among hospitals and supports the ability of patients to assess overall hospital quality. Conclusions and Relevance: In this cross-sectional study, inclusion of the peer grouping in the CMS star rating method resulted in modest changes in hospital star ratings compared with application of the method without peer grouping. Given improvement in face validity and the close association between the current peer grouping approach and stakeholder needs for peer-comparison, the current CMS Overall Star Rating method allows for durable comparisons in hospital performance.

Indexed as

HospitalsCenters for Medicare and Medicaid Services, U.S.Cross-Sectional StudiesHumansQuality Indicators, Health CareQuality of Health CareUnited States

Identifiers

PMID38753326
PMCPMC11099678

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.