Evidence map›Paper›PMID 24026600›Full record

Trial reportJAMA2013

Effect of pay-for-performance incentives on quality of care in small practices with electronic health records: a randomized trial.

Naomi S Bardach, Jason J Wang, Samantha F De Leon, Sarah C Shih, W John Boscardin, L Elizabeth Goldman, R Adams Dudley

Registry-linked trialOpen access · greenAbstract readMulticenter StudyRandomized Controlled Trial
In one paragraph

Trial report in JAMA, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT00884013 (Program Evaluation of New York City Health eHearts Pay for Quality Program), which is not on this map. Cited by 57 papers, 7 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
57citing papers in PubMed, 7 pooled it
30.3field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT00884013 completednot on this map

Program Evaluation of New York City Health eHearts Pay for Quality Program

TypeobservationalSponsorNew York City Department of Health and Mental HygieneRan2009Enrolled84ConditionsHypertension, Diabetes, Smoking, Ischemic Cardiovascular Disease
3 · Its place in the literature

Who cites it

57 citing papers in PubMed, 7 syntheses or guidelines pooled it, 138 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Multicomponent interventions for enhancing primary care: a systematic review.The British journal of general practice : the journal of the Royal College of General Practitioners · 2021
    Pooled it
  5. Pooled it
  6. Pooled it
  7. Payment methods for outpatient care facilities.The Cochrane database of systematic reviews · 2017
    Pooled it
  8. Trial
  9. Trial
  10. Trial
  11. Trial
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

7 authors at 1 institution in 1 country.

Naomi S BardachDepartment of Pediatrics, University of California, San Francisco, USA. bardachn@peds.ucsf.edu
Jason J Wang
Samantha F De Leon
Sarah C Shih
W John Boscardin
L Elizabeth Goldman
R Adams Dudley
University of California, San Francisco · US

Funding

CTSA: K12 COMPONENTKL2RR024130 · NCRR · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI JOHNSTON, S. CLAIBORNE · 2006 to 2011
$19.3M
NICHD Institutional Training for PediatriciansT32HD044331 · NICHD · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI FERRIERO, DONNA M. · 2003 to 2012
$2.5M
"Bringing High Performing Systems to Small Practices"R18HS018275 · AHRQ · NEW YORK CITY HEALTH/MENTAL HYGIENE · PI PARSONS, AMANDA · 2009 to 2011
$1.2M
Understanding and Preventing Pediatric Asthma ReadmissionsK23HD065836 · NICHD · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI BARDACH, NAOMI SHULA · 2011 to 2015
$697k
Bringing Measurement to the Point of CareR18HS017059 · AHRQ · NEW YORK CITY HEALTH/MENTAL HYGIENE · PI WU, WINFRED · 2007 to 2008
$693k
AHRQ HHS R18 HS017059AHRQ HHS R18 HS018275AHRQ HHS R18 HS17059AHRQ HHS R18 HS18275NCRR NIH HHS KL2 RR024130NCRR NIH HHS KL2 RR024130-05NICHD NIH HHS K23 HD065836NICHD NIH HHS T32 HD044331
6 · The paper itself

Abstract

importanceMost evaluations of pay-for-performance (P4P) incentives have focused on large-group practices. Thus, the effect of P4P in small practices, where many US residents receive care, is largely unknown. Furthermore, whether electronic health records (EHRs) with chronic disease management capabilities support small-practice response to P4P has not been studied.

objectiveTo assess the effect of P4P incentives on quality in EHR-enabled small practices in the context of an established quality improvement initiative. DESIGN, SETTING, AND

participantsA cluster-randomized trial of small (<10 clinicians) primary care clinics in New York City from April 2009 through March 2010. A city program provided all participating clinics with the same EHR software with decision support and patient registry functionalities and quality improvement specialists offering technical assistance.

interventionsIncentivized clinics were paid for each patient whose care met the performance criteria, but they received higher payments for patients with comorbidities, who had Medicaid insurance, or who were uninsured (maximum payments: $200/patient; $100,000/clinic). Quality reports were given quarterly to both the intervention and control groups. MAIN OUTCOMES AND MEASURES: Comparison of differences in performance improvement, from the beginning to the end of the study, between control and intervention clinics for aspirin or antithrombotic prescription, blood pressure control, cholesterol control, and smoking cessation interventions. Mixed-effects logistic regression was used to account for clustering of patients within clinics, with a treatment by time interaction term assessing the statistical significance of the effect of the intervention.

resultsParticipating clinics (n = 42 for each group) had similar baseline characteristics, with a mean of 4592 (median, 2500) patients at the intervention group clinics and 3042 (median, 2000) at the control group clinics. Intervention clinics had greater adjusted absolute improvement in rates of appropriate antithrombotic prescription (12.0% vs 6.1%, difference: 6.0% [95% CI, 2.2% to 9.7%], P = .001 for interaction term), blood pressure control (no comorbidities: 9.7% vs 4.3%, difference: 5.5% [95% CI, 1.6% to 9.3%], P = .01 for interaction term; with diabetes mellitus: 9.0% vs 1.2%, difference: 7.8% [95% CI, 3.2% to 12.4%], P = .007 for interaction term; with diabetes mellitus or ischemic vascular disease: 9.5% vs 1.7%, difference: 7.8% [95% CI, 3.0% to 12.6%], P = .01 for interaction term), and in smoking cessation interventions (12.4% vs 7.7%, difference: 4.7% [95% CI, -0.3% to 9.6%], P = .02 for interaction term). Intervention clinics performed better on all measures for Medicaid and uninsured patients except cholesterol control, but no differences were statistically significant. CONCLUSIONS AND RELEVANCE: Among small EHR-enabled clinics, a P4P incentive program compared with usual care resulted in modest improvements in cardiovascular care processes and outcomes. Because most proposed P4P programs are intended to remain in place more than a year, further research is needed to determine whether this effect increases or decreases over time.

trial registrationclinicaltrials.gov Identifier: NCT00884013.

Indexed as

Quality ImprovementReimbursement, IncentiveAdultCardiovascular DiseasesChronic DiseaseDisease ManagementElectronic Health RecordsFemaleGroup PracticeHumansHypertensionMaleMiddle AgedNew York CityPractice Patterns, Physicians'Primary Health Care

Identifiers

PMID24026600
PMCPMC4013308
OpenAlexW2057355482

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.