Evidence map›Paper›PMID 22336833›Full record

SynthesisThe Cochrane database of systematic reviews2012

Paying for performance to improve the delivery of health interventions in low- and middle-income countries .

Sophie Witter, Atle Fretheim, Flora L Kessy, Anne Karin Lindahl

Abstract readSystematic Review
PubMed Publisher
In one paragraph

Synthesis in The Cochrane database of systematic reviews, 2012. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 157 papers, 23 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
157citing papers in PubMed, 23 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

157 citing papers in PubMed, 23 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Pay for performance for hospitals.The Cochrane database of systematic reviews · 2019
    Pooled it
  9. Pooled it
  10. Pooled it
  11. Pooled it
  12. Pooled it
  13. Pooled it
  14. Payment methods for outpatient care facilities.The Cochrane database of systematic reviews · 2017
    Pooled it
  15. Pooled it
  16. Pooled it
  17. Pooled it
  18. Pharmaceutical policies: effects of financial incentives for prescribers.The Cochrane database of systematic reviews · 2015
    Pooled it
  19. Pooled it
  20. Pooled it

97 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

4 authors.

Sophie WitterImmpact, University of Aberdeen, Aberdeen, UK. 2Global Health Unit, Norwegian Knowledge Centre for the Health Services, Oslo,Norway. sophiewitter@blueyonder.co.uk.
Atle Fretheim
Flora L Kessy
Anne Karin Lindahl

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThere is a growing interest in paying for performance as a means to align the incentives of health workers and health providers with public health goals. However, there is currently a lack of rigorous evidence on the effectiveness of these strategies in improving health care and health, particularly in low- and middle-income countries. Moreover, paying for performance is a complex intervention with uncertain benefits and potential harms. A review of evidence on effectiveness is therefore timely, especially as this is an area of growing interest for funders and governments.

objectivesTo assess the current evidence for the effects of paying for performance on the provision of health care and health outcomes in low- and middle-income countries. SEARCH

methodsWe searched more than 15 databases in 2009, including the Cochrane Effective Practice and Organisation of Care Group Specialised Register (searched 3 March 2009), CENTRAL (2009, Issue 1) (searched 3 March 2009), MEDLINE, Ovid (1948 to present) (searched 24 June 2011), EMBASE, Ovid (1980 to 2009 Week 09) (searched 2 March 2009), EconLit, Ovid (1969 to February 2009) (searched 5 March 2009), as well as the Social Sciences Citation Index, ISI Web of Science (1975 to present) (searched 8 September 2010). We also searched the websites and online resources of numerous international agencies, organisations and universities to find relevant grey literature and contacted experts in the field. We carried out an updated search on the Results-Based Financing website in April 2011, and re-ran the MEDLINE search in June 2011. SELECTION CRITERIA: Pay for performance refers to the transfer of money or material goods conditional on taking a measurable action or achieving a predetermined performance target. To be included, a study had to report at least one of the following outcomes: changes in targeted measures of provider performance, such as the delivery or utilisation of healthcare services, or patient outcomes, unintended effects and/or changes in resource use. Studies also needed to use one of the following study designs: randomised trial, non-randomised trial, controlled before-after study or interrupted time series study, and had to have been conducted in low- or middle-income countries (as defined by the World Bank). DATA COLLECTION AND ANALYSIS: We aimed to present a meta-analysis of results. However, due to the limited number of studies in each category, the diversity of intervention designs and study methods, as well as important contextual differences, we present a narrative synthesis with separate results from each study. MAIN

resultsNine studies were included in the review: one randomised trial, six controlled before-after studies and two interrupted time series studies (or studies which could be re-analysed as such). The interventions were varied: one used target payments linked to quality of care (in the Philippines). Two used target payments linked to coverage indicators (in Tanzania and Zambia). Three used conditional cash transfers, modified by quality measurements (in Rwanda, Burundi and the Democratic Republic of Congo). Two used conditional cash transfers without quality measures (in Rwanda and Vietnam). One used a mix of conditional cash transfers and target payments (China). Targeted services also varied. Most of the interventions used a wide range of targets covering inpatient, outpatient and preventive care, including a strong emphasis on services for women and children. However, one focused specifically on tuberculosis (the main outcome measure was cases detected); one on hospital revenues; and one on improved treatment of common illnesses in under-sixes. Participants were in most cases in a mix of public and faith-based facilities (dispensaries, health posts, health centres and hospitals), though districts were also involved and in one case payments were made direct to individual private practitioners.One study was considered to have low risk of bias and one a moderate risk of bias. The other seven studies had a high risk of bias. Only one study included any patient health indicators. Of the four outcome measures, two showed significant improvement for the intervention group (wasting and self reported health by parents of the under-fives), while two showed no significant difference (being C-reactive protein (CRP)-negative and not anaemic). The two more robust studies both found mixed results - gains for some indicators but no improvement for others. Almost all dimensions of potential impact remain under-studied, including intended and unintended impact on health outcomes, equity, organisational change, user payments and satisfaction, resource use and staff satisfaction. AUTHORS'

conclusionsThe current evidence base is too weak to draw general conclusions; more robust and also comprehensive studies are needed. Performance-based funding is not a uniform intervention, but rather a range of approaches. Its effects depend on the interaction of several variables, including the design of the intervention (e.g. who receives payments, the magnitude of the incentives, the targets and how they are measured), the amount of additional funding, other ancillary components such as technical support, and contextual factors, including the organisational context in which it is implemented.

Indexed as

Developing CountriesReimbursement, IncentiveHumansQuality ImprovementQuality of Health Care

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.