Did a quality improvement intervention improve quality of maternal health care? Implementation evaluation from a cluster-randomized controlled study.

objectiveTo test the success of a maternal healthcare quality improvement intervention in actually improving quality.

designCluster-randomized controlled study with implementation evaluation; we randomized 12 primary care facilities to receive a quality improvement intervention, while 12 facilities served as controls.

settingFour districts in rural Tanzania.

participantsHealth facilities (24), providers (70 at baseline; 119 at endline) and patients (784 at baseline; 886 at endline).

interventionsIn-service training, mentorship and supportive supervision and infrastructure support.

main outcome measuresWe measured fidelity with indictors of quality and compared quality between intervention and control facilities using difference-in-differences analysis.

resultsQuality of care was low at baseline: the average provider knowledge test score was 46.1% (range: 0-75%) and only 47.9% of women were very satisfied with delivery care. The intervention was associated with an increase in newborn counseling (β: 0.74, 95% CI: 0.13, 1.35) but no evidence of change across 17 additional indicators of quality. On average, facilities reached 39% implementation. Comparing facilities with the highest implementation of the intervention to control facilities again showed improvement on only one of the 18 quality indicators.

conclusionsA multi-faceted quality improvement intervention resulted in no meaningful improvement in quality. Evidence suggests this is due to both failure to sustain a high-level of implementation and failure in theory: quality improvement interventions targeted at the clinic-level in primary care clinics with weak starting quality, including poor infrastructure and low provider competence, may not be effective.