Evidence map›Paper›PMID 24890250›Full record

Trial reportThe Milbank quarterly2014

What are the key ingredients for effective public involvement in health care improvement and policy decisions? A randomized trial process evaluation.

Antoine Boivin, Pascale Lehoux, Jako Burgers, Richard Grol

Abstract readRandomized Controlled Trial
In one paragraph

Trial report in The Milbank quarterly, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 60 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
60citing papers in PubMed, 6 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

60 citing papers in PubMed, 6 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Patient and public engagement in research and health system decision making: A systematic review of evaluation tools.Health expectations : an international journal of public participation in health care and health policy · 2018
    Pooled it
  6. Pooled it
  7. Trial
  8. Trial
  9. Article
  10. Article
  11. Nothing about us, without us? A reflection on and call for involving children in the process of valuing child health.The European journal of health economics : HEPAC : health economics in prevention and care · 2026
    Article
  12. Review
  13. Article
  14. Article
  15. Patient influence on general practice service improvement decision making: a participatory research mixed-methods intervention study.The British journal of general practice : the journal of the Royal College of General Practitioners · 2024
    Article
  16. Public Engagement in Health Policy-Making for Older Adults: A Systematic Search and Scoping Review.Health expectations : an international journal of public participation in health care and health policy · 2024
    Article
  17. Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Antoine BoivinUniversité de Sherbrooke.
Pascale Lehoux
Jako Burgers
Richard Grol

Funding

Canadian Institutes of Health Research
6 · The paper itself

Abstract

contextIn the past 50 years, individual patient involvement at the clinical consultation level has received considerable attention. More recently, patients and the public have increasingly been involved in collective decisions concerning the improvement of health care and policymaking. However, rigorous evaluation guiding the development and implementation of effective public involvement interventions is lacking. This article describes those key ingredients likely to affect public members' ability to deliberate productively with professionals and influence collective health care choices.

methodWe conducted a trial process evaluation of public involvement in setting priorities for health care improvement. In all, 172 participants (including 83 patients and public members and 89 professionals) from 6 Health and Social Services Centers in Canada participated in the trial. We video-recorded 14 one-day meetings, and 2 nonparticipant observers took structured notes. Using qualitative analysis, we show how public members influenced health care improvement priorities.

findingsLegitimacy, credibility, and power explain the variations in the public members' influence. Their credibility was supported by their personal experience as patients and caregivers, the provision of a structured preparation meeting, and access to population-based data from their community. Legitimacy was fostered by the recruitment of a balanced group of participants and by the public members' opportunities to draw from one another's experience. The combination of small-group deliberations, wider public consultation, and a moderation style focused on effective group process helped level out the power differences between professionals and the public. The engagement of key stakeholders in the intervention design and implementation helped build policy support for public involvement.

conclusionsA number of interacting active ingredients structure and foster the public's legitimacy, credibility, and power. By paying greater attention to them, policymakers could develop and implement more effective public involvement interventions.

Indexed as

Policy MakingAdultCanadaCommunity ParticipationFemaleHealth PolicyHumansMalePublic OpinionQuality ImprovementQuality of Health Carepatient participationpolicymakingqualitative researchquality of health care

Identifiers

PMID24890250
PMCPMC4089374

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.