SynthesisBMC health services research2021
Evaluating health service outcomes of public involvement in health service design in high-income countries: a systematic review.
Synthesis in BMC health services research, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers, 4 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
24 citing papers in PubMed, 4 syntheses or guidelines pooled it.
- Oral Health Interventions to Improve Access in Rural Areas of High-Income Countries: A Mixed Methods Systematic Review.Community dentistry and oral epidemiology · 2026Pooled it
- Evaluating Process and Outcomes of Public Involvement in Applied Health and Social Care Research: A Rapid Systematic Review.Health expectations : an international journal of public participation in health care and health policy · 2025Pooled it
- Pooled it
- Public participation in decisions about measures to manage the COVID-19 pandemic: a systematic review.BMJ global health · 2024Pooled it
- Reconsidering Governance Models to Strengthen Rural Healthcare.Journal of bioethical inquiry · 2026Article
- Development of a Patient and Carer Advisory Board to Co-Design Health Services Research for the Quality of Care of People With Dementia.Health expectations : an international journal of public participation in health care and health policy · 2026Article
- Involvement of underserved 18-40 year olds living with early-onset type 2 diabetes in the M3 NIHR programme grant.Research involvement and engagement · 2025Article
- Promoting informed health choices: the long and winding road.Journal of the Royal Society of Medicine · 2025Article
- Continuity Is Essential: The Experiences of Co-Design Participants During the Implementation of a New Health Service.Health expectations : an international journal of public participation in health care and health policy · 2025Article
- Measuring impacts of patient and public involvement and engagement (PPIE): a narrative review synthesis of review evidence.Research involvement and engagement · 2025Review
- Developing an evaluation tool for the impact of consumer partnerships in healthcare governance: a coproduced mixed methods study.BMJ open quality · 2025Article
- Operationalising Patient Engagement Through the Alberta Cancer Diagnosis Initiative: Recruitment Strategies for Diverse Populations in Health System Improvement.Health expectations : an international journal of public participation in health care and health policy · 2025Article
- Co-designing and pilot-testing an infographic to support the consent process in an adaptive platform trial for adults in ICU with community-acquired pneumonia or COVID-19: a mixed methods study within a trial (SWAT).Research involvement and engagement · 2025Article
- Chronic disease management: policy design based on service design methods.Frontiers in public health · 2025Article
- Interrogating the effectiveness of service engagement for underserved populations in complex health and social care systems: towards an equitable engagement strategy.International journal for equity in health · 2024Article
- Experiences of participants in the co-design of a community-based health service for people with high healthcare service use.BMC health services research · 2024Article
- Barriers and Enablers to Evaluating Outcomes From Public Involvement in Health Service Design: An Interpretive Description.Qualitative health research · 2023Article
- Comparing an in-person workshop and a postal Delphi survey for involving health service users in health care and health research prioritization.Health expectations : an international journal of public participation in health care and health policy · 2023Article
- Patient and public involvement in an international rheumatology translational research project: an evaluation.BMC rheumatology · 2022Article
- Implementing public involvement throughout the research process-Experience and learning from the GPs in EDs study.Health expectations : an international journal of public participation in health care and health policy · 2022Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
3 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundInternationally, it is expected that health services will involve the public in health service design. Evaluation of public involvement has typically focused on the process and experiences for participants. Less is known about outcomes for health services. The aim of this systematic review was to a) identify and synthesise what is known about health service outcomes of public involvement and b) document how outcomes were evaluated.
methodsSearches were undertaken in MEDLINE, EMBASE, The Cochrane Library, PsycINFO, Web of Science, and CINAHL for studies that reported health service outcomes from public involvement in health service design. The review was limited to high-income countries and studies in English. Study quality was assessed using the Mixed Methods Appraisal Tool and critical appraisal guidelines for assessing the quality and impact of user involvement in health research. Content analysis was used to determine the outcomes of public involvement in health service design and how outcomes were evaluated.
resultsA total of 93 articles were included. The majority were published in the last 5 years, were qualitative, and were located in the United Kingdom. A range of health service outcomes (discrete products, improvements to health services and system/policy level changes) were reported at various levels (service level, across services, and across organisations). However, evaluations of outcomes were reported in less than half of studies. In studies where outcomes were evaluated, a range of methods were used; most frequent were mixed methods. The quality of study design and reporting was inconsistent.
conclusionWhen reporting public involvement in health service design authors outline a range of outcomes for health services, but it is challenging to determine the extent of outcomes due to inadequate descriptions of study design and poor reporting. There is an urgent need for evaluations, including longitudinal study designs and cost-benefit analyses, to fully understand outcomes from public involvement in health service design.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.