Evidence map›Paper›PMID 30922339›Full record

ArticleHealth research policy and systems2019

The dark side of coproduction: do the costs outweigh the benefits for health research?

Kathryn Oliver, Anita Kothari, Nicholas Mays

Registry-linked trialAbstract readLetter
In one paragraph

Article in Health research policy and systems, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT07110779 (Telenursing in Coronary Artery Disease), which is not on this map. Cited by 295 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
295citing papers in PubMed, 5 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT07110779 nanot yet recruitingnot on this mapstarted 2025, after this paper: background citation

Telenursing in Coronary Artery Disease: Randomized Clinical Trial and Patient Collaboration

TypeinterventionalSponsorFernanda Maria Alves LimaRan2025 to 2026Enrolled150ConditionsCoronary Artery Disease, Cardiovascular DiseasesArmsTelenursing consultation
3 · Its place in the literature

Who cites it

295 citing papers in PubMed, 5 syntheses or guidelines pooled it.

  1. Pooled it
  2. What Do We Know About Sharing Power in Co-Production in Mental Health Research? A Systematic Review and Thematic Synthesis.Health expectations : an international journal of public participation in health care and health policy · 2024
    Pooled it
  3. Participatory research with carers: A systematic review and narrative synthesis.Health expectations : an international journal of public participation in health care and health policy · 2024
    Pooled it
  4. A systematic review of theories, models and frameworks used for youth engagement in health research.Health expectations : an international journal of public participation in health care and health policy · 2024
    Pooled it
  5. Evaluating the role and effectiveness of co-produced community-based mental health interventions that aim to reduce suicide among adults: A systematic review.Health expectations : an international journal of public participation in health care and health policy · 2023
    Pooled it
  6. Trial
  7. Trial
  8. Article
  9. Evaluation of Co-Production in Adolescent Health Research: A Mixed Methods Study From Born in Bradford.Health expectations : an international journal of public participation in health care and health policy · 2026
    Article
  10. Developing Best Practices in Co-Production With Lived Experience Experts in Bipolar Research: Insights From the AMBIENT-BD Lived Experience Advisory Panel.Health expectations : an international journal of public participation in health care and health policy · 2026
    Article
  11. Review
  12. Article
  13. Review
  14. Review
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

235 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

3 authors.

Kathryn OliverDepartment of Public Health, Environments and Society, Faculty of Public Health Policy, London School of Hygiene and Tropical Medicine, London, UK. kathryn.oliver@lshtm.ac.uk.ORCID http://orcid.org/0000-0002-4326-5258
Anita KothariSchool of Health Studies, Western University, London, ON, Canada.
Nicholas MaysDepartment of Health Services Research and Policy, Faculty of Public Health Policy, London School of Hygiene and Tropical Medicine, London, UK.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundCoproduction, a collaborative model of research that includes stakeholders in the research process, has been widely advocated as a means of facilitating research use and impact. We summarise the arguments in favour of coproduction, the different approaches to establishing coproductive work and their costs, and offer some advice as to when and how to consider coproduction. DEBATE: Despite the multiplicity of reasons and incentives to coproduce, there is little consensus about what coproduction is, why we do it, what effects we are trying to achieve, or the best coproduction techniques to achieve policy, practice or population health change. Furthermore, coproduction is not free risk or cost. Tensions can arise throughout coproduced research processes between the different interests involved. We identify five types of costs associated with coproduced research affecting the research itself, the research process, professional risks for researchers and stakeholders, personal risks for researchers and stakeholders, and risks to the wider cause of scholarship. Yet, these costs are rarely referred to in the literature, which generally calls for greater inclusion of stakeholders in research processes, focusing exclusively on potential positives. There are few tools to help researchers avoid or alleviate risks to themselves and their stakeholders.

conclusionsFirst, we recommend identifying specific motivations for coproduction and clarifying exactly which outcomes are required for whom for any particular piece of research. Second, we suggest selecting strategies specifically designed to enable these outcomes to be achieved, and properly evaluated. Finally, in the absence of strong evidence about the impact and process of coproduction, we advise a cautious approach to coproduction. This would involve conscious and reflective research practice, evaluation of how coproduced research practices change outcomes, and exploration of the costs and benefits of coproduction. We propose some preliminary advice to help decide when coproduction is likely to be more or less useful.

Indexed as

Cooperative BehaviorCost-Benefit AnalysisResearchResearch DesignStakeholder ParticipationHumansMotivationCoproductionevidence usepolicy and practiceresearch ethicsstakeholder engagement

Identifiers

PMID30922339
PMCPMC6437844

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.