ArticleHealth expectations : an international journal of public participation in health care and health policy2021
Evaluation of patient engagement in medicine development: A multi-stakeholder framework with metrics.
Article in Health expectations : an international journal of public participation in health care and health policy, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 23 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
23 citing papers in PubMed.
- "I am struggling to find an explicit task"-a midterm evaluation of patient research partner involvement in HIPPOCRATES translational research.EULAR rheumatology open · 2026Article
- Advancing the Science of Patient Input in Drug Research and Development.Journal of participatory medicine · 2026Article
- Evaluation and lessons learned regarding Public Involvement: a panel advising on an Alzheimer's disease and related dementia cohort study.Research involvement and engagement · 2026Article
- Methods of Engaging Interest-Holders in Healthcare Evidence Syntheses: A Scoping Review.Cochrane evidence synthesis and methods · 2026Review
- Introducing a Series of Reviews Assessing Engagement in Evidence Syntheses.Cochrane evidence synthesis and methods · 2025Article
- Measuring and Demonstrating the Value of Patient Engagement Across the Medicines Lifecycle: A Patient Engagement Impact Measurement Framework.The patient · 2025Article
- A mixed-methods study of patient and healthcare professional perceptions of care pathways for knee osteoarthritis.BMC primary care · 2024Article
- Protocol: Assessing the impact of interest-holder engagement on guideline development: A systematic review.Campbell systematic reviews · 2024Article
- Embedding patient engagement in the R&D process of a life sciences company through co-creation with a patient expert R&D board: a case study.Research involvement and engagement · 2024Article
- Understanding Co-Creation in a Research Partnership Programme Exploring Patient-Driven Innovations: A Qualitative Longitudinal Study.Health expectations : an international journal of public participation in health care and health policy · 2024Article
- Patient engagement as a collaborative process in a large Dutch COVID-19 vaccination study (RECOVAC) - insight into the contribution of patient engagement and learnings for the future.Research involvement and engagement · 2024Article
- Exploring ChatGPT's potential in the clinical stream of neurorehabilitation.Frontiers in artificial intelligence · 2024Review
- Evaluating the impact of engaging older adults and service providers as research partners in the co-design of a community mobility-promoting program: a mixed methods developmental evaluation study.Research involvement and engagement · 2023Article
- Systematic scoping review protocol of Stroke Patient and Stakeholder Engagement (SPSE).Systematic reviews · 2023Article
- Researchers' experiences with patient engagement in health research: a scoping review and thematic synthesis.Research involvement and engagement · 2023Article
- Using Patient Perspectives to Inform Better Clinical Trial Design and Conduct: Current Trends and Future Directions.Pharmaceutical medicine · 2023Review
- Overview of Chatbots with special emphasis on artificial intelligence-enabled ChatGPT in medical science.Frontiers in artificial intelligence · 2023Review
- Practices of patient engagement in drug development: a systematic scoping review.Research involvement and engagement · 2022Article
- Evaluating the Impacts of Patient Engagement on Health Services Research Teams: Lessons from the Veteran Consulting Network.Journal of general internal medicine · 2022Article
- Monitoring and Evaluation of Patient Engagement in Health Product Research and Development: Co-Creating a Framework for Community Advisory Boards.Journal of patient-centered research and reviews · 2022Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
13 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundPatient engagement is becoming more customary in medicine development. However, embedding it in organizational decision-making remains challenging, partly due to lack of agreement on its value and the means to evaluate it. The objective of this project was to develop a monitoring and evaluation framework, with metrics, to demonstrate impact and enhance learning.
methodsA consortium of five patient groups, 15 biopharmaceutical companies and two academic groups iteratively created a framework in a multi-phase participatory process, including analysis of its application in 24 cases.
resultsThe framework includes six components, with 87 metrics and 15 context factors distributed among (sub)components: (a) Input: expectations, preparations, resources, representativeness of stakeholders; (b) Activities/process: structure, management, interactions, satisfaction; (c) Learnings and changes; (d) Impacts: research relevance, study ethics and inclusiveness, study quality and efficiency, quality of evidence and uptake of products, empowerment, reputation and trust, embedding of patient engagement; (e) Context: policy, institutional, community, decision-making contextual factors. Case study findings show a wide variation in use of metrics. There is no 'one size fits all' set of metrics appropriate for every initiative or organization. Presented sample sets of metrics can be tailored to individual situations.
conclusionIntroducing change into any process is best done when the value of that change is clear. This framework allows participants to select what metrics they value and assess to what extent patient engagement has contributed. PATIENT CONTRIBUTION: Five patient groups were involved in all phases of the study (design, conduct, interpretation of data) and in writing the manuscript.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.