ArticleHealth expectations : an international journal of public participation in health care and health policy2023
Towards an Implementation-STakeholder Engagement Model (I-STEM) for improving health and social care services.
Article in Health expectations : an international journal of public participation in health care and health policy, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT03652883 (ImpleMentAll - Towards Evidence-based Tailored Implementation Strategies for eHealth), which is not on this map. Cited by 46 papers, 3 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
ImpleMentAll - Towards Evidence-based Tailored Implementation Strategies for eHealth
Who cites it
46 citing papers in PubMed, 3 syntheses or guidelines pooled it, 81 citations in OpenAlex.
- Stakeholder engagement in healthcare research in India - A systematic review.Health research policy and systems · 2025Pooled it
- Engagement in Hypertension and Diabetes Clinical Trials at Federally Qualified Health Centers: A Systematic Review.JAMA network open · 2025Pooled it
- Effectiveness of Physical Activity Interventions on Acute Inpatient Mental Health Units on Health Outcomes: A Systematic Review.International journal of mental health nursing · 2025Pooled it
- Trial
- Acceptability, feasibility, and factors affecting implementation of a gender-sensitivity training for HIV providers and staff in Uganda: a mixed methods, quasi-experimental controlled pilot trial.BMC public health · 2025Trial
- Using App Store Reviews to Explore User Experiences and Perceptions of Mental Health Mobile Apps: Qualitative Study.JMIR formative research · 2026Article
- A Hybrid Care Intervention for High-Risk Patients With Chronic Obstructive Respiratory Disorders: Mixed Methods Co-Design Study.Journal of medical Internet research · 2026Article
- Engaging With Hospital Staff to Develop Implementation Strategies For Delivering a Patient Falls Prevention Education Program Using a World Café.Western journal of nursing research · 2026Article
- Adapting a United States cancer education programme for South Africa: A participatory, culturally tailored approach using Card's Seven-Step adaptation framework.African journal of primary health care & family medicine · 2026Article
- Participatory approaches for tailoring implementation strategies in healthcare settings: a scoping review of contemporary literature (2019-2024).Implementation science communications · 2026Review
- Exploring Stakeholder Involvement in Intervention Implementation Studies: Systematic Evidence Synthesis With an Evidence Gap Map Approach.Evaluation & the health professions · 2026Review
- A Brazilian approach to training stakeholder engagement skills in biotechnology undergraduates through curricular innovation.Nature biotechnology · 2026Article
- Perspectives from a multi-stakeholder workshop for implementing a risk-stratified breast cancer screening program in Canada.Communications medicine · 2026Review
- Development of implementation strategies for the National Emergency Airway Registry for Pediatric Emergency Medicine (NEAR4PEM) pre-intubation checklist: a prospective, pre-implementation planning study.Implementation science communications · 2026Article
- Identifying and supporting trafficked individuals: provider and community organization perspectives on existing sociotechnical approaches.Journal of the American Medical Informatics Association : JAMIA · 2026Article
- Community engagement and implementation science: a hermeneutic review for implementation scientists.Implementation science communications · 2026Review
- The Homeless Outreach Behavioral Screen (HOBS): A Brief Scale for Identifying Need for Mental Health Evaluation Among Unsheltered Populations.Community mental health journal · 2026Article
- Creation of an Implementation Blueprint for the National Emergency Airway Registry for Pediatric Emergency Medicine (NEAR4PEM) Pre-Intubation Checklist.Research square · 2026Article
- Accelerating the Adoption of Best Practice Research in Resuscitation Through Implementation Science: Identifying Gaps and Pathways.Journal of clinical medicine · 2026Review
- A mixed-methods first-year evaluation of implementation outcomes for a bottom-up osteoarthritis management program across healthcare settings in Ireland.Translational behavioral medicine · 2026Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
11 authors at 5 institutions in 4 countries.
Funding
Abstract
backgroundThe implementation science literature acknowledges a need for engagement of key stakeholders when designing, delivering and evaluating implementation work. To date, the literature reports minimal or focused stakeholder engagement, where stakeholders are engaged in either barrier identification and/or barrier prioritisation. This paper begins to answer calls from the literature for the development of tools and guidance to support comprehensive stakeholder engagement in implementation research and practice. The paper describes the systematic development of the Implementation-STakeholder Engagement Model (I-STEM) in the context of an international, large-scale empirical implementation study (ImpleMentAll) aimed at evaluating the effectiveness of a tailored implementation toolkit. The I-STEM is a sensitising tool that defines key considerations and activities for undertaking stakeholder engagement activities across an implementation process.
methodsIn-depth, semistructured interviews and observations were conducted with implementers who were tailoring implementation strategies to integrate and embed internet-based cognitive behavioural therapy (iCBT) services in 12 routine mental health care organisations in nine countries in Europe and Australia. The analytical process was informed by principles of first- and third-generation Grounded Theory, including constant comparative method.
resultsWe conducted 55 interviews and observed 19 implementation-related activities (e.g., team meetings and technical support calls). The final outcome of our analysis is expressed in an initial version of the I-STEM, consisting of five interrelated concepts: engagement objectives, stakeholder mapping, engagement approaches, engagement qualities and engagement outcomes. Engagement objectives are goals that implementers plan to achieve by working with stakeholders in the implementation process. Stakeholder mapping involves identifying a range of organisations, groups or people who may be instrumental in achieving the engagement objectives. Engagement approaches define the type of work that is undertaken with stakeholders to achieve the engagement objectives. Engagement qualities define the logistics of the engagement approach. Lastly, every engagement activity may result in a range of engagement outcomes.
conclusionThe I-STEM represents potential avenues for substantial stakeholder engagement activity across key phases of an implementation process. It provides a conceptual model for the planning, delivery, evaluation and reporting of stakeholder engagement activities. The I-STEM is nonprescriptive and highlights the importance of a flexible, iterative approach to stakeholder engagement. It is developmental and will require application and validation across a range of implementation activities. PATIENT OR PUBLIC CONTRIBUTION: Patient contribution to ImpleMentAll trial was facilitated by GAMIAN-Europe at all stages-from grant development to dissemination. GAMIAN-Europe brings together a wide variety of patient representation organisations (local, regional and national) from almost all European countries. GAMIAN-Europe was involved in pilot testing the ItFits-toolkit and provided their views on the various aspects, including stakeholder engagement. Patients were also represented in the external advisory board providing support and advice on the design, conduct and interpretation of the wider project, including the development of the ItFits-toolkit.
trial registrationClinicalTrials.gov NCT03652883. Retrospectively registered on 29 August 2018.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.