Evidence map›Paper›PMID 37403248›Full record

ArticleHealth expectations : an international journal of public participation in health care and health policy2023

Towards an Implementation-STakeholder Engagement Model (I-STEM) for improving health and social care services.

Sebastian Potthoff, Tracy Finch, Leah Bührmann, Anne Etzelmüller, Claire R van Genugten, Melissa Girling, Carl R May, Neil Perkins, Christiaan Vis, Tim Rapley and 1 more

Registry-linked trialOpen access · goldAbstract read
In one paragraph

Article in Health expectations : an international journal of public participation in health care and health policy, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT03652883 (ImpleMentAll - Towards Evidence-based Tailored Implementation Strategies for eHealth), which is not on this map. Cited by 46 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
46citing papers in PubMed, 3 pooled it
35.4field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03652883 nacompletednot on this map

ImpleMentAll - Towards Evidence-based Tailored Implementation Strategies for eHealth

TypeinterventionalSponsorVU University of AmsterdamRan2018 to 2020Enrolled456ConditionsTailored Implementation: Online ItFits-toolkit, Implementation as UsualArmsItFits-toolkit, Implementation as Usual
3 · Its place in the literature

Who cites it

46 citing papers in PubMed, 3 syntheses or guidelines pooled it, 81 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Trial
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Review
  12. Article
  13. Review
  14. Article
  15. Article
  16. Review
  17. Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 5 institutions in 4 countries.

Sebastian PotthoffDepartment of Social Work, Education, and Community Wellbeing, Northumbria University, Newcastle Upon Tyne, UK.ORCID 0000-0003-4580-8532
Tracy FinchDepartment of Nursing, Midwifery and Health, Northumbria University, Newcastle upon Tyne, UK.ORCID 0000-0001-8647-735X
Leah BührmannDepartment of Social Work, Education, and Community Wellbeing, Northumbria University, Newcastle Upon Tyne, UK.ORCID 0000-0001-6957-4369
Anne EtzelmüllerDepartment Sports and Health Sciences, Technical University of Munich, Munich, Germany.ORCID 0000-0001-8833-6067
Claire R van GenugtenClinical, Neuro-, & Developmental Psychology Faculty of Behavioural and Movement Sciences, VU Amsterdam, The Netherlands.ORCID 0000-0003-3209-4673
Melissa GirlingDepartment of Nursing, Midwifery and Health, Northumbria University, Newcastle upon Tyne, UK.ORCID 0000-0002-0272-5262
Carl R MayDepartment of Health Services Research and Policy, London School of Hygiene and Tropical Medicine & NIHR North Thames ARC, London, UK.ORCID 0000-0002-0451-2690
Neil PerkinsDepartment of Social Work, Education, and Community Wellbeing, Northumbria University, Newcastle Upon Tyne, UK.
Christiaan VisClinical, Neuro-, & Developmental Psychology Faculty of Behavioural and Movement Sciences, VU Amsterdam, The Netherlands.ORCID 0000-0001-8783-8487
Tim RapleyDepartment of Social Work, Education, and Community Wellbeing, Northumbria University, Newcastle Upon Tyne, UK.ORCID 0000-0003-4836-4279
ImpleMentAll consortium
Northumbria University · GBHaukeland University Hospital · NOLondon School of Hygiene & Tropical Medicine · GBTechnical University of Munich · DEVrije Universiteit Amsterdam · NL

Funding

Department of Health NIHR200163Department of Health NIHR200173
6 · The paper itself

Abstract

backgroundThe implementation science literature acknowledges a need for engagement of key stakeholders when designing, delivering and evaluating implementation work. To date, the literature reports minimal or focused stakeholder engagement, where stakeholders are engaged in either barrier identification and/or barrier prioritisation. This paper begins to answer calls from the literature for the development of tools and guidance to support comprehensive stakeholder engagement in implementation research and practice. The paper describes the systematic development of the Implementation-STakeholder Engagement Model (I-STEM) in the context of an international, large-scale empirical implementation study (ImpleMentAll) aimed at evaluating the effectiveness of a tailored implementation toolkit. The I-STEM is a sensitising tool that defines key considerations and activities for undertaking stakeholder engagement activities across an implementation process.

methodsIn-depth, semistructured interviews and observations were conducted with implementers who were tailoring implementation strategies to integrate and embed internet-based cognitive behavioural therapy (iCBT) services in 12 routine mental health care organisations in nine countries in Europe and Australia. The analytical process was informed by principles of first- and third-generation Grounded Theory, including constant comparative method.

resultsWe conducted 55 interviews and observed 19 implementation-related activities (e.g., team meetings and technical support calls). The final outcome of our analysis is expressed in an initial version of the I-STEM, consisting of five interrelated concepts: engagement objectives, stakeholder mapping, engagement approaches, engagement qualities and engagement outcomes. Engagement objectives are goals that implementers plan to achieve by working with stakeholders in the implementation process. Stakeholder mapping involves identifying a range of organisations, groups or people who may be instrumental in achieving the engagement objectives. Engagement approaches define the type of work that is undertaken with stakeholders to achieve the engagement objectives. Engagement qualities define the logistics of the engagement approach. Lastly, every engagement activity may result in a range of engagement outcomes.

conclusionThe I-STEM represents potential avenues for substantial stakeholder engagement activity across key phases of an implementation process. It provides a conceptual model for the planning, delivery, evaluation and reporting of stakeholder engagement activities. The I-STEM is nonprescriptive and highlights the importance of a flexible, iterative approach to stakeholder engagement. It is developmental and will require application and validation across a range of implementation activities. PATIENT OR PUBLIC CONTRIBUTION: Patient contribution to ImpleMentAll trial was facilitated by GAMIAN-Europe at all stages-from grant development to dissemination. GAMIAN-Europe brings together a wide variety of patient representation organisations (local, regional and national) from almost all European countries. GAMIAN-Europe was involved in pilot testing the ItFits-toolkit and provided their views on the various aspects, including stakeholder engagement. Patients were also represented in the external advisory board providing support and advice on the design, conduct and interpretation of the wider project, including the development of the ItFits-toolkit.

trial registrationClinicalTrials.gov NCT03652883. Retrospectively registered on 29 August 2018.

Indexed as

Social SupportStakeholder ParticipationAustraliaEuropeHumansSocial Workco-designco-productionimplementation strategiesnormalisationstakeholder engagementtailored implementation

Identifiers

PMID37403248
PMCPMC10485327
OpenAlexW4383186783

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.