Evidence map›Paper›PMID 36735287›Full record

Trial reportJournal of medical Internet research2023

Effectiveness of Self-guided Tailored Implementation Strategies in Integrating and Embedding Internet-Based Cognitive Behavioral Therapy in Routine Mental Health Care: Results of a Multicenter Stepped-Wedge Cluster Randomized Trial.

Christiaan Vis, Josien Schuurmans, Bruno Aouizerate, Mette Atipei Craggs, Philip Batterham, Leah Bührmann, Alison Calear, Arlinda Cerga Pashoja, Helen Christensen, Els Dozeman and 30 more

2 registry-linked trialsOpen access · goldAbstract readRandomized Controlled TrialMulticenter Study
In one paragraph

Trial report in Journal of medical Internet research, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 2 registered trials, which are not on this map. Cited by 28 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
28citing papers in PubMed, 2 pooled it
6.5field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03652883 nacompletednot on this map

ImpleMentAll - Towards Evidence-based Tailored Implementation Strategies for eHealth

TypeinterventionalSponsorVU University of AmsterdamRan2018 to 2020Enrolled456ConditionsTailored Implementation: Online ItFits-toolkit, Implementation as UsualArmsItFits-toolkit, Implementation as Usual
NCT06718322 naenrolling by invitationnot on this mapstarted 2024, after this paper: background citation

Towards Large-Scale Adaptation and Tailored Implementation of Primary Cancer Prevention Programs Across 9 Countries

TypeinterventionalSponsorHidde van der PloegRan2024 to 2026Enrolled100ConditionsFocus of Study: Tailored ImplementationArmsPrimary Cancer Prevention Implementation Toolkit (PCP-IT)
3 · Its place in the literature

Who cites it

28 citing papers in PubMed, 2 syntheses or guidelines pooled it, 45 citations in OpenAlex.

  1. Tailored interventions to address determinants of practice.The Cochrane database of systematic reviews · 2026
    Pooled it
  2. Pooled it
  3. Trial
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Innovations to improve outcomes and uptake of psychotherapies for mental disorders: a state-of-the-art review.World psychiatry : official journal of the World Psychiatric Association (WPA) · 2026
    Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

40 authors at 20 institutions in 11 countries.

Christiaan VisClinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.ORCID 0000-0001-8783-8487
Josien SchuurmansGGZ InGeest, Amsterdam, Netherlands.ORCID 0000-0003-4029-1810
Bruno AouizerateRegional Reference Center for the Management and Treatment of Anxiety and Depressive Disorders, FondaMental Advanced Centre of Expertise in Resistant Depression, Deparment of General and Academic Psychiatry, Charles Perrens Hospital, Bordeaux, France.ORCID 0000-0002-7092-7747
Mette Atipei CraggsResearch Unit for Digital Psychiatry, Deptartment of Clinical Research, University of Southern Denmark, Odense, Denmark.ORCID 0000-0001-8102-4597
Philip BatterhamCentre for Mental Health Research, The Australian National University, Canberra, Australia.ORCID 0000-0002-4547-6876
Leah BührmannDepartment of Social Work, Education and Community Wellbeing, Northumbria University, Newcastle Upon Tyne, United Kingdom.ORCID 0000-0001-6957-4369
Alison CalearCentre for Mental Health Research, The Australian National University, Canberra, Australia.ORCID 0000-0002-7028-725X
Arlinda Cerga PashojaLondon School of Hygiene and Tropical Medicine, London, United Kingdom.ORCID 0000-0002-7029-947X
Helen ChristensenDepartment of Medicine, University of New South Wales, Sydney, Australia.ORCID 0000-0003-0435-2065
Els DozemanGGZ InGeest, Amsterdam, Netherlands.ORCID 0000-0002-3550-4298
Claus Duedal PedersenSundhed.dk, Odense, Denmark.ORCID 0000-0002-6637-0392
David Daniel EbertProfessorship Psychology & Digital Mental Health, Technical University of Munich, Munich, Germany.ORCID 0000-0001-6820-0146
Anne EtzelmuellerProfessorship Psychology & Digital Mental Health, Technical University of Munich, Munich, Germany.ORCID 0000-0001-8833-6067
Naim FanajMental Health Center Prizren, Prizren, Kosovo.ORCID 0000-0001-7375-643X
Tracy L FinchDepartment of Nursing, Midwifery and Health, Northumbria University, Newcastle Upon Tyne, United Kingdom.ORCID 0000-0001-8647-735X
Denise HanssenDepartment of Psychiatry, University Medical Center Groningen, University of Groningen, Groningen, Netherlands.ORCID 0000-0003-0119-9608
Ulrich HegerlGerman Depression Foundation, Leipzig, Germany.ORCID 0000-0003-2031-0594
Adriaan HoogendoornAmsterdam Public Health research institute, Amsterdam, Netherlands.ORCID 0000-0003-4784-0712
Kim MathiasenResearch Unit for Digital Psychiatry, Deptartment of Clinical Research, University of Southern Denmark, Odense, Denmark.ORCID 0000-0001-6067-8866
Carl MayFaculty of Public Health and Policy, London School of Hygiene and Tropical Medicine, London, United Kingdom.ORCID 0000-0002-0451-2690
Andia MeksiInstitute of Public Health, Tirana, Albania.ORCID 0000-0003-1769-1488
Sevim MustafaMental Health Center Prizren, Prizren, Kosovo.ORCID 0000-0003-1105-6475
Bridianne O'DeaBlack Dog Institute, University of New South Wales, Sydney, Australia.ORCID 0000-0003-1731-210X
Caroline OehlerGerman Depression Foundation, Leipzig, Germany.ORCID 0000-0001-8329-147X
Jordi Piera-JiménezCatalan Health Service, Barcelona, Spain.ORCID 0000-0001-6471-9979
Sebastian PotthoffDepartment of Social Work, Education and Community Wellbeing, Northumbria University, Newcastle Upon Tyne, United Kingdom.ORCID 0000-0003-4580-8532
Gentiana QirjakoDepartment of Public Health, Faculty of Medicine, University of Medicine, Tirana, Albania.ORCID 0000-0003-3179-9006
Tim RapleyDepartment of Social Work, Education and Community Wellbeing, Northumbria University, Newcastle Upon Tyne, United Kingdom.ORCID 0000-0003-4836-4279
Judith RosmalenDepartment of Psychiatry, University Medical Center Groningen, University of Groningen, Groningen, Netherlands.ORCID 0000-0002-6393-0032
Ylenia SaccoDepartment of Mental Health, Local Health Authority Torino 3, ASLTO3, Torino, Italy.ORCID 0000-0002-2312-5231
Ludovic SamalinDepartment of psychiatry, Centre Hospitalier Universitaire de Clermont-Ferrand, Expert center for bipolar disorder (Foundation FondaMental), University of Clermont Auvergne, Clermont-Ferrand, France.ORCID 0000-0003-0740-4019
Mette Maria SkjothDepartment of Dermatology and Allergy Centre, Odense University Hospital, Odense, Denmark.ORCID 0000-0002-3528-4619
Kristine TarpResearch Unit for Digital Psychiatry, Deptartment of Clinical Research, University of Southern Denmark, Odense, Denmark.ORCID 0000-0003-0901-855X
Ingrid TitzlerDepartment of Clinical Psychology and Psychotherapy, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany.ORCID 0000-0002-8963-2324
Erik Van der EyckenGAMIAN Europe, Brussels, Belgium.ORCID 0000-0001-5807-3366
Claire Rosalie van GenugtenClinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.ORCID 0000-0003-3209-4673
Alexis WhittonBlack Dog Institute, University of New South Wales, Sydney, Australia.ORCID 0000-0002-7944-2172
Enrico ZanaldaDepartment of Mental Health, Local Health Authority Torino 3, ASLTO3, Torino, Italy.ORCID 0000-0003-4449-8384
Jan H SmitAmsterdam Public Health research institute, Amsterdam, Netherlands.ORCID 0000-0002-2062-8378
Heleen RiperClinical, Neuro-, & Developmental Psychology, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.ORCID 0000-0002-8144-8901
Northumbria University · GBGGZ inGeest · NLUniversity of Southern Denmark · DKAmsterdam University Medical Centers · NLAustralian National University · AUBlack Dog Institute · AUIGES Institut · DELondon School of Hygiene & Tropical Medicine · GBUniversity Clinical Center of Kosovo · XKUniversity Medical Center Groningen · NLUniversity of Medicine Tirana · ALCentre Hospitalier Charles Perrens · FREuropean Alliance Against Depression · DEFriedrich-Alexander-Universität Erlangen-Nürnberg · DEGlobal Alliance of Mental Illness Advocacy Networks-Europe · BEGoethe University Frankfurt · DEHaukeland University Hospital · NOInstitut Pascal · FROdense University Hospital · DKUniversitat Oberta de Catalunya · ES

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundInternet-based cognitive behavioral therapy (iCBT) services for common mental health disorders have been found to be effective. There is a need for strategies that improve implementation in routine practice. One-size-fits-all strategies are likely to be ineffective. Tailored implementation is considered as a promising approach. The self-guided integrated theory-based Framework for intervention tailoring strategies toolkit (ItFits-toolkit) supports local implementers in developing tailored implementation strategies. Tailoring involves identifying local barriers; matching selected barriers to implementation strategies; developing an actionable work plan; and applying, monitoring, and adapting where necessary.

objectiveThis study aimed to compare the effectiveness of the ItFits-toolkit with implementation-as-usual (IAU) in implementing iCBT services in 12 routine mental health care organizations in 9 countries in Europe and Australia.

methodsA stepped-wedge cluster randomized trial design with repeated measures was applied. The trial period lasted 30 months. The primary outcome was the normalization of iCBT delivery by service providers (therapists, referrers, IT developers, and administrators), which was measured with the Normalization Measure Development as a proxy for implementation success. A 3-level linear mixed-effects modeling was applied to estimate the effects. iCBT service uptake (referral and treatment completion rates) and implementation effort (hours) were used as secondary outcomes. The perceived satisfaction (Client Satisfaction Questionnaire), usability (System Usability Scale), and impact of the ItFits-toolkit by implementers were used to assess the acceptability of the ItFits-toolkit.

resultsIn total, 456 mental health service providers were included in this study. Compared with IAU, the ItFits-toolkit had a small positive statistically significant effect on normalization levels in service providers (mean 0.09, SD 0.04; P=.02; Cohen d=0.12). The uptake of iCBT by patients was similar to that of IAU. Implementers did not spend more time on implementation work when using the ItFits-toolkit and generally regarded the ItFits-toolkit as usable and were satisfied with it.

conclusionsThe ItFits-toolkit performed better than the usual implementation activities in implementing iCBT services in routine practice. There is practical utility in the ItFits-toolkit for supporting implementers in developing and applying effective tailored implementation strategies. However, the effect on normalization levels among mental health service providers was small. These findings warrant modesty regarding the effectiveness of self-guided tailored implementation of iCBT services in routine practice.

trial registrationClinicalTrials.gov NCT03652883; https://clinicaltrials.gov/ct2/show/NCT03652883. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.1186/s13063-020-04686-4.

Indexed as

Cognitive Behavioral TherapyMental Health ServicesHumansInternetMental HealthSurveys and QuestionnairesTreatment Outcomecommon mental health disordersiCBTimplementation strategiesinternet-based cognitive behavioral therapymobile phonetailored implementation

Identifiers

PMID36735287
PMCPMC9938445
OpenAlexW4312344579

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.