Evidence map›Paper›PMID 31573934›Full record

SynthesisJournal of medical Internet research2019

Implementation Strategies to Enhance the Implementation of eHealth Programs for Patients With Chronic Illnesses: Realist Systematic Review.

Cecilie Varsi, Lise Solberg Nes, Olöf Birna Kristjansdottir, Saskia M Kelders, Una Stenberg, Heidi Andersen Zangi, Elin Børøsund, Karen Elizabeth Weiss, Audun Stubhaug, Rikke Aune Asbjørnsen and 3 more

Abstract readSystematic Review
In one paragraph

Synthesis in Journal of medical Internet research, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 74 papers, 8 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
74citing papers in PubMed, 8 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

74 citing papers in PubMed, 8 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Guideline
  8. Pooled it
  9. Trial
  10. Trial
  11. Trial
  12. Trial
  13. Article
  14. Review
  15. Review
  16. Strategies to promote the dissemination of psychosocial digital health resources for those affected by cancer: scoping review.Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer · 2026
    Article
  17. Article
  18. Article
  19. Article
  20. Review

14 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Cecilie VarsiCenter for Shared Decision Making and Collaborative Care Research, Division of Medicine, Oslo University Hospital, Oslo, Norway.ORCID 0000-0001-5257-7993
Lise Solberg NesCenter for Shared Decision Making and Collaborative Care Research, Division of Medicine, Oslo University Hospital, Oslo, Norway.ORCID 0000-0002-9261-0871
Olöf Birna KristjansdottirCenter for Shared Decision Making and Collaborative Care Research, Division of Medicine, Oslo University Hospital, Oslo, Norway.ORCID 0000-0002-8585-5547
Saskia M KeldersCenter for eHealth and Wellbeing Research, Department of Psychology, Health and Technology, University of Twente, Enschede, Netherlands.ORCID 0000-0001-8949-6871
Una StenbergNorwegian National Advisory Unit on Learning and Mastery in Health, Oslo University Hospital, Oslo, Norway.ORCID 0000-0002-6007-8630
Heidi Andersen ZangiNational Advisory Unit on Rehabilitation in Rheumatology, Department of Rheumatology, Diakonhjemmet Hospital, Oslo, Norway.ORCID 0000-0001-6882-221X
Elin BørøsundCenter for Shared Decision Making and Collaborative Care Research, Division of Medicine, Oslo University Hospital, Oslo, Norway.ORCID 0000-0003-3897-7055
Karen Elizabeth WeissDepartment of Anesthesiology and Pain Medicine, School of Medicine, University of Washington, Seattle, WA, United States.ORCID 0000-0001-6576-0615
Audun StubhaugInstitute of Clinical Medicine, Faculty of Medicine, University of Oslo, Oslo, Norway.ORCID 0000-0002-0606-8001
Rikke Aune AsbjørnsenCenter for Shared Decision Making and Collaborative Care Research, Division of Medicine, Oslo University Hospital, Oslo, Norway.ORCID 0000-0003-4295-9298
Marianne WestengCenter for Shared Decision Making and Collaborative Care Research, Division of Medicine, Oslo University Hospital, Oslo, Norway.ORCID 0000-0003-3129-6302
Marte ØdegaardUniversity of Oslo Library, University of Oslo, Oslo, Norway.ORCID 0000-0001-9504-2219
Hilde EideCenter for Shared Decision Making and Collaborative Care Research, Division of Medicine, Oslo University Hospital, Oslo, Norway.ORCID 0000-0003-4428-5047

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThere is growing evidence of the positive effects of electronic health (eHealth) interventions for patients with chronic illness, but implementation of such interventions into practice is challenging. Implementation strategies that potentially impact implementation outcomes and implementation success have been identified. Which strategies are actually used in the implementation of eHealth interventions for patients with chronic illness and which ones are the most effective is unclear.

objectiveThis systematic realist review aimed to summarize evidence from empirical studies regarding (1) which implementation strategies are used when implementing eHealth interventions for patients with chronic illnesses living at home, (2) implementation outcomes, and (3) the relationship between implementation strategies, implementation outcomes, and degree of implementation success.

methodsA systematic literature search was performed in the electronic databases MEDLINE, Embase, PsycINFO, Scopus, Allied and Complementary Medicine Database, Cumulative Index to Nursing and Allied Health Literature, and Cochrane Library. Studies were included if they described implementation strategies used to support the integration of eHealth interventions into practice. Implementation strategies were categorized according to 9 categories defined by the Expert Recommendations for Implementing Change project: (1) engage consumers, (2) use evaluative and iterative strategies, (3) change infrastructure, (4) adapt and tailor to the context, (5) develop stakeholder interrelationships, (6) use financial strategies, (7) support clinicians, (8) provide interactive assistance, and (9) train and educate stakeholders. Implementation outcomes were extracted according to the implementation outcome framework by Proctor and colleagues: (1) acceptability, (2) adoption, (3) appropriateness, (4) cost, (5) feasibility, (6) fidelity, (7) penetration, and (8) sustainability. Implementation success was extracted according to the study authors' own evaluation of implementation success in relation to the used implementation strategies.

resultsThe implementation strategies management support and engagement, internal and external facilitation, training, and audit and feedback were directly related to implementation success in several studies. No clear relationship was found between the number of implementation strategies used and implementation success.

conclusionsThis is the first review examining implementation strategies, implementation outcomes, and implementation success of studies reporting the implementation of eHealth programs for patients with chronic illnesses living at home. The review indicates that internal and external facilitation, audit and feedback, management support, and training of clinicians are of importance for eHealth implementation. The review also points to the lack of eHealth studies that report implementation strategies in a comprehensive way and highlights the need to design robust studies focusing on implementation strategies in the future.

trial registrationPROSPERO CRD42018085539; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=85539.

Indexed as

Chronic DiseaseHealth Plan ImplementationHumansTelemedicinechronic illnesseHealthimplementationimplementation outcomesimplementation strategiesrealist review

Identifiers

PMID31573934
PMCPMC6789428

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.