Evidence map›Paper›PMID 35768105›Full record

ReviewBMJ open2022

The relationship between the living lab approach and successful implementation of healthcare innovations: an integrative review.

Nina Zipfel, Bedra Horreh, Carel T J Hulshof, Angela G E M de Boer, Sylvia J van der Burg-Vermeulen

Abstract readReview
In one paragraph

Review in BMJ open, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 31 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
31citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

31 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Trial
  4. Article
  5. Article
  6. Article
  7. AI-enabled Living Labs: Accelerating innovation in multiple sclerosis care and research.Multiple sclerosis (Houndmills, Basingstoke, England) · 2026
    Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Engagement of People With Lived Experience in Spinal Cord Injury to Address Innovation Priorities.Health expectations : an international journal of public participation in health care and health policy · 2025
    Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Nina ZipfelDepartment of Public and Occupational Health, Coronel Institute of Occupational Health, Amsterdam Public Health Research Institute, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands n.zipfel@amsterdamumc.nl.ORCID 0000-0003-4125-6726
Bedra HorrehDepartment of Public and Occupational Health, Coronel Institute of Occupational Health, Amsterdam Public Health Research Institute, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands.
Carel T J HulshofDepartment of Public and Occupational Health, Coronel Institute of Occupational Health, Amsterdam Public Health Research Institute, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands.
Angela G E M de BoerDepartment of Public and Occupational Health, Coronel Institute of Occupational Health, Amsterdam Public Health Research Institute, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands.
Sylvia J van der Burg-VermeulenDepartment of Public and Occupational Health, Coronel Institute of Occupational Health, Amsterdam Public Health Research Institute, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesThe concept of living labs as a research method to enhance participation of end-users in the development and implementation process of an innovation, gained increasing attention over the past decade. A living lab can be characterised by five key components: user-centric, cocreation, real-life context, test innovation and open innovation. The purpose of this integrative literature review was to summarise the literature on the relationship between the living lab approach and successful implementation of healthcare innovations.

methodsAn integrative literature review searching PubMed, EMBASE, PsycINFO and Cinahl databases between January 2000 and December 2019. Studies were included when a living lab approach was used to implement innovations in healthcare and implementation outcomes were reported. Included studies evaluated at least one of the following implementation outcomes: acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, penetration or sustainability. Quality was assessed based on a tool developed by Hawker

resultsOf the 1173 retrieved articles, 30 studies were included of which 11 of high quality. Most studies involved a combination of patients/public (N=23) and providers (N=17) as key stakeholders in the living lab approach. Living lab components were mostly applied in the development phase of innovations (N=21). The majority of studies reported on achievement of acceptability (N=22) and feasibility (N=17) in terms of implementation outcomes. A broader spectrum of implementation outcomes was only evaluated in one study. We found that in particular six success factors were mentioned for the added-value of using living lab components for healthcare innovations: leadership, involvement, timing, openness, organisational support and ownership.

conclusionsThe living lab approach showed to contribute to successful implementation outcomes. This integrative review suggests that using a living lab approach fosters collaboration and participation in the development and implementation of new healthcare innovations. PROSPERO REGISTRATION NUMBER: CRD42020166895.

Indexed as

Delivery of Health CareHealth FacilitiesHumansLeadershipResearch Designchange managementpublic healthquality in health care

Identifiers

PMID35768105
PMCPMC9240880

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.