ArticleImplementation science : IS2019
The clinician crowdsourcing challenge: using participatory design to seed implementation strategies.
Article in Implementation science : IS, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
21 citing papers in PubMed.
- Results from a cluster-randomized, stepped-wedge trial testing a deliberative engagement intervention to increase guideline adherence among U.S. oral health providers.Scientific reports · 2025Trial
- Participatory approaches for tailoring implementation strategies in healthcare settings: a scoping review of contemporary literature (2019-2024).Implementation science communications · 2026Review
- Application of Innovation Tournament methodology to inform de-implementation strategies: lessons learned in addressing mammography overscreening in older women.Implementation science communications · 2026Article
- Crowdsourcing Ideas for the Implementation of Long-Acting Injectable PrEP among Sexual Minority Men in Chicago through an Innovation Tournament.Implementation science communications · 2025Article
- Co-designing strategies to implement long-acting injectable PrEP for sexual minority men in Chicago: a study protocol for an innovation tournament and implementation mapping.Implementation science communications · 2024Article
- Therapist perceptions of experiential training for exposure therapy.Behavioural and cognitive psychotherapy · 2023Article
- Crowdsourcing to support training for public health: A scoping review.PLOS global public health · 2023Article
- Comparing output from two methods of participatory design for developing implementation strategies: traditional contextual inquiry vs. rapid crowd sourcing.Implementation science : IS · 2022Article
- Making Progress Monitoring Easier and More Motivating: Developing a Client Data Collection App Incorporating User-Centered Design and Behavioral Economics Insights.Social sciences (Basel, Switzerland) · 2022Article
- Co-designing implementation strategies for the WALK-Cph intervention in Denmark aimed at increasing mobility in acutely hospitalized older patients: a qualitative analysis of selected strategies and their justifications.BMC health services research · 2022Article
- Understanding the Role of Clinical Champions and Their Impact on Clinician Behavior Change: The Need for Causal Pathway Mechanisms.Frontiers in health services · 2022Article
- Moving from Implementation Science to Implementation Practice: The Need to Solve Practical Problems to Improve Behavioral Health Services.The journal of behavioral health services & research · 2022Article
- A pilot study of participatory and rapid implementation approaches to increase depression screening in primary care.BMC family practice · 2021Article
- Topical Review: Crowdsourcing as a Novel Approach to Qualitative Research.Journal of pediatric psychology · 2021Article
- Community stakeholder preferences for evidence-based practice implementation strategies in behavioral health: a best-worst scaling choice experiment.BMC psychiatry · 2021Article
- Applying NUDGE to Inform Design of EBP Implementation Strategies in Community Mental Health Settings.Administration and policy in mental health · 2021Article
- Fathers of Children With Congenital Heart Disease: Sources of Stress and Opportunities for Intervention.Pediatric critical care medicine : a journal of the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies · 2020Article
- Disseminating for Equity and Justice: Findings From the LIGHT Global Crowdsourcing Open Contest to Reimagine Public Health.Journal of public health management and practice : JPHMPArticle
- Review
- Amplifying consumers as partners in dissemination and implementation science and practice.Implementation research and practiceArticle
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
10 authors.
Funding
Abstract
backgroundIn healthcare settings, system and organization leaders often control the selection and design of implementation strategies even though frontline workers may have the most intimate understanding of the care delivery process, and factors that optimize and constrain evidence-based practice implementation within the local system. Innovation tournaments, a structured participatory design strategy to crowdsource ideas, are a promising approach to participatory design that may increase the effectiveness of implementation strategies by involving end users (i.e., clinicians). We utilized a system-wide innovation tournament to garner ideas from clinicians about how to enhance the use of evidence-based practices (EBPs) within a large public behavioral health system.
methodsOur innovation tournament occurred in three phases. First, we invited over 500 clinicians to share, through a web-based platform, their ideas regarding how their organizations could best support use of EBPs. Clinicians could rate and comment on ideas submitted by others. Second, submissions were judged by an expert panel (including behavioral scientists, system leaders, and payers) based on their rated enthusiasm for the idea. Third, we held a community-facing event during which the six clinicians who submitted winning ideas presented their strategies to 85 attendees representing a cross-section of clinicians and system and organizational leaders.
resultsWe had a high rate of participation (12.3%), more than double the average rate of previous tournaments conducted in other settings (5%). A total of 65 ideas were submitted by 55 participants representing 38 organizations. The most common categories of ideas pertained to training (42%), financing and compensation (26%), clinician support and preparation tools (22%), and EBP-focused supervision (17%). The expert panel and clinicians differed on their ratings of the ideas, highlighting value of seeking input from multiple stakeholder groups when developing implementation strategies.
conclusionsInnovation tournaments are a useful and feasible methodology for engaging end users, system leaders, and behavioral scientists through a structured approach to developing implementation strategies. The process and resultant strategies engendered significant enthusiasm and engagement from participants at all levels of a healthcare system. Research is needed to compare the effectiveness of strategies developed through innovation tournaments to strategies developed through design approaches.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.