Evidence map›Paper›PMID 35854367›Full record

ArticleImplementation science : IS2022

Comparing output from two methods of participatory design for developing implementation strategies: traditional contextual inquiry vs. rapid crowd sourcing.

Emily M Becker-Haimes, Brinda Ramesh, Jacqueline E Buck, Heather J Nuske, Kelly A Zentgraf, Rebecca E Stewart, Alison Buttenheim, David S Mandell

Abstract read
In one paragraph

Article in Implementation science : IS, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Trial
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Emily M Becker-HaimesDepartment of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3rd floor, Philadelphia, PA, 19104, USA. Emily.haimes@pennmedicine.upenn.edu.ORCID 0000-0002-9922-8667
Brinda RameshDepartment of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3rd floor, Philadelphia, PA, 19104, USA.
Jacqueline E BuckDepartment of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3rd floor, Philadelphia, PA, 19104, USA.
Heather J NuskeDepartment of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3rd floor, Philadelphia, PA, 19104, USA.
Kelly A ZentgrafDepartment of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3rd floor, Philadelphia, PA, 19104, USA.
Rebecca E StewartDepartment of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3rd floor, Philadelphia, PA, 19104, USA.
Alison ButtenheimDepartment of Family and Community Health, School of Nursing, University of Pennsylvania, Philadelphia, PA, USA.
David S MandellDepartment of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3rd floor, Philadelphia, PA, 19104, USA.

Funding

Transforming mental health delivery through behavioral economics and implementation scienceP50MH113840 · NIMH · UNIVERSITY OF PENNSYLVANIA · PI MANDELL, DAVID S · 2017 to 2020
$6.6M
Increasing the uptake of medication-assisted treatment for opioid use disorderK23DA048167 · NIDA · UNIVERSITY OF PENNSYLVANIA · PI STEWART, REBECCA E · 2019 to 2023
$975k
Reducing Challenging Behaviors In Children With Autism Through Digital HealthK01MH120509 · NIMH · UNIVERSITY OF PENNSYLVANIA · PI NUSKE, HEATHER J · 2020 to 2024
$773k
NIDA NIH HHS K23 DA 048167NIDA NIH HHS K23 DA048167NIMH NIH HHS K01 MH120509NIMH NIH HHS P50113840
6 · The paper itself

Abstract

backgroundParticipatory design methods are a key component of designing tailored implementation strategies. These methods vary in the resources required to execute and analyze their outputs. No work to date has examined the extent to which the output obtained from different approaches to participatory design varies.

methodsWe concurrently used two separate participatory design methods: (1) field observations and qualitative interviews (i.e., traditional contextual inquiry) and (2) rapid crowd sourcing (an innovation tournament). Our goal was to generate and compare information to tailor implementation strategies to increase the use of evidence-based data collection practices among one-to-one aides working with children with autism. Each method was executed and analyzed by study team members blinded to the output of the other method. We estimated the personnel time and monetary costs associated with each method to further facilitate comparison.

resultsObservations and interviews generated nearly double the number of implementation strategies (n = 26) than did the innovation tournament (n = 14). When strategies were classified into implementation strategies from the Expert Recommendations for Implementing Change (ERIC) taxonomy, there was considerable overlap in the content of identified strategies. However, strategies derived from observations and interviews were more specific than those from the innovation tournament. Five strategies (13%) reflected content unique to observations and interviews and 3 (8%) strategies were unique to the innovation tournament. Only observations and interviews identified implementation strategies related to adapting and tailoring to context; only the innovation tournament identified implementation strategies that used incentives. Observations and interviews required more than three times the personnel hours than the innovation tournament, but the innovation tournament was more costly overall due to the technological platform used.

conclusionsThere was substantial overlap in content derived from observations and interviews and the innovation tournament, although there was greater specificity in the findings from observations and interviews. However, the innovation tournament yielded unique information. To select the best participatory design approach to inform implementation strategy design for a particular context, researchers should carefully consider unique advantages of each method and weigh the resources available to invest in the process.

Indexed as

CrowdsourcingChildData CollectionHumansResearch DesignResearch PersonnelEvidence-based practiceImplementation scienceImplementation strategy designParticipatory design

Identifiers

PMID35854367
PMCPMC9295107

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.