Evidence map›Paper›PMID 35135566›Full record

ArticleImplementation science : IS2022

Six practical recommendations for improved implementation outcomes reporting.

Rebecca Lengnick-Hall, Donald R Gerke, Enola K Proctor, Alicia C Bunger, Rebecca J Phillips, Jared K Martin, Julia C Swanson

Abstract read
In one paragraph

Article in Implementation science : IS, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 42 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
42citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

42 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Trial
  6. Trial
  7. Trial
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Rebecca Lengnick-HallThe Brown School, Washington University in St. Louis, St. Louis, USA. rlengnick-hall@wustl.edu.ORCID 0000-0002-7900-0585
Donald R GerkeGraduate School of Social Work, University of Denver, Denver, CO, USA.
Enola K ProctorShanti Khinduka Distinguished Professor Emerita, The Brown School, Washington University in St. Louis, St. Louis, USA.
Alicia C BungerCollege of Social Work, The Ohio State University, Columbus, OH, USA.
Rebecca J PhillipsCollege of Social Work, The Ohio State University, Columbus, OH, USA.
Jared K MartinCollege of Education & Human Ecology, The Ohio State University, Columbus, OH, USA.
Julia C SwansonThe Brown School, Washington University in St. Louis, St. Louis, USA.

Funding

GWB MENTAL HEALTH SERVICE RESEARCH TRAININGT32MH019960 · NIMH · WASHINGTON UNIVERSITY · PI Leopoldo J Cabassa, Byron James Powell · 1995 to 2026
$11.1M
IMPLEMENTATION RESEARCH INSTITUTE FOR MENTAL HEALTH SERVICES IRI-MHSR25MH080916 · NIMH · WASHINGTON UNIVERSITY · PI Byron James Powell · 2009 to 2026
$3.7M
NIMH NIH HHS R25 MH080916NIMH NIH HHS T32MH019960
6 · The paper itself

Abstract

backgroundImplementation outcomes research spans an exciting mix of fields, disciplines, and geographical space. Although the number of studies that cite the 2011 taxonomy has expanded considerably, the problem of harmony in describing outcomes persists. This paper revisits that problem by focusing on the clarity of reporting outcomes in studies that examine them. Published recommendations for improved reporting and specification have proven to be an important step in enhancing the rigor of implementation research. We articulate reporting problems in the current implementation outcomes literature and describe six practical recommendations that address them. RECOMMENDATIONS: Our first recommendation is to clearly state each implementation outcome and provide a definition that the study will consistently use. This includes providing an explanation if using the taxonomy in a new way or merging terms. Our second recommendation is to specify how each implementation outcome will be analyzed relative to other constructs. Our third recommendation is to specify "the thing" that each implementation outcome will be measured in relation to. This is especially important if you are concurrently studying interventions and strategies, or if you are studying interventions and strategies that have multiple components. Our fourth recommendation is to report who will provide data and the level at which data will be collected for each implementation outcome, and to report what kind of data will be collected and used to assess each implementation outcome. Our fifth recommendation is to state the number of time points and frequency at which each outcome will be measured. Our sixth recommendation is to state the unit of observation and the level of analysis for each implementation outcome.

conclusionThis paper advances implementation outcomes research in two ways. First, we illustrate elements of the 2011 research agenda with concrete examples drawn from a wide swath of current literature. Second, we provide six pragmatic recommendations for improved reporting. These recommendations are accompanied by an audit worksheet and a list of exemplar articles that researchers can use when designing, conducting, and assessing implementation outcomes studies.

Indexed as

Outcome Assessment, Health CareHumansAcceptabilityAdoptionAppropriatenessFeasibilityFidelityImplementation costImplementation outcomePenetrationSustainability

Identifiers

PMID35135566
PMCPMC8822722

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.