Evidence map›Paper›PMID 32611414›Full record

ArticleImplementation science : IS2020

Characterizing evolving frameworks: issues from Esmail et al. (2020) review.

Russell E Glasgow, Paul A Estabrooks, Marcia G Ory

Abstract readLetterComment
In one paragraph

Article in Implementation science : IS, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Improving parenting skill through the strong families program in Thailand.Archives of public health = Archives belges de sante publique · 2025
    Article
  5. Article
  6. The snapshot audit methodology: design, implementation and analysis of prospective observational cohort studies in surgery.European journal of trauma and emergency surgery : official publication of the European Trauma Society · 2023
    Review
  7. Article
  8. Article
  9. Review
  10. Understanding and applying the RE-AIM framework: Clarifications and resources.Journal of clinical and translational science · 2021
    Article
  11. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

3 authors.

Russell E GlasgowFamily Medicine, University of Colorado School of Medicine, 13199 E. Montview Blvd, Aurora, CO, 80045, USA. russell.glasgow@cuanschutz.edu.ORCID 0000-0003-4218-3231
Paul A EstabrooksCollege of Public Health,Department of Health Promotion, University of Nebraska Medical Center, 986075 Nebraska Medical Center, Omaha, NE, 68198-6075, USA.
Marcia G OryEnvironmental and Occupational Health, School of Public Health, Texas A&M University, SPH Administration Building, 212 Adriance Lab Rd., TAMU Bldg #1518 | TAMU MS 1266, College Station, TX, 77843, USA.

Funding

Pragmatic Implementation Science Approaches to Assess and Enhance Value of Cancer Prevention and Control in Rural Primary CareP50CA244688 · NCI · UNIVERSITY OF COLORADO DENVER · PI GLASGOW, RUSSELL E · 2019 to 2023
$4.9M
NCI NIH HHS 1P50CA244688-01NCI NIH HHS P50 CA244688
6 · The paper itself

Abstract

There are complex issues in understanding and categorizing implementation science theories, models, and frameworks. Systematic reviews of these models are important undertakings for synthesizing current knowledge. The issues involved are even more challenging when reviewing a large number of frameworks and when some of the frameworks have evolved significantly over time. This paper addresses how the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework was described in the recent Esmail (2020) review and identifies four mischaracterizations. This is followed by a more general discussion of how advances or extensions of frameworks after an original source publication or influential review tend to be overlooked. We discuss why inadvertent mischaracterization of what a framework is and is not, and what it can and cannot be used for, can have deleterious consequences. Finally, we suggest initial ideas about what could be done to prevent or alleviate some of these problems by reviewers, framework developers, and scholars at large.

Indexed as

Implementation ScienceTranslational Research, BiomedicalClassificationImplementation science frameworkRE-AIMReview

Identifiers

PMID32611414
PMCPMC7331253

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.