Evidence map›Paper›PMID 36925901›Full record

ArticleFrontiers in health services2022

Tracking dynamic changes in implementation strategies over time within a hybrid type 2 trial of an electronic patient-reported oncology symptom and needs monitoring program.

Justin D Smith, James L Merle, Kimberly A Webster, September Cahue, Frank J Penedo, Sofia F Garcia

Registry-linked trialOpen access · diamondFull text read
In one paragraph

Article in Frontiers in health services, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT04014751 (Expansion, Implementation & Evaluation of Electronic Health Record), which is not on this map. Cited by 22 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed, 4 pooled it
6.7field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04014751 completednot on this map

Expansion, Implementation & Evaluation of Electronic Health Record (EHR)-Integrated Patient-Reported Symptom Screening in a Multi-Site Cancer Center

TypeobservationalSponsorNorthwestern UniversityRan2019 to 2022Enrolled1,166ConditionsCancerArmsSymptom Monitoring Intervention
3 · Its place in the literature

Who cites it

22 citing papers in PubMed, 4 syntheses or guidelines pooled it, 29 citations in OpenAlex.

  1. Tailored interventions to address determinants of practice.The Cochrane database of systematic reviews · 2026
    Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Trial
  6. Trial
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 3 institutions in 1 country.

Justin D SmithDepartment of Population Health Sciences, Spencer Fox Eccles School of Medicine, University of Utah, Salt Lake City, UT, United States.
James L MerleDepartment of Population Health Sciences, Spencer Fox Eccles School of Medicine, University of Utah, Salt Lake City, UT, United States.
Kimberly A WebsterDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States.
September CahueDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States.
Frank J PenedoDepartments of Psychology and Medicine, University of Miami, Coral Gables, FL, United States.
Sofia F GarciaDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States.
Northwestern University · USUniversity of Utah · USSylvester Comprehensive Cancer Center · US

Funding

Utah Center for Clinical and Translational ScienceUL1TR002538 · NCATS · UNIVERSITY OF UTAH · PI HESS, RACHEL, MAJERSIK, JENNIFER JUHL · 2018 to 2022
$26.0M
UNIVERSITY OF UTAH MEDICAL INFORMATICS TRAININGT15LM007124 · NLM · UTAH STATE HIGHER EDUCATION SYSTEM--UNIVERSITY OF UTAH · PI Karen Louise Eilbeck · 1997 to 2026
$22.0M
NCATS NIH HHS UL1 TR002538NLM NIH HHS T15 LM007124
6 · The paper itself

Abstract

Background: Longitudinal tracking of implementation strategies is critical in accurately reporting when and why they are used, for promoting rigor and reproducibility in implementation research, and could facilitate generalizable knowledge if similar methods are used across research projects. This article focuses on tracking dynamic changes in the use of implementation strategies over time within a hybrid type 2 effectiveness-implementation trial of an evidence-based electronic patient-reported oncology symptom assessment for cancer patient-reported outcomes in a single large healthcare system. Methods: The Longitudinal Implementation Strategies Tracking System (LISTS), a timeline follow-back procedure for documenting strategy use and modifications, was applied to the multiyear study. The research team used observation, study records, and reports from implementers to complete LISTS in an electronic data entry system. Types of modifications and reasons were categorized. Determinants associated with each strategy were collected as a justification for strategy use and a potential explanation for strategy modifications. Results: Thirty-four discrete implementation strategies were used and at least one strategy was used from each of the nine strategy categories from the Expert Recommendations for Implementing Change (ERIC) taxonomy. Most of the strategies were introduced, used, and continued or discontinued according to a prospective implementation plan. Relatedly, a small number of strategies were introduced, the majority unplanned, because of the changing healthcare landscape, or to address an emergent barrier. Despite changing implementation context, there were relatively few modifications to the way strategies were enacted, such as a change in the actor, action, or dose. Few differences were noted between the trial's three regional units under investigation. Conclusion: This study occurred within the ambulatory oncology clinics of a large, academic medical center and was supported by the Quality team of the health system to ensure greater uptake, uniformity, and implementation within established practice change processes. The centralized nature of the implementation likely contributed to the relatively low proportion of modified strategies and the high degree of uniformity across regions. These results demonstrate the potential of LISTS in gathering the level of data needed to understand the impact of the many implementation strategies used to support adoption and delivery of a multilevel innovation. Clinical trial registration: https://clinicaltrials.gov/ct2/show/NCT04014751, identifier: NCT04014751.

Indexed as

adaptationscancer symptom screeningimplementation strategiesmodificationstracking system

Identifiers

PMID36925901
PMCPMC10012686
OpenAlexW4307855428

What OpenQuestion holds

Textfull text, public
LicenceCC BY
measurements read15
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.