Evidence map›Paper›PMID 37932840›Full record

ArticleImplementation science communications2023

Evaluation of a brief virtual implementation science training program: the Penn Implementation Science Institute.

Amelia E Van Pelt, Christopher P Bonafide, Katharine A Rendle, Courtney Wolk, Judy A Shea, Amanda Bettencourt, Rinad S Beidas, Meghan B Lane-Fall

Abstract read
In one paragraph

Article in Implementation science communications, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Amelia E Van PeltDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, 625 N Michigan Ave Suite 2100, Chicago, IL, 60611, USA. amelia.vanpelt@northwestern.edu.ORCID http://orcid.org/0000-0002-5671-7479
Christopher P BonafidePenn Implementation Science Center at the Leonard Davis Institute for Health Economics, University of Pennsylvania, 3641 Locust Walk, Philadelphia, PA, 19104, USA.
Katharine A RendlePenn Implementation Science Center at the Leonard Davis Institute for Health Economics, University of Pennsylvania, 3641 Locust Walk, Philadelphia, PA, 19104, USA.
Courtney WolkPenn Implementation Science Center at the Leonard Davis Institute for Health Economics, University of Pennsylvania, 3641 Locust Walk, Philadelphia, PA, 19104, USA.
Judy A SheaDepartment of Medicine, Division of General Internal Medicine, University of Pennsylvania Perelman School of Medicine, 423 Guardian Drive, Philadelphia, PA, 19104, USA.
Amanda BettencourtPenn Implementation Science Center at the Leonard Davis Institute for Health Economics, University of Pennsylvania, 3641 Locust Walk, Philadelphia, PA, 19104, USA.
Rinad S Beidas *Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, 625 N Michigan Ave Suite 2100, Chicago, IL, 60611, USA.
Meghan B Lane-Fall *Penn Implementation Science Center at the Leonard Davis Institute for Health Economics, University of Pennsylvania, 3641 Locust Walk, Philadelphia, PA, 19104, USA.

Funding

Research ProgramP50CA244690 · NCI · UNIVERSITY OF PENNSYLVANIA · PI BEIDAS, RINAD SARY · 2020 to 2024
$4.9M
NCI NIH HHS P50 CA244690NIH HHS P30 045088
6 · The paper itself

Abstract

backgroundTo meet the growing demand for implementation science expertise, building capacity is a priority. Various training opportunities have emerged to meet this need. To ensure rigor and achievement of specific implementation science competencies, it is critical to systematically evaluate training programs.

methodsThe Penn Implementation Science Institute (PennISI) offers 4 days (20 h) of virtual synchronous training on foundational and advanced topics in implementation science. Through a pre-post design, this study evaluated the sixth PennISI, delivered in 2022. Surveys measures included 43 implementation science training evaluation competencies grouped into four thematic domains (e.g., items related to implementation science study design grouped into the "design, background, and rationale" competency category), course-specific evaluation criteria, and open-ended questions to evaluate change in knowledge and suggestions for improving future institutes. Mean composite scores were created for each of the competency themes. Descriptive statistics and thematic analysis were completed.

resultsOne hundred four (95.41% response rate) and 55 (50.46% response rate) participants completed the pre-survey and post-survey, respectively. Participants included a diverse cohort of individuals primarily affiliated with US-based academic institutions and self-reported as having novice or beginner-level knowledge of implementation science at baseline (81.73%). In the pre-survey, all mean composite scores for implementation science competencies were below one (i.e., beginner-level). Participants reported high value from the PennISI across standard course evaluation criteria (e.g., mean score of 3.77/4.00 for overall quality of course). Scores for all competency domains increased to a score between beginner-level and intermediate-level following training. In both the pre-survey and post-survey, competencies related to "definition, background, and rationale" had the highest mean composite score, whereas competencies related to "design and analysis" received the lowest score. Qualitative themes offered impressions of the PennISI, didactic content, PennISI structure, and suggestions for improvement. Prior experience with or knowledge of implementation science influenced many themes.

conclusionsThis evaluation highlights the strengths of an established implementation science institute, which can serve as a model for brief, virtual training programs. Findings provide insight for improving future program efforts to meet the needs of the heterogenous implementation science community (e.g., different disciplines and levels of implementation science knowledge). This study contributes to ensuring rigorous implementation science capacity building through the evaluation of programs.

Indexed as

Capacity buildingEducationEvaluationImplementation scienceTraining

Identifiers

PMID37932840
PMCPMC10626776

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.