Evidence map›Paper›PMID 30656517›Full record

ArticleThe journal of primary prevention2019

Redesigning Implementation Measurement for Monitoring and Quality Improvement in Community Delivery Settings.

Cady Berkel, Carlos G Gallo, Irwin N Sandler, Anne M Mauricio, Justin D Smith, C Hendricks Brown

Abstract read
In one paragraph

Article in The journal of primary prevention, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed.

  1. Article
  2. Implementation of an Arts at Home program for people living with dementia: Learnings from key stakeholders.Health promotion journal of Australia : official journal of Australian Association of Health Promotion Professionals · 2025
    Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Three Flavorings for a Soup to Cure what Ails Mental Health Services.Administration and policy in mental health · 2020
    Article
  11. Article
  12. Article
  13. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Cady Berkel, 900 S McAllister Ave., Tempe, AZ, 85287, USA. Cady.Berkel@asu.edu.ORCID 0000-0001-9664-9485
Carlos G GalloCenter for Prevention Implementation Methodology (Ce-PIM), Northwestern University, Chicago, IL, USA.
Irwin N SandlerREACH Institute, Department of Psychology, Arizona State University, Tempe, AZ, USA.
Anne M MauricioREACH Institute, Department of Psychology, Arizona State University, Tempe, AZ, USA.
Justin D SmithCenter for Prevention Implementation Methodology (Ce-PIM), Northwestern University, Chicago, IL, USA.
C Hendricks BrownCenter for Prevention Implementation Methodology (Ce-PIM), Northwestern University, Chicago, IL, USA.

Funding

INNOVATIVE IMPLEMENTATION RESEARCH METHODS COREP30DA027828 · NIDA · UNIVERSITY OF MIAMI SCHOOL OF MEDICINE · PI BROWN, C. HENDRICKS, MUSTANSKI, BRIAN · 2011 to 2020
$11.4M
Multi-Court Trial of NBP to Prevent Substance Abuse and Mental Health DisorderR01DA026874 · NIDA · ARIZONA STATE UNIVERSITY-TEMPE CAMPUS · PI SANDLER, IRWIN N. · 2011 to 2015
$6.0M
An Individually Tailored, Family-Centered Intervention for Childhood Obesity: Connecting Services in Pediatric Primary Healthcare, the Home, and the CommunityU18DP006255 · DP · ARIZONA STATE UNIVERSITY-TEMPE CAMPUS · PI BERKEL, CADY, SMITH, JUSTIN D · 2016 to 2017
$3.8M
Implementation of Evidence-Based Preventive Parenting ProgramsR01DA033991 · NIDA · ARIZONA STATE UNIVERSITY-TEMPE CAMPUS · PI BERKEL, CADY, MAURICIO, ANNE MARIE · 2013 to 2017
$2.7M
NCCDPHP CDC HHS U18 DP006255NIDA NIH HHS P30 DA027828NIDA NIH HHS R01 DA026874NIDA NIH HHS R01 DA033991
6 · The paper itself

Abstract

The field of prevention has established the potential to promote child adjustment across a wide array of outcomes. However, when evidence-based prevention programs have been delivered at scale in community settings, declines in implementation and outcomes have resulted. Maintaining high quality implementation is a critical challenge for the field. We describe steps towards the development of a practical system to monitor and support the high-quality implementation of evidence-based prevention programs in community settings. Research on the implementation of an evidence-based parenting program for divorcing families called the "New Beginnings Program" serves as an illustration of the promise of such a system. As a first step, we describe a multidimensional theoretical model of implementation that links aspects of program delivery with improvements in participant outcomes. We then describe research on the measurement of each of these implementation dimensions and test their relations to intended program outcomes. As a third step, we develop approaches to the assessment of these implementation constructs that are feasible to use in community settings and to establish their reliability and validity. We focus on the application of machine learning algorithms and web-based data collection systems to assess implementation and provide support for high quality delivery and positive outcomes. Examples are presented to demonstrate that valid and reliable measures can be collected using these methods. Finally, we envision how these measures can be used to develop an unobtrusive system to monitor implementation and provide feedback and support in real time to maintain high quality implementation and program outcomes.

Indexed as

DivorceImplementation ScienceParent-Child RelationsQuality ImprovementAdolescentAdultChildCurriculumData CollectionEvidence-Based PracticeFemaleHumansMachine LearningMaleModels, TheoreticalProgram EvaluationEvidence-based programsImplementationMeasurementParentingPragmatic measuresTechnology

Identifiers

PMID30656517
PMCPMC6404547

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.