Evidence map›Paper›PMID 39930503›Full record

Trial reportImplementation science : IS2025

Outcomes of the ROSE Sustainment (ROSES) Study, a sequential multiple assignment randomized implementation trial to determine the minimum necessary intervention to sustain a postpartum depression prevention program in agencies serving low-income pregnant people.

Jennifer E Johnson, Shannon Wiltsey-Stirman, Alla Sikorskii, Ted Miller, Ellen Poleshuck, Tiffany A Moore Simas, Laura Carravallah, Raven Miller, Caron Zlotnick

Registry-linked trialAbstract readRandomized Controlled Trial
In one paragraph

Trial report in Implementation science : IS, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT03267563 (Implementing to Sustain), which is not on this map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03267563 nacompletednot on this map

Implementing to Sustain: Determining the Minimum Necessary Intervention to Maintain a Postpartum Depression Prevention Program (ROSE) in Clinics Providing Prenatal Services to Low-income Women

TypeinterventionalSponsorMichigan State UniversityRan2018 to 2023Enrolled160ConditionsDepression, PostpartumArmsEIAU, LICF, HICF
3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Trial
  2. Implementation science aims to improve healthcare by validating effective interventions.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Jennifer E JohnsonCharles Stewart Mott Department of Public Health, Michigan State University, 200 East 1st St Room 366, Flint, MI, 48502, USA. JJohns@msu.edu.ORCID 0000-0003-2540-7213
Shannon Wiltsey-StirmanNational Center for PTSD, Department of Psychiatry and Behavioral Sciences, Dissemination and Training Division and Stanford University, 795 Willow Road (NC-PTSD 334), Menlo Park, CA, 94025, USA.
Alla SikorskiiDepartment of Psychiatry, Michigan State University, 909 Wilson Rd Room 321, East Lansing, MI, 48824, USA.
Ted MillerPacific Institute for Research and Evaluation, 11720 Beltsville Drive Suite 900, Calverton, New York, MD, 20705, USA.
Ellen PoleshuckUniversity of Rochester Medical Center, 601 Elmwood Ave, Box PSYCH, Rochester, NY, 14642, USA.
Tiffany A Moore SimasUniversity of Massachusetts Chan Medical School/UMass Memorial Health, Memorial Campus, - 119 Belmont Street - Jaquith 2.060, Worcester, MA, 01605, USA.
Laura CarravallahDepartment of Pediatrics and Human Development, Michigan State University, Life Sciences, Bldg, 1355 Bogue St., Rm 240, East Lansing, MI, 48824, USA.
Raven MillerCharles Stewart Mott Department of Public Health, Michigan State University, 200 East 1st St Room 372, Flint, MI, 48502, USA.
Caron ZlotnickButler Hospital and Brown University, 345 Blackstone Blvd, Providence, RI, 02906, USA.

Funding

The ROSE Scale-Up Study: Informing a decision about ROSE as universal postpartum depression preventionR01MH130948 · NIMH · MICHIGAN STATE UNIVERSITY · PI JENNIFER E JOHNSON, CARON ZLOTNICK · 2022 to 2026
$6.2M
Implementing to sustain: Determining the minimum necessary intervention to maintain a postpartum depression prevention program (ROSE) in clinics providing prenatal services to low-income womenR01MH114883 · NIMH · MICHIGAN STATE UNIVERSITY · PI JOHNSON, JENNIFER E, ZLOTNICK, CARON · 2018 to 2022
$3.6M
NIMH NIH HHS R01 MH114883NIMH NIH HHS R01 MH130948
6 · The paper itself

Abstract

backgroundThis Sequential Multiple Assignment Randomized Trial (SMART) was conducted to determine minimum implementation support needed for agencies serving pregnant people on public assistance to adopt and sustain the ROSE (Reach Out, Stay Strong, Essentials for mothers of newborns) postpartum depression (PPD) prevention program.

methodsEnrolled prenatal agencies (N=98) received thorough initial implementation support (initial training + written sustainment planning). Agencies were identified as at risk for non-sustainment within the first 15 months (N=56) were randomized to: (1) no additional implementation support (N=12), or (2) quarterly implementation support (coaching and feedback; N=44). If agencies receiving quarterly implementation supports were still at risk and within the first 15 months (N=29), they were randomized to: (1) continued quarterly support (N=14), or (2) monthly implementation support (N=15). No implementation support occurred after 18 months. Follow-ups occurred quarterly and then at 18, 24, and 30 months. Outcomes included sustainment of core program elements, agency PPD rates, reach, and costs/cost-effectiveness of each sustainment step.

resultsTwice as many agencies as expected (41 of 98; 42%) delivered ROSE with fidelity for 15+ months after receiving thorough initial implementation support only. For agencies at risk for non-sustainment, no effects of adding quarterly implementation supports were observed. However, adding monthly supports (versus quarterly) for agencies still at risk resulted in higher monthly percent of core ROSE elements sustained and more months ROSE was sustained with fidelity with large (Cohen's d = 0.73 and 0.80) effect sizes, and improved reach over 30 months. Many agencies did not consistently collect PPD rates, making results difficult to interpret. Mean implementation costs (including implementation support and agency staff time) per agency were $1,849 (SD $1,429) for agencies receiving initial implementation support only, $2,699 (SD $1,837) for those receiving initial and quarterly implementation support, and $4,059 (SD $1,763) for those receiving initial, quarterly, and ultimately monthly implementation support.

conclusionsThe cost of agency-wide ROSE implementation is far less than the cost of a single untreated case of PPD ($33,484). We suggest implementing ROSE through thorough training and written sustainment planning. For agencies not sustaining, adding monthly support can promote sustainment and improve reach.

trial registrationRegistered June 14, 2018 at clinicaltrials.gov, NCT03267563 ( https://clinicaltrials.gov/study/NCT03267563 ).

Indexed as

Depression, PostpartumPovertyAdultFemaleHumansImplementation SciencePregnancyProgram EvaluationCost-effectivenessImplementationPostpartum depressionPrenatal carePreventionPublic assistanceSustainment

Identifiers

PMID39930503
PMCPMC11812186

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.