Evidence map›Paper›PMID 41364911›Full record

Trial reportJMIR formative research2025

Proactively Delivered Digital Mental Health Support for Health Care Workers: Usability and Acceptability Evaluation.

Lauren Southwick, Rachel Gonzales, Lisa Bellini, David A Asch, Nandita Mitra, Mohan Balachandran, Courtney Benjamin Wolk, Emily M Becker-Haimes, Rachel Kishton, Sarah Beck and 2 more

Registry-linked trialAbstract readRandomized Controlled Trial
In one paragraph

Trial report in JMIR formative research, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT05028075 (Evaluating the Effectiveness of an Enhanced Digital Mental Health Care Delivery System), which is not on this map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05028075 nacompletednot on this map

Evaluating the Effectiveness of an Enhanced Digital Mental Health Care Delivery System

TypeinterventionalSponsorUniversity of PennsylvaniaRan2021 to 2023Enrolled1,275ConditionsDepressive Symptoms, Anxiety, Well-BeingArmsCobalt +
3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Lauren SouthwickDepartment of Emergency Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States.ORCID 0000-0001-5290-9759
Rachel GonzalesDepartment of Emergency Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States.ORCID 0000-0002-1977-0772
Lisa BelliniDepartment of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States.ORCID 0000-0003-0985-2384
David A AschDepartment of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States.ORCID 0000-0002-7970-286X
Nandita MitraDepartment of Biostatistics, Epidemiology, and Informatics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States.ORCID 0000-0002-7714-3910
Mohan BalachandranCenter for Health Care Transformation and Innovation, Penn Medicine, Philadelphia, PA, United States.ORCID 0000-0001-8556-3846
Courtney Benjamin WolkDepartment of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States.ORCID 0000-0001-9542-2801
Emily M Becker-HaimesDepartment of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States.ORCID 0000-0002-9922-8667
Rachel KishtonCenter for Health Care Transformation and Innovation, Penn Medicine, Philadelphia, PA, United States.ORCID 0000-0002-5541-2841
Sarah BeckCenter for Health Care Transformation and Innovation, Penn Medicine, Philadelphia, PA, United States.ORCID 0009-0003-8640-8655
Raina M MerchantDepartment of Emergency Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States.ORCID 0000-0002-9801-6881
Anisk K AgarwalDepartment of Emergency Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States.ORCID 0000-0003-2175-0196

Funding

Assessing the effectiveness of a digital platform to support the mental health of healthcare workers in the response and recovery phases of COVID-19R01MH127686 · NIMH · UNIVERSITY OF PENNSYLVANIA · PI MERCHANT, RAINA · 2021 to 2023
$3.4M
Mentoring and Patient Oriented Research in Cardiovascular Health and Digital Data ScienceK24HL157621 · NHLBI · UNIVERSITY OF PENNSYLVANIA · PI MERCHANT, RAINA · 2021 to 2025
$615k
NHLBI NIH HHS K24 HL157621NIMH NIH HHS R01 MH127686
6 · The paper itself

Abstract

backgroundHealth systems are investing in mental health and well-being support tools and resources for health care workers (HCW). Considering the mental health strain facing HCWs, there is a need to optimize the current mental health delivery model.

objectiveThis study aimed to evaluate the usability and acceptability of a proactive digital mental health approach (Cobalt+;Penn Medicine), which included services proactively sent to HCWs via text messaging, including (1) monthly automated text messaging reminders and links to Cobalt, and (2) bimonthly text-message-based measures of depression and anxiety.

methodsThis study used the System Usability Scale (SUS), Net Promoter Score (NPS), and open-ended questions to capture Cobalt+ participants who received proactive digital mental health tools and resources. Descriptive summary statistics were used for SUS and NPS outcome measures, and a chi-square test was used to detect group differences. Open-ended questions were analyzed using a qualitative open coding process by 2 coders. Research team members calculated interrater agreement (Cohen κ above 0.80).

resultsA total of 162 of 642 HCWs randomized to Cobalt+ (25.2%) visited Cobalt due to a proactive text message and completed usability and acceptability measures. The mean age was 38.9 years, most were female (90.7%), 56.8% White, 53.1% married or partnered, and 34.6% engaged in shift work. The mean SUS score was 74.43 (median score 72.5). Participants said they mostly "browsed" the online mental health platform. Cobalt+ received an NPS of 13.7. When asked to elaborate on their experience, 2 categories (eg, positive and negative experiences) with 13 subcategories were identified. Most participants noted the brief process that helped prioritize mental health: "Forget otherwise. Puts in forefront of my mind," and "Your texts do remind me to take stock of my current feelings."

conclusionsA proactive digital mental health approach may help overcome barriers in the uptake of services that are otherwise passively available to HCWs. This study demonstrated that the proactive approach is generally usable, modestly acceptable, and further supplemented by HCW feedback. These findings suggest the approach's viability and the need for additional research toward improvement and broader implementation.

trial registrationClinicalTrials.gov NCT05028075; https://clinicaltrials.gov/study/NCT05028075.

Indexed as

Health PersonnelMental Health ServicesText MessagingAdultDepressionFemaleHumansMaleMental HealthMiddle AgedSurveys and QuestionnairesacceptabilityCOVID-19 pandemicdigital interventionfeasibilityhealth care workforceusabilitywell-being

Identifiers

PMID41364911
PMCPMC12728399

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.