Evidence map›Paper›PMID 39476366›Full record

ArticleJournal of medical Internet research2024

Evaluating the Implementation and Clinical Effectiveness of an Innovative Digital First Care Model for Behavioral Health Using the RE-AIM Framework: Quantitative Evaluation.

Samuel S Nordberg, Brittany A Jaso-Yim, Pratha Sah, Keke Schuler, Mara Eyllon, Mariesa Pennine, Georgia H Hoyler, J Ben Barnes, Lily Hong Murillo, Heather O'Dea and 5 more

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Moving beyond global scores: the added value of clinical dimensions for assessing HRQoL in mental disorders.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2026
    Article
  3. Review
  4. Observational
  5. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Samuel S Nordberg *Reliant Medical Group, OptumCare, Worcester, MA, United States.ORCID 0000-0002-4527-8175
Brittany A Jaso-Yim *Reliant Medical Group, OptumCare, Worcester, MA, United States.ORCID 0000-0002-3474-5639
Pratha SahReliant Medical Group, OptumCare, Worcester, MA, United States.ORCID 0000-0001-8936-5871
Keke SchulerReliant Medical Group, OptumCare, Worcester, MA, United States.ORCID 0009-0008-0860-5908
Mara EyllonReliant Medical Group, OptumCare, Worcester, MA, United States.ORCID 0000-0002-5270-4494
Mariesa PennineReliant Medical Group, OptumCare, Worcester, MA, United States.ORCID 0009-0003-4666-1656
Georgia H HoylerUnited Health Group, Minnetonka, MN, United States.ORCID 0009-0008-7056-406X
J Ben BarnesReliant Medical Group, OptumCare, Worcester, MA, United States.ORCID 0000-0001-5554-1435
Lily Hong MurilloReliant Medical Group, OptumCare, Worcester, MA, United States.ORCID 0009-0003-9825-9693
Heather O'DeaReliant Medical Group, OptumCare, Worcester, MA, United States.ORCID 0009-0003-9483-1453
Laura OrthReliant Medical Group, OptumCare, Worcester, MA, United States.ORCID 0009-0002-9351-5443
Elizabeth RogersReliant Medical Group, OptumCare, Worcester, MA, United States.ORCID 0009-0002-6857-3908
George WelchReliant Medical Group, OptumCare, Worcester, MA, United States.ORCID 0009-0000-0862-4238
Gabrielle PeloquinReliant Medical Group, OptumCare, Worcester, MA, United States.ORCID 0000-0002-5555-3951
Soo Jeong YounReliant Medical Group, OptumCare, Worcester, MA, United States.ORCID 0000-0002-7528-5042

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundIn the United States, innovation is needed to address the increasing need for mental health care services and widen the patient-to-provider ratio. Despite the benefits of digital mental health interventions (DMHIs), they have not been effective in addressing patients' behavioral health challenges as stand-alone treatments.

objectiveThis study evaluates the implementation and effectiveness of precision behavioral health (PBH), a digital-first behavioral health care model embedded within routine primary care that refers patients to an ecosystem of evidence-based DMHIs with strategically placed human support.

methodsPatient demographic information, triage visit outcomes, multidimensional patient-reported outcome measure, enrollment, and engagement with the DMHIs were analyzed using data from the electronic health record and vendor-reported data files. The RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework was used to evaluate the implementation and clinical effectiveness outcomes of PBH.

resultsPBH had a 47.58% reach rate, defined as patients accepting the PBH referral from their behavioral health integrated clinician. PBH patients had high DMHI registration rates (79.62%), high activation rates (76.54%), and high retention rates at 15 days (57.69%) and 30 days (44.58%) compared to literature benchmarks. In total, 74.01% (n=168) of patients showed clinical improvement, 22.47% (n=51) showed no clinical change, and 3.52% (n=8) showed clinical deterioration in symptoms. PBH had high adoption rates, with behavioral health integrated clinicians referring on average 4.35 (SD 0.46) patients to PBH per month and 90%-100% of clinicians (n=12) consistently referring at least 1 patient to PBH each month. A third (32%, n=1114) of patients were offered PBH as a treatment option during their triage visit.

conclusionsPBH as a care model with evidence-based DMHIs, human support for patients, and integration within routine settings offers a credible service to support patients with mild to moderate mental health challenges. This type of model has the potential to address real-life access to care problems faced by health care settings.

Indexed as

Mental Health ServicesAdultFemaleHumansMaleMiddle AgedPrimary Health CareUnited Statesaccess to careclinical effectivenessdigital mental health interventionsimplementationpractice-oriented research

Identifiers

PMID39476366
PMCPMC11561446

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.