Evidence map›Paper›PMID 40203298›Full record

ArticleJMIR human factors2025

Co-Designing a Web-Based and Tablet App to Evaluate Clinical Outcomes of Early Psychosis Service Users in a Learning Health Care Network: User-Centered Design Workshop and Pilot Study.

Kathleen E Burch, Valerie L Tryon, Katherine M Pierce, Laura M Tully, Sabrina Ereshefsky, Mark Savill, Leigh Smith, Adam B Wilcox, Christopher Komei Hakusui, Viviana E Padilla and 9 more

Abstract read
In one paragraph

Article in JMIR human factors, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

19 authors.

Kathleen E BurchDepartment of Psychiatry & Behavioral Sciences, University of California-Davis, Sacramento, CA, United States.ORCID 0000-0002-4889-3907
Valerie L TryonDepartment of Psychiatry & Behavioral Sciences, University of California-Davis, Sacramento, CA, United States.ORCID 0000-0003-3117-3150
Katherine M PierceDepartment of Psychiatry & Behavioral Sciences, University of California-Davis, Sacramento, CA, United States.ORCID 0000-0002-6820-5649
Laura M TullyDepartment of Psychiatry & Behavioral Sciences, University of California-Davis, Sacramento, CA, United States.ORCID 0000-0002-2751-9887
Sabrina EreshefskyDepartment of Psychiatry & Behavioral Sciences, University of California-Davis, Sacramento, CA, United States.ORCID 0000-0002-0348-1300
Mark SavillDepartment of Psychiatry & Behavioral Sciences, University of California-Davis, Sacramento, CA, United States.ORCID 0000-0002-4785-4885
Leigh SmithDepartment of Psychology, University of California-Davis, Davis, CA, United States.ORCID 0000-0001-7414-8380
Adam B WilcoxInstitute for Informatics, Washington University in St. Louis, St. Louis, MO, United States.ORCID 0000-0002-6305-735X
Christopher Komei HakusuiDepartment of Psychiatry & Behavioral Sciences, University of California-Davis, Sacramento, CA, United States.ORCID 0000-0001-7006-5860
Viviana E PadillaDepartment of Psychiatry & Behavioral Sciences, University of California-Davis, Sacramento, CA, United States.ORCID 0009-0004-8454-5020
Amanda P McNamaraHerbert Wertheim School of Public Health and Human Longevity Science, University of California San Diego, San Diego, CA, United States.ORCID 0000-0002-6079-7694
Merissa Kado-WaltonHerbert Wertheim School of Public Health and Human Longevity Science, University of California San Diego, San Diego, CA, United States.ORCID 0000-0002-6042-1996
Andrew J PadovaniCenter for Healthcare Policy and Research, University of California-Davis, Sacramento, CA, United States.ORCID 0000-0002-3116-3078
Chelyah MillerDepartment of Psychiatry & Behavioral Sciences, University of California-Davis, Sacramento, CA, United States.ORCID 0000-0001-6820-0680
Madison J MilesDepartment of Psychiatry & Behavioral Sciences, University of California-Davis, Sacramento, CA, United States.ORCID 0000-0001-7371-802X
Nitasha SharmaDepartment of Psychiatry & Behavioral Sciences, University of California-Davis, Sacramento, CA, United States.ORCID 0009-0000-6411-0979
Khanh Linh H NguyenDepartment of Psychiatry & Behavioral Sciences, University of California-Davis, Sacramento, CA, United States.ORCID 0000-0002-9563-1838
Yi ZhangCenter for Healthcare Policy and Research, University of California-Davis, Sacramento, CA, United States.ORCID 0000-0003-0422-3757
Tara A NiendamDepartment of Psychiatry & Behavioral Sciences, University of California-Davis, Sacramento, CA, United States.ORCID 0000-0003-2285-5002

Funding

California Collaborative Network to Promote Data Driven Care and Improve Outcomes in Early Psychosis (EPI-CAL)R01MH120555 · NIMH · UNIVERSITY OF CALIFORNIA AT DAVIS · PI NIENDAM, TARA ANN · 2019 to 2024
$7.9M
NIMH NIH HHS R01 MH120555
6 · The paper itself

Abstract

backgroundThe Early Psychosis Intervention Network of California project, a learning health care network of California early psychosis intervention (EPI) programs, prioritized incorporation of community partner feedback while designing its eHealth app, Beehive. Though eHealth apps can support learning health care network data collection aims, low user acceptance or adoption can pose barriers to successful implementation. Adopting user-centered design (UCD) approaches, such as incorporation of user feedback, prototyping, iterative design, and continuous evaluation, can mitigate these potential barriers.

objectiveWe aimed to use UCD during development of a data collection and data visualization web-based and tablet app, Beehive, to promote engagement with Beehive as part of standard EPI care across a diverse user-base.

methodsOur UCD approach included incorporation of user feedback, prototyping, iterative design, and continuous evaluation. This started with user journey mapping to create storyboards, which were then presented in UCD workshops with service users, their support persons, and EPI providers. We incorporated feedback from these workshops into the alpha version of Beehive, which was also presented in a UCD workshop. Feedback was again incorporated into the beta version of Beehive. We provided Beehive training to 4 EPI programs who then piloted Beehive's beta version. During piloting, service users, their support persons, and EPI program providers completed Beehive surveys at enrollment and every 6 months after treatment initiation. To examine preliminary user acceptance and adoption during the piloting phase, we assessed rates of participant enrollment and survey completion, with a particular focus on completion of a prioritized survey: the Modified Colorado Symptom Index.

resultsUCD workshop feedback resulted in the creation of new workflows and interface changes in Beehive to improve the user experience. During piloting, 48 service users, 42 support persons, and 72 EPI program providers enrolled in Beehive. Data were available for 88% (n=42) of service users, including self-reported data for 79% (n=38), collateral-reported data for 42% (n=20), and clinician-entered data for 17% (n=8). The Modified Colorado Symptom Index was completed by 54% (n=26) of service users (total score: mean 24.16, SD 16.81). In addition, 35 service users had a support person who could complete the Modified Colorado Symptom Index, and 56% (n=19) of support persons completed it (mean 26.71, SD 14.43).

conclusionsImplementing UCD principles while developing the Beehive app resulted in early workflow changes and produced an app that was acceptable and feasible for collection of self-reported clinical outcomes data from service users. Additional support is needed to increase collateral-reported and clinician-entered data.

Indexed as

Computers, HandheldMobile ApplicationsPsychotic DisordersAdultCaliforniaFemaleHumansInternetMalePilot ProjectsTelemedicinedata visualizationearly psychosiseHealthlearning health systemmeasurement-based carepsychosissurveys and questionnairesuser-centered designuser-driven developmentweb-based

Identifiers

PMID40203298
PMCPMC12018865

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.