Evidence map›Paper›PMID 39432895›Full record

ArticleJournal of medical Internet research2024

Assessing the Usage and Usability of a Mental Health Advice Telephone Service in Uganda: Mixed Methods Study.

Johnblack K Kabukye, Juliet Nakku, Jackline Niwemuhwezi, James Nsereko, Rosemary Namagembe, Iris Dorothee Emilie Groen, Ritah Neumbe, Denis Mubiru, Caroline Kisakye, Roseline Nanyonga and 3 more

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Johnblack K KabukyeSwedish Program for ICT in Developing Regions (SPIDER), Department of Computer and Systems Science, Stockholm University, Stockholm, Sweden.ORCID 0000-0002-7864-1858
Juliet NakkuButabika National Referral Mental Hospital, Kampala, Uganda.ORCID 0000-0002-0611-1102
Jackline NiwemuhweziButabika National Referral Mental Hospital, Kampala, Uganda.ORCID 0009-0002-7472-2463
James NserekoButabika National Referral Mental Hospital, Kampala, Uganda.ORCID 0009-0004-0103-2511
Rosemary NamagembeHutchinson Centre Research Institute of Uganda, Uganda Cancer Institute, Kampala, Uganda.ORCID 0000-0002-6545-990X
Iris Dorothee Emilie GroenMoleMann Mental Health, Almere, Netherlands.ORCID 0009-0004-8249-7993
Ritah NeumbeButabika National Referral Mental Hospital, Kampala, Uganda.ORCID 0009-0006-5470-8022
Denis MubiruButabika National Referral Mental Hospital, Kampala, Uganda.ORCID 0009-0007-5422-7154
Caroline KisakyeButabika National Referral Mental Hospital, Kampala, Uganda.ORCID 0009-0000-3352-161X
Roseline NanyongaButabika National Referral Mental Hospital, Kampala, Uganda.ORCID 0009-0000-9883-5441
Marie SjölinderResearch Institutes of Sweden (RISE), Stockholm, Sweden.ORCID 0000-0002-0968-5785
Susanne NilssonUnit for Integrated Product Development and Design, Department of Machine Design, KTH Royal Institute of Technology, Stockholm, Sweden.ORCID 0000-0002-6056-5172
Caroline Wamala-LarssonSwedish Program for ICT in Developing Regions (SPIDER), Department of Computer and Systems Science, Stockholm University, Stockholm, Sweden.ORCID 0000-0003-4920-9182

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundHarnessing mobile health (mHealth) solutions could improve the delivery of mental health services and mitigate their impact in Uganda and similar low-resource settings. However, successful adoption requires that mHealth solutions have good usability. We have previously implemented a telephone service to provide mental health information and advice in English and Luganda, utilizing an automated interactive voice response (IVR) system linked to live agents, including mental health care workers and peer support workers.

objectiveThis study aims to assess the usage and usability of this mental health telephone service.

methodsWe obtained usage data from the system's call logs over 18 months to study call volumes and trends. We then surveyed callers to gather their characteristics and assess usability using the Telehealth Usability Questionnaire. Additionally, call recordings were evaluated for conversation quality by 3 independent health care professionals, using the Telephone Nursing Dialogue Process, and correlations between quality and usability aspects were investigated.

resultsOver 18 months, the system received 2863 meaningful calls (ie, calls that went past the welcome message) from 1125 unique telephone numbers. Of these, 1153 calls (40.27%) stopped at the prerecorded IVR information, while 1710 calls (59.73%) opted to speak to an agent. Among those who chose to speak with an agent, 1292 calls (75.56%) were answered, 393 calls (22.98%) went to voicemail and were returned in the following working days, and 25 calls (1.46%) were not answered. Usage was generally sustained over time, with spikes in call volume corresponding to marketing events. The survey (n=240) revealed that most callers were caregivers of patients with mental health issues (n=144, 60.0%) or members of the general public (n=46, 19.2%), while a few were patients with mental health issues (n=44, 18.3%). Additionally, the majority were male (n=143, 59.6%), spoke English (n=180, 75.0%), had postsecondary education (n=164, 68.3%), lived within 1 hour or less from Butabika Hospital (n=187, 77.9%), and were aged 25-44 years (n=160, 66.7%). The overall usability score for the system was 4.12 on a 5-point scale, significantly higher than the recommended target usability score of 4 (P=.006). The mean scores for usability components ranged from 3.66 for reliability to 4.41 for ease of use, with all components, except reliability, scoring higher than 4 or falling within its CI. Usability scores were higher for Luganda speakers compared with English speakers, but there was no association with other participant characteristics such as sex, distance from the hospital, age, marital status, duration of symptoms, or treatment status. The quality of call conversations (n=50) was rated at 4.35 out of 5 and showed a significant correlation with usability (Pearson r=0.34, P=.02).

conclusionsWe found sustained usage of the mental health telephone service, along with a positive user experience and high satisfaction across various user characteristics. mHealth solutions like this should be embraced and replicated to enhance the delivery of health services in Uganda and similar low-resource settings.

Indexed as

Mental Health ServicesTelephoneAdultFemaleHumansMaleMental HealthMiddle AgedSurveys and QuestionnairesTelemedicineUgandaYoung AdultAfricaevaluationmental healthmHealthmixed methodsatisfactiontelephone serviceUgandausability

Identifiers

PMID39432895
PMCPMC11535793

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.