Evidence map›Paper›PMID 39259964›Full record

Observational studyJMIR human factors2024

User Experience of a Large-Scale Smartphone-Based Observational Study in Multiple Sclerosis: Global, Open-Access, Digital-Only Study.

Adriano Galati, Lito Kriara, Michael Lindemann, Rea Lehner, J B Jones

Abstract readObservational Study
In one paragraph

Observational study in JMIR human factors, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Review
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Adriano GalatiF Hoffmann-La Roche Ltd, Basel, Switzerland.ORCID 0009-0006-9661-899X
Lito KriaraF Hoffmann-La Roche Ltd, Basel, Switzerland.ORCID 0000-0002-9159-0469
Michael LindemannF Hoffmann-La Roche Ltd, Basel, Switzerland.ORCID 0000-0003-1010-3890
Rea LehnerF Hoffmann-La Roche Ltd, Basel, Switzerland.ORCID 0000-0002-6497-2875
J B JonesSutter Health Center for Health Systems Research, Walnut Creek, CA, United States.ORCID 0000-0001-8752-877X

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe Floodlight Open app is a digital health technology tool (DHTT) that comprises remote, smartphone sensor-based tests (daily activities) for assessing symptoms of multiple sclerosis (MS). User acquisition, engagement, and retention remain a barrier to successfully deploying such tools.

objectiveThis study aims to quantitatively and qualitatively investigate key user experience (UX) factors associated with the Floodlight Open app.

methodsFloodlight Open is a global, open-access, digital-only study designed to understand the drivers and barriers in deploying a DHTT in a naturalistic setting without supervision and onboarding by a clinician. Daily activities included tests assessing cognition (Information Processing Speed and Information Processing Speed Digit-Digit), hand-motor function (Pinching Test and Draw a Shape Test), and postural stability and gait (Static Balance Test, U-Turn Test, and Two-Minute Walk Test [2MWT]). All daily activities except the 2MWT were taken in a fixed sequence. Qualitative UX was studied through semistructured interviews in a substudy of US participants with MS. The quantitative UX analysis investigated the impact of new UX design features on user engagement and retention in US participants for 3 separate test series: all daily activities included in the fixed sequence (DA), all daily activities included in the fixed sequence except the Static Balance Test and U-Turn Test (DA

resultsThe qualitative UX substudy (N=22) revealed the need for 2 new UX design features: a more seamless user journey during the activation process that eliminates the requirement of switching back and forth between the app and the email that the participants received upon registration, and configurable reminders and push notifications to help plan and remind the participants to complete their daily activities. Both UX design features were assessed in the quantitative UX analysis. Introducing the more seamless user journey (original user journey: n=608; more seamless user journey: n=481) improved the conversion rate of participants who enrolled in the study and proceeded to successfully activate the app from 53.9% (328/608) to 74.6% (359/481). Introducing reminders and push notifications (with reminders and notifications: n=350; without reminders and notifications: n=172) improved continuous usage time (proportion of participants with ≥3 consecutive days of usage: DA and DA

conclusionsThe remote assessment of MS with DHTTs is a relatively nascent but growing field of research. The continued assessment and improvement of UX design features can play a crucial role in the successful long-term adoption of new DHTTs.

Indexed as

Mobile ApplicationsMultiple SclerosisSmartphoneActivities of Daily LivingAdultFemaleHumansMaleMiddle AgedQualitative Researchdigital healthdigital health technologymobile phonemultiple sclerosisretentionsmartphoneuser experience

Identifiers

PMID39259964
PMCPMC11425019

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.