Evidence map›Paper›PMID 37006821›Full record

ArticleFrontiers in digital health2023

Older adults' experience with virtual conversational agents for health data collection.

Hattie Wilczewski, Hiral Soni, Julia Ivanova, Triton Ong, Janelle F Barrera, Brian E Bunnell, Brandon M Welch

Open access · goldFull text read
In one paragraph

Article in Frontiers in digital health, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed, 1 pooled it
8.7field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 1 synthesis or guideline pooled it, 20 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 2 institutions in 1 country.

Hattie WilczewskiDoxy.me Research, Doxy.me Inc., Rochester, NY, United States.
Hiral SoniDoxy.me Research, Doxy.me Inc., Rochester, NY, United States.
Julia IvanovaDoxy.me Research, Doxy.me Inc., Rochester, NY, United States.
Triton OngDoxy.me Research, Doxy.me Inc., Rochester, NY, United States.
Janelle F BarreraDoxy.me Research, Doxy.me Inc., Rochester, NY, United States.
Brian E BunnellDoxy.me Research, Doxy.me Inc., Rochester, NY, United States.
Brandon M WelchDoxy.me Research, Doxy.me Inc., Rochester, NY, United States.
University of South Florida · USMedical University of South Carolina · US

Funding

PRACTICE: A Mobile Health Solution to Improve Between-Session Skills Practice in Youth Mental Health TreatmentK23MH118482 · NIMH · UNIVERSITY OF SOUTH FLORIDA · PI BUNNELL, BRIAN E. · 2018 to 2021
$621k
Improving data capture in clinical research using a chatbotR41LM013419 · NLM · DOKBOT, LLC · PI WELCH, BRANDON M · 2020 to 2020
$252k
NIMH NIH HHS K23 MH118482NLM NIH HHS R41 LM013419
6 · The paper itself

Abstract

Introduction: Virtual conversational agents (i.e., chatbots) are an intuitive form of data collection. Understanding older adults' experiences with chatbots could help identify their usability needs. This quality improvement study evaluated older adults' experiences with a chatbot for health data collection. A secondary goal was to understand how perceptions differed based on length of chatbot forms. Methods: After a demographic survey, participants (≥60 years) completed either a short (21 questions), moderate (30 questions), or long (66 questions) chatbot form. Perceived ease-of-use, usefulness, usability, likelihood to recommend, and cognitive load were measured post-test. Qualitative and quantitative analyses were used. Results: A total of 260 participants reported on usability and satisfaction metrics including perceived ease-of-use (5.8/7), usefulness (4.7/7), usability (5.4/7), and likelihood to recommend (Net Promoter Score = 0). Cognitive load (12.3/100) was low. There was a statistically significant difference in perceived usefulness between groups, with a significantly higher mean perceived usefulness for Group 1 than Group 3. No other group differences were observed. The chatbot was perceived as quick, easy, and pleasant with concerns about technical issues, privacy, and security. Participants provided suggestions to enhance progress tracking, edit responses, improve readability, and have options to ask questions. Discussion: Older adults found the chatbot to be easy, useful, and usable. The chatbot required low cognitive load demonstrating it could be an enjoyable health data collection tool for older adults. These results will inform the development of a health data collection chatbot technology.

Indexed as

chatbothealth data collectionolder adultsusabilityuser experiencevirtual conversational agents

Identifiers

PMID37006821
PMCPMC10050579
OpenAlexW4324373429

What OpenQuestion holds

Textfull text, public
LicenceCC BY
reference markers read1
measurements read49
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.