ReviewJournal of medical Internet research2022
Design and Evaluation Challenges of Conversational Agents in Health Care and Well-being: Selective Review Study.
Review in Journal of medical Internet research, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 18 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
18 citing papers in PubMed, 1 synthesis or guideline pooled it.
- Therapeutic Interaction Features of AI Chatbots in Depression Interventions: Systematic Review and Meta-Analysis.Journal of medical Internet research · 2026Pooled it
- Body Image and Eating Disorder Education Chatbot, JEM, in Australia and Canada: First 6-Month Real-World Survey Evaluation.JMIR human factors · 2026Article
- Behavior Change Content and Implementation of Large Language Model-Driven Conversational Agents in Cardiometabolic Care: Scoping Review.Journal of medical Internet research · 2026Article
- Human-AI co-research on design and evaluation of Embodied Conversational Agent in rehabilitation contexts.Frontiers in robotics and AI · 2026Article
- Conversational Systems for Social Care in Older Adults: Protocol for a Scoping Review.JMIR research protocols · 2025Article
- User Engagement with A Multimodal Conversational Agent for Self-Care and Chronic Disease Management: A Retrospective Analysis.Journal of medical systems · 2025Article
- Caregiving Artificial Intelligence Chatbot for Older Adults and Their Preferences, Well-Being, and Social Connectivity: Mixed-Method Study.Journal of medical Internet research · 2025Article
- Review
- Exploring health professionals' views on the depiction of conversational agents as health professionals: a qualitative descriptive study.Frontiers in digital health · 2025Article
- Chatbot for Social Need Screening and Resource Sharing With Vulnerable Families: Iterative Design and Evaluation Study.JMIR human factors · 2024Article
- Digital Anti-Aging Healthcare: An Overview of the Applications of Digital Technologies in Diet Management.Journal of personalized medicine · 2024Review
- Evaluation framework for conversational agents with artificial intelligence in health interventions: a systematic scoping review.Journal of the American Medical Informatics Association : JAMIA · 2024Article
- Existing Barriers Faced by and Future Design Recommendations for Direct-to-Consumer Health Care Artificial Intelligence Apps: Scoping Review.Journal of medical Internet research · 2023Article
- Collecting Food and Drink Intake Data With Voice Input: Development, Usability, and Acceptability Study.JMIR mHealth and uHealth · 2023Article
- Implementation Fidelity of Chatbot Screening for Social Needs: Acceptability, Feasibility, Appropriateness.Applied clinical informatics · 2023Article
- Adaptation of the Gabby conversational agent system to improve the sexual and reproductive health of young women in Lesotho.Frontiers in digital health · 2023Article
- Information security and confidentiality in health chatbots: A scoping review and development of a conceptual model.Digital healthReview
- Individual differences in views toward healthcare conversational agents: A cross-sectional survey study.Digital healthArticle
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
22 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundHealth care and well-being are 2 main interconnected application areas of conversational agents (CAs). There is a significant increase in research, development, and commercial implementations in this area. In parallel to the increasing interest, new challenges in designing and evaluating CAs have emerged.
objectiveThis study aims to identify key design, development, and evaluation challenges of CAs in health care and well-being research. The focus is on the very recent projects with their emerging challenges.
methodsA review study was conducted with 17 invited studies, most of which were presented at the ACM (Association for Computing Machinery) CHI 2020 conference workshop on CAs for health and well-being. Eligibility criteria required the studies to involve a CA applied to a health or well-being project (ongoing or recently finished). The participating studies were asked to report on their projects' design and evaluation challenges. We used thematic analysis to review the studies.
resultsThe findings include a range of topics from primary care to caring for older adults to health coaching. We identified 4 major themes: (1) Domain Information and Integration, (2) User-System Interaction and Partnership, (3) Evaluation, and (4) Conversational Competence.
conclusionsCAs proved their worth during the pandemic as health screening tools, and are expected to stay to further support various health care domains, especially personal health care. Growth in investment in CAs also shows the value as a personal assistant. Our study shows that while some challenges are shared with other CA application areas, safety and privacy remain the major challenges in the health care and well-being domains. An increased level of collaboration across different institutions and entities may be a promising direction to address some of the major challenges that otherwise would be too complex to be addressed by the projects with their limited scope and budget.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.