Evidence map›Paper›PMID 31697237›Full record

SynthesisJournal of medical Internet research2019

The Personalization of Conversational Agents in Health Care: Systematic Review.

Ahmet Baki Kocaballi, Shlomo Berkovsky, Juan C Quiroz, Liliana Laranjo, Huong Ly Tong, Dana Rezazadegan, Agustina Briatore, Enrico Coiera

Registry-linked trialAbstract readSystematic Review
In one paragraph

Synthesis in Journal of medical Internet research, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT07073898 (Population Health Management Approaches to Increase Lung Cancer Screening in Community Health Centers - UG3 Pilot Clinical Trial), which is not on this map. Cited by 110 papers, 9 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
110citing papers in PubMed, 9 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT07073898 nacompletednot on this mapstarted 2025, after this paper: background citation

Population Health Management Approaches to Increase Lung Cancer Screening in Community Health Centers - UG3 Pilot Clinical Trial

TypeinterventionalSponsorUniversity of UtahRan2025 to 2026Enrolled65ConditionsLung CancerArmsRepeated Text Messages (TM+), Conversational Agent (CA), Educational Video, Proactive Patient Navigation (PPN), Reactive Patient Navigation (RPN)
3 · Its place in the literature

Who cites it

110 citing papers in PubMed, 9 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Pooled it
  10. Trial
  11. Trial
  12. Trial
  13. Trial
  14. Trial
  15. Trial
  16. Review
  17. Article
  18. Review
  19. Article
  20. Article

50 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Ahmet Baki KocaballiAustralian Institute of Health Innovation
, Faculty of Medicine and Health Sciences, Macquarie University, Sydney, Australia.ORCID 0000-0002-8328-5317
Shlomo BerkovskyAustralian Institute of Health Innovation
, Faculty of Medicine and Health Sciences, Macquarie University, Sydney, Australia.ORCID 0000-0003-2638-4121
Juan C QuirozAustralian Institute of Health Innovation
, Faculty of Medicine and Health Sciences, Macquarie University, Sydney, Australia.ORCID 0000-0003-0241-5376
Liliana LaranjoAustralian Institute of Health Innovation
, Faculty of Medicine and Health Sciences, Macquarie University, Sydney, Australia.ORCID 0000-0003-1020-3402
Huong Ly TongAustralian Institute of Health Innovation
, Faculty of Medicine and Health Sciences, Macquarie University, Sydney, Australia.ORCID 0000-0002-8462-0105
Dana RezazadeganAustralian Institute of Health Innovation
, Faculty of Medicine and Health Sciences, Macquarie University, Sydney, Australia.ORCID 0000-0002-0097-3801
Agustina BriatoreHealth Information Systems Office, Ministry of Health, Buenos Aires, Argentina.ORCID 0000-0002-6389-182X
Enrico CoieraAustralian Institute of Health Innovation
, Faculty of Medicine and Health Sciences, Macquarie University, Sydney, Australia.ORCID 0000-0002-6444-6584

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe personalization of conversational agents with natural language user interfaces is seeing increasing use in health care applications, shaping the content, structure, or purpose of the dialogue between humans and conversational agents.

objectiveThe goal of this systematic review was to understand the ways in which personalization has been used with conversational agents in health care and characterize the methods of its implementation.

methodsWe searched on PubMed, Embase, CINAHL, PsycInfo, and ACM Digital Library using a predefined search strategy. The studies were included if they: (1) were primary research studies that focused on consumers, caregivers, or health care professionals; (2) involved a conversational agent with an unconstrained natural language interface; (3) tested the system with human subjects; and (4) implemented personalization features.

resultsThe search found 1958 publications. After abstract and full-text screening, 13 studies were included in the review. Common examples of personalized content included feedback, daily health reports, alerts, warnings, and recommendations. The personalization features were implemented without a theoretical framework of customization and with limited evaluation of its impact. While conversational agents with personalization features were reported to improve user satisfaction, user engagement and dialogue quality, the role of personalization in improving health outcomes was not assessed directly.

conclusionsMost of the studies in our review implemented the personalization features without theoretical or evidence-based support for them and did not leverage the recent developments in other domains of personalization. Future research could incorporate personalization as a distinct design factor with a more careful consideration of its impact on health outcomes and its implications on patient safety, privacy, and decision-making.

Indexed as

Delivery of Health CareHumansPrecision Medicineadaptive systemsconversational agentsconversational interfacescustomizationdialogue systemshealth carepersonalization

Identifiers

PMID31697237
PMCPMC6873147

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.