ArticleJMIR research protocols2024
Adapting and Evaluating an AI-Based Chatbot Through Patient and Stakeholder Engagement to Provide Information for Different Health Conditions: Master Protocol for an Adaptive Platform Trial (the MARVIN Chatbots Study).
Article in JMIR research protocols, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 2 registered trials, which are not on this map. Cited by 15 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
A Master Research Protocol to Adapt and Evaluate an Artificial Intelligence Based Conversational Agent to Provide Information for Different Health Conditions: the MARVIN Chatbots
Empowering Breast Cancer Clients Through AI Chatbots: Transforming Knowledge and Attitudes for Enhanced Nursing Care
Who cites it
15 citing papers in PubMed, 1 synthesis or guideline pooled it.
- Opportunities and challenges of artificial intelligence in public health: a systematic review on technological efficacy, ethical dilemmas, and governance pathways.Frontiers in public health · 2025Pooled it
- Validation of the AI mental health Therapy Attitude, Perception, and Intention Scale (AiTAPI).Internet interventions · 2026Article
- Large language model-based triage to identify antiretroviral therapy adherence barriers and risk levels in patient messages.JAMIA open · 2026Article
- Coconstructing CHAMP, an Artificial Intelligence Chatbot for Pediatric Infectious Symptoms Management: Protocol for a Multiphase Participatory Study.JMIR research protocols · 2026Article
- A Fine-Tuned Multimodal AI Chatbot for Dietary Health and Nutrition, Purrfessor: Development and Mixed Methods Evaluation.JMIR AI · 2026Article
- A complex intervention to improve life experience during and after acute treatment for breast cancer: Preliminary results from intervention development for the Continuum PAROLE-Onco 360 program.Canadian journal of public health = Revue canadienne de sante publique · 2026Article
- Participatory-informed preference optimization (PiPrO): A reinforcement learning simulation study.PLOS digital health · 2026Article
- Medical clinical minds meet artificial intelligence: Italian physicians' knowledge, attitudes, and concordance between Italian physicians and AI-generated diagnoses. A national cross-sectional study.Frontiers in digital health · 2026Article
- Development of an AI-driven chatbot for medication-assisted treatment standards in Scotland.Frontiers in digital health · 2026Article
- Perspective on patient and non-academic partner engagement for the responsible integration of large language models in health chatbots.Research involvement and engagement · 2025Article
- Using generative artificial intelligence in clinical practice: a narrative review and proposed agenda for implementation.The Medical journal of Australia · 2025Review
- The first AI-based Chatbot to promote HIV self-management: A mixed methods usability study.HIV medicine · 2025Article
- Recommendations for the equitable integration of digital health interventions across the HIV care cascade.Communications medicine · 2024Article
- Acceptance, Satisfaction, and Preference With Telemedicine During the COVID-19 Pandemic in 2021-2022: Survey Among Patients With Chronic Pain.JMIR formative research · 2024Article
- Artificial Intelligence, the Digital Surgeon: Unravelling Its Emerging Footprint in Healthcare - The Narrative Review.Journal of multidisciplinary healthcare · 2024Review
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
17 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundArtificial intelligence (AI)-based chatbots could help address some of the challenges patients face in acquiring information essential to their self-health management, including unreliable sources and overburdened health care professionals. Research to ensure the proper design, implementation, and uptake of chatbots is imperative. Inclusive digital health research and responsible AI integration into health care require active and sustained patient and stakeholder engagement, yet corresponding activities and guidance are limited for this purpose.
objectiveIn response, this manuscript presents a master protocol for the development, testing, and implementation of a chatbot family in partnership with stakeholders. This protocol aims to help efficiently translate an initial chatbot intervention (MARVIN) to multiple health domains and populations.
methodsThe MARVIN chatbots study has an adaptive platform trial design consisting of multiple parallel individual chatbot substudies with four common objectives: (1) co-construct a tailored AI chatbot for a specific health care setting, (2) assess its usability with a small sample of participants, (3) measure implementation outcomes (usability, acceptability, appropriateness, adoption, and fidelity) within a large sample, and (4) evaluate the impact of patient and stakeholder partnerships on chatbot development. For objective 1, a needs assessment will be conducted within the setting, involving four 2-hour focus groups with 5 participants each. Then, a co-construction design committee will be formed with patient partners, health care professionals, and researchers who will participate in 6 workshops for chatbot development, testing, and improvement. For objective 2, a total of 30 participants will interact with the prototype for 3 weeks and assess its usability through a survey and 3 focus groups. Positive usability outcomes will lead to the initiation of objective 3, whereby the public will be able to access the chatbot for a 12-month real-world implementation study using web-based questionnaires to measure usability, acceptability, and appropriateness for 150 participants and meta-use data to inform adoption and fidelity. After each objective, for objective 4, focus groups will be conducted with the design committee to better understand their perspectives on the engagement process.
resultsFrom July 2022 to October 2023, this master protocol led to four substudies conducted at the McGill University Health Centre or the Centre hospitalier de l'Université de Montréal (both in Montreal, Quebec, Canada): (1) MARVIN for HIV (large-scale implementation expected in mid-2024), (2) MARVIN-Pharma for community pharmacists providing HIV care (usability study planned for mid-2024), (3) MARVINA for breast cancer, and (4) MARVIN-CHAMP for pediatric infectious conditions (both in preparation, with development to begin in early 2024).
conclusionsThis master protocol offers an approach to chatbot development in partnership with patients and health care professionals that includes a comprehensive assessment of implementation outcomes. It also contributes to best practice recommendations for patient and stakeholder engagement in digital health research.
trial registrationClinicalTrials.gov NCT05789901; https://classic.clinicaltrials.gov/ct2/show/NCT05789901. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/54668.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.