Evidence map›Paper›PMID 38206661›Full record

ArticleJMIR medical education2024

Comprehensiveness, Accuracy, and Readability of Exercise Recommendations Provided by an AI-Based Chatbot: Mixed Methods Study.

Amanda L Zaleski, Rachel Berkowsky, Kelly Jean Thomas Craig, Linda S Pescatello

Registry-linked trialAbstract read
In one paragraph

Article in JMIR medical education, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT07238556 (Feasibility and Acceptability of a Novel Algorithm for Physicians to Prescribe Personalized Exercise Prescriptions to Patients With Cardiovascular Disease Risk Factors), which is not on this map. Cited by 29 papers.

0numbers the graph read from it
0cells of the map it votes in
29citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT07238556 narecruitingnot on this mapstarted 2026, after this paper: background citation

Feasibility and Acceptability of a Novel Algorithm for Physicians to Prescribe Personalized Exercise Prescriptions to Patients With Cardiovascular Disease Risk Factors: Study Protocol for an Exploratory Randomized Controlled Crossover Trial

TypeinterventionalSponsorUniversity of ConnecticutRan2026 to 2026Enrolled72ConditionsHypertension, Dyslipidemia, Diabetes Mellitus, ObesityArmsExperimental - 12 Week P3-EX Unsupervised Exercise Program with Virtual Weekly Oversight from Graduate Research Assistants, Active Control - 12 Week ACSM-PAVS Unsupervised Exercise Program with Virtual Weekly Oversight from Graduate Research Assistants
3 · Its place in the literature

Who cites it

29 citing papers in PubMed.

  1. Article
  2. Review
  3. Review
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Observational
  18. Article
  19. Accuracy of chat-based artificial intelligence for patient education on orthostatic hypotension.Clinical autonomic research : official journal of the Clinical Autonomic Research Society · 2025
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Amanda L ZaleskiClinical Evidence Development, Aetna Medical Affairs, CVS Health Corporation, Hartford, CT, United States.ORCID 0000-0002-0362-819X
Rachel BerkowskyDepartment of Kinesiology, University of Connecticut, Storrs, CT, United States.ORCID 0000-0003-1150-1284
Kelly Jean Thomas CraigClinical Evidence Development, Aetna Medical Affairs, CVS Health Corporation, Hartford, CT, United States.ORCID 0000-0002-9954-2795
Linda S PescatelloDepartment of Kinesiology, University of Connecticut, Storrs, CT, United States.ORCID 0000-0002-5841-798X

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundRegular physical activity is critical for health and disease prevention. Yet, health care providers and patients face barriers to implement evidence-based lifestyle recommendations. The potential to augment care with the increased availability of artificial intelligence (AI) technologies is limitless; however, the suitability of AI-generated exercise recommendations has yet to be explored.

objectiveThe purpose of this study was to assess the comprehensiveness, accuracy, and readability of individualized exercise recommendations generated by a novel AI chatbot.

methodsA coding scheme was developed to score AI-generated exercise recommendations across ten categories informed by gold-standard exercise recommendations, including (1) health condition-specific benefits of exercise, (2) exercise preparticipation health screening, (3) frequency, (4) intensity, (5) time, (6) type, (7) volume, (8) progression, (9) special considerations, and (10) references to the primary literature. The AI chatbot was prompted to provide individualized exercise recommendations for 26 clinical populations using an open-source application programming interface. Two independent reviewers coded AI-generated content for each category and calculated comprehensiveness (%) and factual accuracy (%) on a scale of 0%-100%. Readability was assessed using the Flesch-Kincaid formula. Qualitative analysis identified and categorized themes from AI-generated output.

resultsAI-generated exercise recommendations were 41.2% (107/260) comprehensive and 90.7% (146/161) accurate, with the majority (8/15, 53%) of inaccuracy related to the need for exercise preparticipation medical clearance. Average readability level of AI-generated exercise recommendations was at the college level (mean 13.7, SD 1.7), with an average Flesch reading ease score of 31.1 (SD 7.7). Several recurring themes and observations of AI-generated output included concern for liability and safety, preference for aerobic exercise, and potential bias and direct discrimination against certain age-based populations and individuals with disabilities.

conclusionsThere were notable gaps in the comprehensiveness, accuracy, and readability of AI-generated exercise recommendations. Exercise and health care professionals should be aware of these limitations when using and endorsing AI-based technologies as a tool to support lifestyle change involving exercise.

Indexed as

Artificial IntelligenceComprehensionAwarenessExerciseHumansSoftwareAIartificial intelligencechatbotexercise prescriptionhealth literacylarge language modelpatient education

Identifiers

PMID38206661
PMCPMC10811574

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.