Evidence map›Paper›PMID 39412574›Full record

ArticleRheumatology international2024

Enhancing clinical reasoning skills for medical students: a qualitative comparison of LLM-powered social robotic versus computer-based virtual patients within rheumatology.

Alexander Borg, Benjamin Jobs, Viking Huss, Cidem Gentline, Fabricio Espinosa, Mini Ruiz, Samuel Edelbring, Carina Georg, Gabriel Skantze, Ioannis Parodis

Registry-linked trialAbstract readComparative Study
In one paragraph

Article in Rheumatology international, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT07277829 (AI-generated Feedback in Social Robotic Virtual Patients), which is not on this map. Cited by 14 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT07277829 nacompletednot on this mapstarted 2025, after this paper: background citation

AI-generated Feedback in Social Robotic Virtual Patients

TypeinterventionalSponsorIoannis ParodisRan2025 to 2025Enrolled115ConditionsVirtual Patient, Social Robots, Artificial Intelligence (AI), Large Language ModelArmsAI post consultation feedback
3 · Its place in the literature

Who cites it

14 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Observational
  11. Article
  12. Article
  13. Medical reasoning in LLMs: an in-depth analysis of DeepSeek R1.Frontiers in artificial intelligence · 2025
    Article
  14. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Alexander BorgDivision of Rheumatology, Department of Medicine Solna, Karolinska Institutet and Karolinska University Hospital, Stockholm, Sweden.ORCID 0000-0003-1013-4590
Benjamin JobsDivision of Rheumatology, Department of Medicine Solna, Karolinska Institutet and Karolinska University Hospital, Stockholm, Sweden.
Viking HussDivision of Clinical Epidemiology, Department of Medicine Solna, Karolinska Institutet, Karolinska University Hospital Solna, D2:01 Rheumatology, Stockholm, SE-171 76, Sweden.ORCID 0000-0002-9764-6435
Cidem GentlineDivision of Rheumatology, Department of Medicine Solna, Karolinska Institutet and Karolinska University Hospital, Stockholm, Sweden.
Fabricio EspinosaDivision of Rheumatology, Department of Medicine Solna, Karolinska Institutet and Karolinska University Hospital, Stockholm, Sweden.ORCID 0000-0001-6227-8209
Mini RuizDepartment of Clinical Science, Intervention and Technology, Karolinska Institutet, Stockholm, Sweden.ORCID 0000-0002-9910-8809
Samuel EdelbringSchool of Health Sciences, Örebro University, Örebro, Sweden.ORCID 0000-0002-1110-0782
Carina GeorgDepartment of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden.ORCID 0000-0001-8444-7624
Gabriel SkantzeDivision of Speech Music and Hearing, Royal Institute of Technology, KTH, Stockholm, Sweden.ORCID 0000-0002-8579-1790
Ioannis ParodisDivision of Rheumatology, Department of Medicine Solna, Karolinska Institutet and Karolinska University Hospital, Stockholm, Sweden. ioannis.parodis@ki.se.ORCID 0000-0002-4875-5395

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Virtual patients (VPs) are increasingly used in medical education to train clinical reasoning (CR) skills. However, optimal VP design for enhancing interactivity and authenticity remains unclear. Novel interactive modalities, such as large language model (LLM)-enhanced social robotic VPs might increase interactivity and authenticity in CR skill practice. To evaluate medical students' perceptions of CR training using an LLM-enhanced social robotic VP platform compared with a conventional computer-based VP platform. A qualitative study involved 23 third-year medical students from Karolinska Institutet, who completed VP cases on an LLM-enhanced social robotic platform and a computer-based semi-linear platform. In-depth interviews assessed students' self-perceived acquirement of CR skills using the two platforms. Thematic analysis was employed to identify themes and sub-themes. Three main themes were identified: authenticity, VP application, and strengths and limitations. Students found the social robotic platform more authentic and engaging. It enabled highly interactive communication and expressed emotions, collectively offering a realistic experience. It facilitated active learning, hypothesis generation, and adaptive thinking. Limitations included lack of physical examination options and, occasionally, mechanical dialogue. The LLM-enhanced social robotic VP platform offers a more authentic and interactive learning experience compared to the conventional computer-based platform. Despite some limitations, it shows promise in training CR skills, communication, and adaptive thinking. Social robotic VPs may prove useful and safe learning environments for exposing medical students to diverse, highly interactive patient simulations.

Indexed as

Clinical CompetenceClinical ReasoningQualitative ResearchRheumatologyStudents, MedicalAdultEducation, Medical, UndergraduateFemaleHumansMaleRoboticsYoung AdultClinical reasoningPatient simulationRefractive indexRheumatology

Identifiers

PMID39412574
PMCPMC11618132

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.