Evidence map›Paper›PMID 40118477›Full record

ArticleBMJ open2025

Evaluating the performance of large language models in health education for patients with ankylosing spondylitis/spondyloarthritis: a cross-sectional, single-blind study in China.

Yong Ren, Yue-Ning Kang, Shuang-Yan Cao, Fanxuan Meng, Jingyu Zhang, Ruyi Liao, Xiaomin Li, Yuling Chen, Ya Wen, Jiayun Wu and 7 more

Abstract readMulticenter Study
In one paragraph

Article in BMJ open, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

17 authors.

Yong Ren *Pazhou Lab, Guangzhou, Guangdong, China.ORCID http://orcid.org/0000-0002-4205-6964
Yue-Ning Kang *Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China.
Shuang-Yan Cao *Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China.
Fanxuan MengDepartment of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China.
Jingyu ZhangDepartment of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China.
Ruyi LiaoDepartment of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China.
Xiaomin LiDepartment of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China.
Yuling ChenDepartment of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China.
Ya WenDepartment of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China.
Jiayun WuDepartment of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China.
Wenqi XiaDepartment of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China.ORCID http://orcid.org/0009-0002-7931-8056
Liling XuDepartment of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China.
Shenghui WenDepartment of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China.
Huifen LiuDepartment of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China.
Yuanqing LiSchool of Automation Science and Engineering, South China University of Technology, Guangzhou, China lvqing@sysush.com gujieruo@163.com auyqli@scut.edu.cn.
Jieruo GuDepartment of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China lvqing@sysush.com gujieruo@163.com auyqli@scut.edu.cn.
Qing LvDepartment of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China lvqing@sysush.com gujieruo@163.com auyqli@scut.edu.cn.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesTo evaluate the potential of large language models (LLMs) in health education for patients with ankylosing spondylitis (AS)/spondyloarthritis (SpA), focusing on the accuracy of information transmission, patient acceptance and performance differences between different models.

designCross-sectional, single-blind study.

settingMultiple centres in China.

participants182 volunteers, including 4 rheumatologists and 178 patients with AS/SpA. PRIMARY AND SECONDARY OUTCOME MEASURES: Scientificity, precision and accessibility of the content of the answers provided by LLMs; patient acceptance of the answers.

resultsLLMs performed well in terms of scientificity, precision and accessibility, with ChatGPT-4o and Kimi models outperforming traditional guidelines. Most patients with AS/SpA showed a higher level of understanding and acceptance of the responses from LLMs.

conclusionsLLMs have significant potential in medical knowledge transmission and patient education, making them promising tools for future medical practice.

Indexed as

Health EducationPatient Education as TopicSpondylitis, AnkylosingAdultChinaCross-Sectional StudiesFemaleHumansLarge Language ModelsMaleMiddle AgedSingle-Blind MethodArtificial IntelligenceCross-Sectional StudiesHealth EducationRHEUMATOLOGY

Identifiers

PMID40118477
PMCPMC11931893

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.