Evidence map›Paper›PMID 41035903›Full record

ArticleGastroenterology report2025

Revolutionizing inflammatory bowel disease healthcare communication: a head-to-head comparison of gastroenterologist and ChatGPT responses.

Zixuan He, Yilong Liu, Zhaoming Wang, Xiaoyu Zhou, Xuanming Fan, Miao He, Chengcheng Wang, Hongyu Fu, Zhijie Wang, Yu Bai

Abstract read
In one paragraph

Article in Gastroenterology report, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Review
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Zixuan HeDepartment of Gastroenterology, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.ORCID https://orcid.org/0000-0002-5883-4038
Yilong LiuDepartment of Gastroenterology, Shanghai Changzheng Hospital, Naval Medical University, Shanghai, P. R. China.
Zhaoming WangDepartment of Colorectal Surgery, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.
Xiaoyu ZhouDepartment of Gastroenterology, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.
Xuanming FanDepartment of Gastroenterology, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.
Miao HeDepartment of Pharmacy, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.
Chengcheng WangDepartment of Clinical Nutrition, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.
Hongyu FuNational Clinical Research Center for Digestive Diseases (Shanghai), Shanghai, P. R. China.
Zhijie WangDepartment of Gastroenterology, Affiliated Hangzhou First People's Hospital, Westlake University School of Medicine, Hangzhou, Zhejiang, P. R. China.
Yu BaiDepartment of Gastroenterology, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: Artificial intelligence-driven large language models demonstrate immense potential in the medical field. It remains unclear whether ChatGPT has the ability to provide appropriate recommendations for patients with inflammatory bowel disease (IBD) that are comparable to those of gastroenterologists. This study quantitatively assessed the performance of ChatGPT's generated IBD-related recommendations from the distinct perspectives of gastroenterologists and patients. Methods: Healthcare questions regarding IBD were solicited from IBD patients and specialized physicians. Those questions were then presented to GPT-4 Omni and three independent senior gastroenterologists for responses. These responses were subsequently evaluated by a blinded panel of five board-certified gastroenterologists using a five-point Likert scale, assessing accuracy, completeness, and readability. Furthermore, 10 IBD patients as blinded assessors performed assessments of both ChatGPT's and gastroenterologists' responses. Results: Thirty high-frequency questions were selected, encompassing basic knowledge, treatment, and management domains. ChatGPT demonstrated high reproducibility in responding to these questions. Regarding accuracy and readability, ChatGPT's performance was comparable to that of gastroenterologists. For completeness of responses, ChatGPT outperformed gastroenterologists (4.42 ± 0.67 vs 4.19 ± 0.65; Conclusions: ChatGPT has the potential to provide stable, accurate, comprehensive, and comprehensible healthcare-related information for IBD patients. Further validation of the reliability and practicality of large language models in real-world clinical settings is crucial.

Indexed as

GPT-4 Omniinflammatory bowel diseaselarge language modelspatient education

Identifiers

PMID41035903
PMCPMC12479395

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.