Evidence map›Paper›PMID 39359921›Full record

ArticleFrontiers in medicine2024

Large language model answers medical questions about standard pathology reports.

Anqi Wang, Jieli Zhou, Peng Zhang, Haotian Cao, Hongyi Xin, Xinyun Xu, Haiyang Zhou

Abstract read
In one paragraph

Article in Frontiers in medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Anqi Wang *Division of Colorectal Surgery, Changzheng Hospital, Navy Medical University, Shanghai, China.
Jieli Zhou *UM-SJTU Joint Institute, Shanghai Jiao Tong University, Shanghai, China.
Peng Zhang *Division of Colorectal Surgery, Changzheng Hospital, Navy Medical University, Shanghai, China.
Haotian CaoDepartment of Pathology, Changzheng Hospital, Navy Medical University, Shanghai, China.
Hongyi XinUM-SJTU Joint Institute, Shanghai Jiao Tong University, Shanghai, China.
Xinyun XuDivision of Breast and Thyroid Surgery, Changzheng Hospital, Navy Medical University, Shanghai, China.
Haiyang ZhouDivision of Colorectal Surgery, Changzheng Hospital, Navy Medical University, Shanghai, China.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

This study aims to evaluate the feasibility of large language model (LLM) in answering pathology questions based on pathology reports (PRs) of colorectal cancer (CRC). Four common questions (CQs) and corresponding answers about pathology were retrieved from public webpages. These questions were input as prompts for Chat Generative Pretrained Transformer (ChatGPT) (gpt-3.5-turbo). The quality indicators (understanding, scientificity, satisfaction) of all answers were evaluated by gastroenterologists. Standard PRs from 5 CRC patients who received radical surgeries in Shanghai Changzheng Hospital were selected. Six report questions (RQs) and corresponding answers were generated by a gastroenterologist and a pathologist. We developed an interactive PRs interpretation system which allows users to upload standard PRs as JPG images. Then the ChatGPT's responses to the RQs were generated. The quality indicators of all answers were evaluated by gastroenterologists and out-patients. As for CQs, gastroenterologists rated AI answers similarly to non-AI answers in understanding, scientificity, and satisfaction. As for RQ1-3, gastroenterologists and patients rated the AI mean scores higher than non-AI scores among the quality indicators. However, as for RQ4-6, gastroenterologists rated the AI mean scores lower than non-AI scores in understanding and satisfaction. In RQ4, gastroenterologists rated the AI scores lower than non-AI scores in scientificity (

Indexed as

colorectal cancerGenerative Pretrained Transformerlarge language modelmedical questionpathology report

Identifiers

PMID39359921
PMCPMC11445125

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.