Evidence map›Paper›PMID 40331891›Full record

ArticleBJS open2025

Concordance of ChatGPT artificial intelligence decision-making in colorectal cancer multidisciplinary meetings: retrospective study.

Dimitrios Chatziisaak, Pascal Burri, Moritz Sparn, Dieter Hahnloser, Thomas Steffen, Stephan Bischofberger

Abstract read
In one paragraph

Article in BJS open, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 23 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
23citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

23 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Therapeutic Decisions in Inflammatory Bowel Disease: ChatGPT-4.0 Compared to Medical Expertise.JGH open : an open access journal of gastroenterology and hepatology · 2026
    Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Review
  13. Review
  14. Article
  15. Review
  16. Review
  17. Review
  18. Article
  19. Review
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Dimitrios ChatziisaakDepartment of Surgery, Kantonsspital St. Gallen, St. Gallen, Switzerland.ORCID 0009-0003-7203-7822
Pascal BurriDepartment of Surgery, Kantonsspital St. Gallen, St. Gallen, Switzerland.
Moritz SparnDepartment of Surgery, Kantonsspital St. Gallen, St. Gallen, Switzerland.ORCID 0000-0002-5908-5454
Dieter HahnloserDepartment of Surgery, Centre Hôpitalier Universitaire Vaudois, Lausanne, Switzerland.
Thomas SteffenDepartment of Surgery, Kantonsspital St. Gallen, St. Gallen, Switzerland.ORCID 0000-0001-9374-5703
Stephan BischofbergerDepartment of Surgery, Kantonsspital St. Gallen, St. Gallen, Switzerland.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe objective of this study was to evaluate the concordance between therapeutic recommendations proposed by a multidisciplinary team meeting and those generated by a large language model (ChatGPT) for colorectal cancer. Although multidisciplinary teams represent the 'standard' for decision-making in cancer treatment, they require significant resources and may be susceptible to human bias. Artificial intelligence, particularly large language models such as ChatGPT, has the potential to enhance or optimize the decision-making processes. The present study examines the potential for integrating artificial intelligence into clinical practice by comparing multidisciplinary team decisions with those generated by ChatGPT.

methodsA retrospective, single-centre study was conducted involving consecutive patients with newly diagnosed colorectal cancer discussed at our multidisciplinary team meeting. The pre- and post-therapeutic multidisciplinary team meeting recommendations were assessed for concordance compared with ChatGPT-4.

resultsOne hundred consecutive patients with newly diagnosed colorectal cancer of all stages were included. In the pretherapeutic discussions, complete concordance was observed in 72.5%, with partial concordance in 10.2% and discordance in 17.3%. For post-therapeutic discussions, the concordance increased to 82.8%; 11.8% of decisions displayed partial concordance and 5.4% demonstrated discordance. Discordance was more frequent in patients older than 77 years and with an American Society of Anesthesiologists classification ≥ III.

conclusionThere is substantial concordance between the recommendations generated by ChatGPT and those provided by traditional multidisciplinary team meetings, indicating the potential utility of artificial intelligence in supporting clinical decision-making for colorectal cancer management.

Indexed as

Artificial IntelligenceClinical Decision-MakingColorectal NeoplasmsPatient Care TeamAdultAgedAged, 80 and overDecision MakingFemaleGenerative Artificial IntelligenceHumansInterdisciplinary CommunicationMaleMiddle AgedRetrospective Studies

Identifiers

PMID40331891
PMCPMC12056934

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.