Evidence map›Paper›PMID 41191848›Full record

ArticleJCO clinical cancer informatics2025

Augmenting Large Language Models With National Comprehensive Cancer Network Guidelines for Improved and Standardized Adjuvant Therapy Recommendations in Postoperative Breast Cancer Cases.

Serene Si Ning Goh, Ragunathan Mariappan, Grace Soo Woon Tan, Jiali Yao, Fook Ming Hew, Yenshing Yeo, Samuel Guan Wei Ow, Wee Yao Koh, Nesaretnam Barr Kumarakulasingh, Teng Hwee Tan and 3 more

Abstract read
In one paragraph

Article in JCO clinical cancer informatics, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Review
  5. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Serene Si Ning GohNational University of Singapore and National University Health System, Saw Swee Hock School of Public Health, Singapore, Singapore.ORCID 0000-0003-4916-2142
Ragunathan MariappanNational University of Singapore and National University Health System, Saw Swee Hock School of Public Health, Singapore, Singapore.ORCID 0000-0002-7242-0966
Grace Soo Woon TanDepartment of Surgery, National University Hospital and National University Health System, Singapore, Singapore.
Jiali YaoNational University of Singapore and National University Health System, Saw Swee Hock School of Public Health, Singapore, Singapore.ORCID 0000-0001-7269-4679
Fook Ming HewDepartment of Surgery, National University Hospital and National University Health System, Singapore, Singapore.ORCID 0000-0001-9566-638X
Yenshing YeoDepartment of Surgery, National University Hospital and National University Health System, Singapore, Singapore.
Samuel Guan Wei OwDepartment of Hematology-Oncology, National University Cancer Institute, Singapore, Singapore.ORCID 0000-0002-2229-7971
Wee Yao KohDepartment of Hematology-Oncology, National University Cancer Institute, Singapore, Singapore.ORCID 0000-0001-8996-3337
Nesaretnam Barr KumarakulasinghDepartment of Hematology-Oncology, National University Cancer Institute, Singapore, Singapore.ORCID 0000-0002-5014-2117
Teng Hwee TanDepartment of Radiation Oncology, National University Cancer Institute, Singapore, Singapore.
Bee Choo TaiNational University of Singapore and National University Health System, Saw Swee Hock School of Public Health, Singapore, Singapore.
Mikael HartmanNational University of Singapore and National University Health System, Saw Swee Hock School of Public Health, Singapore, Singapore.
Kee Yuan NgiamDepartment of Surgery, National University Hospital and National University Health System, Singapore, Singapore.ORCID 0000-0001-5676-2520

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeMultidisciplinary breast tumor boards (MTBs) are essential for optimizing breast cancer treatment but face challenges related to logistics, variability in expertise, and lack of standardization. Large language models may support clinical decision making. This study evaluates the accuracy of adjuvant therapy recommendations generated by an artificial intelligence (AI)-driven tool, TheSerenityBot (TSB), in comparison with Claude-2 and GPT-4, using expert MTB consensus as the reference.

methodsPostoperative breast cancer cases reviewed at the National University Hospital, Singapore, between June and November 2023 were retrospectively analyzed. Eligible patients were women with invasive or preinvasive breast cancer who underwent surgery. Metastatic cases were excluded. TSB, a Claude-2-based model augmented with 2023 National Comprehensive Cancer Network guidelines, generated adjuvant therapy recommendations across seven treatment modalities. Outputs from TSB, Claude-2, and GPT-4 were evaluated for concordance with MTB recommendations. Model performance was assessed using generalized estimating equations.

resultsFifty patients were included (mean age, 59.8 years); 75.5% had hormone receptor-positive tumors, and 60.0% underwent breast-conserving surgery. TSB demonstrated the highest overall accuracy (0.89), followed by Claude-2 (0.86) and GPT-4 (0.78). GPT-4 showed significantly lower accuracy in genetic testing recommendations (odds ratio [OR], 0.05 [95% CI, 0.015 to 0.149];

conclusionA guideline-augmented AI tool such as TSB shows promise in supporting adjuvant therapy decisions in breast cancer. To improve clinical relevance, future iterations will incorporate individualized patient factors, broader guideline frameworks, and electronic health record integration. Prospective trials are ongoing to assess the real-world impact.

Indexed as

Artificial IntelligenceBreast NeoplasmsPractice Guidelines as TopicAdultAgedChemotherapy, AdjuvantClinical Decision-MakingFemaleHumansLarge Language ModelsMiddle AgedRetrospective Studies

Identifiers

PMID41191848
PMCPMC12604537

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.