Evidence map›Paper›PMID 41882302›Full record

ArticleCommunications medicine2026

Optimizing prompting strategies improves large language model classification of pain- and fatigue-related functional impact in childhood cancer survivors.

Jin-Ah Sim, Madeline R Horan, Xiaolei Huang, Minsu Kim, Deo Kumar Srivastava, Kirsten K Ness, Melissa M Hudson, Justin N Baker, I-Chan Huang

Abstract read
In one paragraph

Article in Communications medicine, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Jin-Ah SimGraduate School of Public Health and Healthcare Management, The Catholic University of Korea, Seoul, Republic of Korea.
Madeline R HoranDepartment of Pediatrics, Wake Forest University School of Medicine, Winston-Salem, NC, USA.
Xiaolei HuangDepartment of Computer Science, College of Arts & Sciences, University of Memphis, Memphis, TN, USA.
Minsu KimDepartment of AI Convergence, Hallym University, Chuncheon, Republic of Korea.
Deo Kumar SrivastavaDepartment of Biostatistics, St. Jude Children's Research Hospital, Memphis, TN, USA.ORCID http://orcid.org/0000-0001-6693-8120
Kirsten K NessDepartment of Epidemiology & Cancer Control, St. Jude Children's Research Hospital, Memphis, TN, USA.ORCID http://orcid.org/0000-0002-2084-1507
Melissa M HudsonDepartment of Epidemiology & Cancer Control, St. Jude Children's Research Hospital, Memphis, TN, USA.
Justin N BakerDivision of Quality of Life and Pediatric Palliative Care, Department of Pediatrics, Stanford University School of Medicine and Stanford Medicine Children's Health, Palo Alto, CA, USA.
I-Chan HuangDepartment of Epidemiology & Cancer Control, St. Jude Children's Research Hospital, Memphis, TN, USA. i-chan.huang@stjude.org.ORCID http://orcid.org/0000-0002-1194-3923

Funding

Viral Vector Technology (VVTSR)P30CA021765 · NCI · ST. JUDE CHILDREN'S RESEARCH HOSPITAL · PI Shondra Michelle Miller · 1985 to 2026
$166.9M
The St. Jude Lifetime CohortU01CA195547 · NCI · ST. JUDE CHILDREN'S RESEARCH HOSPITAL · PI HUDSON, MELISSA M, NESS, KIRSTEN KIMBERLIE · 2015 to 2024
$14.9M
Patient-Generated Health Data to Predict Childhood Cancer Survivorship OutcomesR01CA258193 · NCI · ST. JUDE CHILDREN'S RESEARCH HOSPITAL · PI I-Chan Huang, YUTAKA YASUI · 2021 to 2026
$3.7M
Patient-Reported Outcomes Version of CTCAE involving Childhood Cancer SurvivorsR01CA238368 · NCI · ST. JUDE CHILDREN'S RESEARCH HOSPITAL · PI BAKER, JUSTIN N, HUANG, I-CHAN · 2019 to 2023
$3.5M
The St. Jude Lifetime Cohort StudyU01CA301480 · NCI · ST. JUDE CHILDREN'S RESEARCH HOSPITAL · PI MELISSA M HUDSON, Kirsten Kimberlie Ness · 2025 to 2026
$2.1M
Symptom progress and adverse health outcomes in adult childhood cancer survivorsR21CA202210 · NCI · ST. JUDE CHILDREN'S RESEARCH HOSPITAL · PI HUANG, I-CHAN, KRULL, KEVIN R · 2016 to 2017
$428k
NCI NIH HHS P30 CA021765NCI NIH HHS R01 CA238368NCI NIH HHS R01 CA258193NCI NIH HHS R21 CA202210NCI NIH HHS U01 CA195547NCI NIH HHS U01 CA301480
6 · The paper itself

Abstract

backgroundUnderstanding how symptoms affect daily functioning is central to improving care for childhood cancer survivors. As narrative symptom reporting becomes increasingly common in survivorship care, scalable automated tools are needed to interpret these descriptions and identify their functional impact. This study evaluates how two large language models (ChatGPT-4o, Llama-3.1) perform this task across different prompt engineering strategies.

methodsWe analyzed semi-structured interviews from 30 childhood cancer survivors and their caregivers, yielding 819 pain- and fatigue-related symptom narratives. Each narrative was expert-annotated for physical, social, or cognitive functional impact, serving as the reference standard. ChatGPT-4o and Llama-3.1 were evaluated using four prompting strategies: zero-shot, few-shot, step-by-step reasoning (Chain-of-Thought), and generated knowledge. Model outputs were compared with expert annotations, and performance was quantified using standard classification and discrimination metrics with resampling-based confidence intervals.

resultsHere, we show that prompting strategies based on generated knowledge and step-by-step reasoning consistently outperform zero-shot and few-shot across both models. Overall, these strategies produce the most accurate and stable classification of physical, social, and cognitive functional impact. Specifically, ChatGPT-4o achieves more balanced precision and discrimination across physical, social, and cognitive functioning, whereas Llama-3.1 demonstrates higher sensitivity but substantially lower precision, particularly for physical and social functioning.

conclusionsPrompt engineering improves how large language models interpret survivor-reported pain and fatigue. These findings support the use of carefully designed prompts to enable automated, context-aware analysis of symptom narratives, providing a scalable approach to support symptom monitoring and survivor-centered care.

Identifiers

PMID41882302
PMCPMC13230702

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.