Evidence map›Paper›PMID 42889097›Full record

ArticleFrontiers in medicine2026

Performance of large language models in prescription review: a comparative study.

Can Huang, Yanfang Sun, Wei Liu

Abstract read
In one paragraph

Article in Frontiers in medicine, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Can HuangBeijing Youan Hospital, Capital Medical University, Beijing, China.
Yanfang SunBeijing Youan Hospital, Capital Medical University, Beijing, China.
Wei LiuBeijing Youan Hospital, Capital Medical University, Beijing, China.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Objective: Large language models (LLMs) have emerged as a novel technical solution for intelligent prescription review. Nevertheless, comparative analyses of their performance remain limited. This study comprehensively evaluates five mainstream LLMs (ChatGPT, DeepSeek, Kimi, Qwen and Doubao) in prescription review, aiming to furnish data-based references for model selection, optimization and clinical deployment of intelligent prescription review systems. Methods: This study employed a cross-sectional comparative design. The evaluation dataset was derived from the prescription review question bank of the Chinese Pharmacist Skills Competition. In total, 100 prescriptions from 10 clinical specialties were randomly sampled, encompassing 270 standardized medication assessment items. Official standard answers served as the gold standard. Quantitative comparisons were performed on overall detection rate, question type identification and adaptability across clinical specialties. Prescription-level repeated-measures analysis of variance (ANOVA) and Holm-adjusted pairwise paired Results: The five models yielded item-level prescription detection rate ranging from 45.19% to 70.37% across 270 standardized medication assessment items. Their performance ranked from highest to lowest as follows: Kimi, DeepSeek, Qwen, Doubao and ChatGPT. Overall, the four Chinese domestic models included in this study outperformed the single tested international model (ChatGPT) in this China-focused prescription review task. Repeated-measures ANOVA confirmed statistically significant within-prescription differences in overall performance (F = 22.46, Conclusion: Performance varied markedly across the five LLMs in prescription review. Although these models can effectively identify routine and straightforward medication issues, they demonstrate prominent deficiencies in assessing complex prescriptions from specialist clinical specialties and detecting hidden medication risks. Currently, LLMs are only suitable for preliminary auxiliary screening and cannot substitute dedicated prescription review software or manual pharmacist evaluation.

Indexed as

large language modelsmedication safetypharmaceutical carepharmacist skillsprescription review

Identifiers

PMID42889097
PMCPMC13668837

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.