Evidence map›Paper›PMID 42039940›Full record

ArticleHealth care science2026

Evaluating ChatGPT's Adherence to Medical Ethics: A Prerequisite for Artificial Intelligence in Medicine.

Ying Zhang, Yuyang Liu, Tingyu Lv, Junhui Wang, Hui Liu, Xiaoying Li

Abstract read
In one paragraph

Article in Health care science, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Ying ZhangInstitute of Medical Information & Library, Chinese Academy of Medical Sciences & Peking Union Medical College Beijing China.
Yuyang LiuInstitute of Medical Information & Library, Chinese Academy of Medical Sciences & Peking Union Medical College Beijing China.
Tingyu LvInstitute of Medical Information & Library, Chinese Academy of Medical Sciences & Peking Union Medical College Beijing China.
Junhui WangInstitute of Medical Information & Library, Chinese Academy of Medical Sciences & Peking Union Medical College Beijing China.
Hui LiuInstitute of Medical Information & Library, Chinese Academy of Medical Sciences & Peking Union Medical College Beijing China.
Xiaoying LiInstitute of Medical Information & Library, Chinese Academy of Medical Sciences & Peking Union Medical College Beijing China.ORCID https://orcid.org/0000-0003-4407-6616

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: As artificial intelligence continues to play an expanding role in healthcare, ensuring its compliance with medical ethics is essential. However, the ethical performance of artificial intelligence in medical contexts remains insufficiently studied. This study aimed to evaluate the ability of ChatGPT to address questions related to medical ethics and to compare its performance with that of human experts. Methods: A Medical Ethics Evaluation dataset was developed, consisting of 465 single-choice questions derived from a range of medical ethics standards. These questions were used to assess two artificial intelligence models, GPT-3.5 and GPT-4. Model responses were compared with those provided by two medical ethics experts. Each test was conducted independently twice to ensure consistency. Accuracy was calculated for each model and expert, and chi-square tests were used to compare differences in performance. Results: GPT-3.5 achieved an overall accuracy of 38.92%, while GPT-4 achieved 27.10%. In comparison, two medical ethics experts achieved substantially higher accuracies of 86.23% and 78.32%, respectively. Both experts performed significantly better than GPT-3.5 and GPT-4. These findings indicate a substantial gap between artificial intelligence models and human experts in understanding and applying medical ethics principles. The relatively low performance of the models, compared with their reported strengths in diagnostic tasks, may reflect the complexity and nuance of ethical reasoning in medicine. Nevertheless, the large language models showed some ability to align with core medical ethics principles, particularly in ethical dilemma scenarios, and were also able to generate responses that addressed psychological needs. Conclusions: Artificial intelligence models currently show limited accuracy in medical ethics decision-making compared with human experts. Although these models demonstrate some alignment with fundamental ethical principles, the performance is not yet sufficient for reliable use in ethically sensitive medical contexts. Further optimization is needed to improve their ability to meet the ethical demands of medical practice.

Indexed as

artificial intelligenceChatGPTethical dilemmasmedical ethics

Identifiers

PMID42039940
PMCPMC13109837

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.