Alignment of large language models in solving medical ethical dilemmas.

Background: Large language models (LLMs) are entering clinical workflows, yet their alignment with medical-ethical principles is unclear. Objective: To evaluate how LLMs reconcile deontological and utilitarian reasoning in medically adapted "Trolley dilemma" scenarios. Methods: We tested 14 LLMs, including GPT-o1-preview and DeepSeek-R1-Distill-Llama, using five medically adapted Trolley dilemmas sourced from philosophical and real-world scenarios. Each model generated 10 independent answers per case (overall 700 responses). Responses were forced to "yes" (utilitarian) or "no" (deontological). The primary outcome was the proportion of utilitarian choices. χ Results: LLM responses varied. Some models, such as GPT-4 and Gemma, selected the utilitarian option in 20% of cases, while others, like Qwen-2-7B, reached 80% ( Conclusions: In this constrained forced-choice stress test, models occasionally endorsed boundary-violating actions within the vignette framing. These results do not generalize to routine clinical decision-making, but motivate further benchmarked evaluation of refusal behavior and boundary constraints in ethically sensitive medical contexts. We must carefully define how these models influence clinical decisions, establish robust ethical guidelines for their use, and ensure that fundamental ethical norms are not compromised.