Articlenpj health systems2025
Current and future state of evaluation of large language models for medical summarization tasks.
Article in npj health systems, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
27 citing papers in PubMed.
- Multimodal Large Language Models for Dental Chart Image Interpretation: Cross-Sectional Benchmarking Study With Students and Clinicians.JMIR medical education · 2026Article
- Precision Grounding: augmenting large language models with evidence-based databases for trustworthy genetic variant summarization.International journal of medical informatics · 2026Article
- Proposed Context-of-Use Evaluation Framework for Medication Management Tasks Completed by Generative Artificial Intelligence.medRxiv : the preprint server for health sciences · 2026Article
- A survey on LLM-as-a-judge.Innovation (Cambridge (Mass.)) · 2026Article
- Screening for Missed Opportunities for Diagnosis in the ED Using eTriggers and Large Language Models.JAMA network open · 2026Article
- Assessing the quality of AI-generated and physician-written discharge summaries: evaluation of an EHR-integrated tool in a Dutch academic hospital.EBioMedicine · 2026Article
- Grounding large language models in clinical diagnostics.Nature communications · 2026Article
- WiseMind: a knowledge-guided multi-agent framework for accurate and empathetic psychiatric diagnosis.NPJ digital medicine · 2026Article
- Empowering Informal Caregivers of Persons With Early-Stage Dementia by Large Language Models: Mixed Methods Evaluation.JMIR formative research · 2026Article
- Can artificial intelligence manage malnutrition? A critical look at ChatGPT's performance in geriatric nutrition.Revista da Associacao Medica Brasileira (1992) · 2026Article
- Psychometric applications of generative artificial intelligence: Lifecycle, risks, and research agenda.PLOS mental health · 2026Review
- Does generative AI mean the "end of history" for pharmacovigilance automation? towards a framework for the future of human-AI systems.Frontiers in drug safety and regulation · 2026Article
- Toward Responsible and Privacy-Preserving Generation of Inpatient Clinical Discharge Notes Using Large Language Models.Computational and structural biotechnology journal · 2026Article
- MEDAI-LLM-SUMM: a reporting checklist for medical text summarization studies using large language models.Frontiers in digital health · 2026Article
- Key aspects of fine-tuning and applying LLM-as-a-judge for clinical data summaries in the radiological workflow.Frontiers in artificial intelligence · 2026Article
- The IMPACT framework for evaluating generative AI in critical care: development and multinational consensus validation.Annals of intensive care · 2026Article
- A centralized decision-making support consultation response for fertility preservation in breast cancer patients: benchmark performance of generative large language models in terms of reliability and readability.Frontiers in public health · 2026Article
- Summarization of Narrative Clinical Data of Inflammatory Bowel Disease With Foundational Large Language Models.Gastro hep advances · 2026Review
- Automating expert-level medical reasoning evaluation of large language models.NPJ digital medicine · 2025Article
- Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
10 authors.
Funding
Abstract
Large Language Models have expanded the potential for clinical Natural Language Generation (NLG), presenting new opportunities to manage the vast amounts of medical text. However, their use in such high-stakes environments necessitate robust evaluation workflows. In this review, we investigated the current landscape of evaluation metrics for NLG in healthcare and proposed a future direction to address the resource constraints of expert human evaluation while balancing alignment with human judgments.
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.