Evidence map›Paper›PMID 41832240›Full record

ArticleNPJ digital medicine2026

A multicenter multifunctional assessment of large language models in pure-tone audiogram interpretation for patients.

Jun Liang, Mengyao Xing, Peng Xiang, Guixuan Wang, Ming Chen, Qichuan Fang, Tingting Zhou, Zhengyang Lu, XueMing Leng, Jiuke Huang and 3 more

Abstract read
In one paragraph

Article in NPJ digital medicine, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Jun Liang *Department of AI and IT, Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, China.
Mengyao Xing *School of Medical Technology and Information Engineering, Zhejiang Chinese Medical University, Hangzhou, China.
Peng Xiang *Department of AI and IT, Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, China.
Guixuan Wang *Intelligent Medical Research Center, Zhejiang University Institute of Computer Innovation Technology, Hangzhou, China.
Ming ChenDepartment of Otolaryngology, Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, China.
Qichuan FangSchool of Medical Technology and Information Engineering, Zhejiang Chinese Medical University, Hangzhou, China.
Tingting ZhouSchool of Nursing, Zhejiang Chinese Medical University, Hangzhou, China.
Zhengyang LuSchool of Public Health, Zhejiang University, Hangzhou, China.
XueMing LengSchool of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing, China.
Jiuke HuangDepartment of Computer Science, Columbia University in the City of New York, New York, NY, USA.
Xiaoyi JiaoSchool of Public Health, Zhejiang University, Hangzhou, China.
Chenghua TianSchool of Medical Technology and Information Engineering, Zhejiang Chinese Medical University, Hangzhou, China. 20071044@zcmu.edu.cn.
Jianbo LeiClinical Research Center, Affiliated Hospital of Southwest Medical University, Luzhou, China. jblei@hsc.pku.edu.cn.

Funding

he National Natural Science Foundation of China 72574006Municipal Natural Science Foundation of Beijing of China 7222306the National Natural Science Foundation of China 81871455Zhejiang Provincial Natural Science Foundation of China LY22H180001
6 · The paper itself

Abstract

No LLMs (Large Language Models) have yet been evaluated for understanding picture reports. Pure-tone audiograms, the gold standard for hearing loss assessment, are technical and often incomprehensible to patients without specialist interpretation. We conducted a blinded, multicenter evaluation of eight LLMs across diagnostic, interpretive, and recommendation tasks using 140 audiogram reports, assessed by clinicians and lay reviewers. The study revealed that DeepSeek-V3 achieved the highest diagnostic accuracy (severity: 67.00% ; type: 54.00%), R1 proved most suitable for general readership (FKGL: 6.41). The general public perceived significant benefits from all models in comprehension and emotional support, with Gemini 2.0 Flash/Thinking scoring higher. Challenges remain in understanding pathological mechanisms and controlling hallucinations. While current general-purpose LLMs cannot replace the diagnostic capabilities of physicians, they may serve as effective auxiliary tools for translating specialized audiogram data into structured, patient-accessible interpretations, with particular relevance for populations facing limited access to hearing-care services.

Identifiers

PMID41832240
PMCPMC13136335

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.