AQFormer: severity-aware transformer with aphasia-specific CAM for spoken keyword classification in aphasic speech.

Language-driven speech output in individuals with aphasia shows considerable variability, including phonological errors and pauses during word searches. This makes it difficult to use traditional keyword classification systems and further reduces trust in deep neural models, complicating their application in clinical settings. This paper introduces AQFormer, a severity-aware transformer architecture designed to classify spoken keywords in aphasic speech, and A-CAM, a dual-stream attribute framework aimed at assisting individuals with aphasic impairments. AQFormer generates acoustic representations that are severity-adaptive by integrating patient-level Aphasia Quotient (AQ) scores through Feature-wise Linear Modulation (FiLM) and A-CAM. A-CAM consists of two main components: (i) a branch that influences WavLM convolutional features, a prediction-focused one, and (ii) a multimodal aphasia filter that captures pauses, phoneme variations, and interruptions at word boundaries, an impairment-focused branch. We introduce an adaptive perturbation and dual-filtering gradient scheme that enforces non-negative, mask-consistent attributions over time-frequency regions. Experiments utilizing a subset of AphasiaBank keywords (93 speakers, 960 recordings; training set expanded to 5,138) with rigorous speaker-disjoint evaluation indicate that AQFormer achieves approximately 96.61% accuracy (F1 = 96.8%) on previously unseen speakers. A-CAM consistently outperforms several Grad-CAM variants when deletion/insertion AUPC and ADCC metrics are employed. This results in stable, sparse explanations that reflect how aphasia is usually caused: Discriminates correct from incorrect productions with Cohen's