SOURCE-LINKED INTELLIGENCE

Heard but Not Heeded: Paralinguistic Information Encoding and Loss in Audio-Language Models

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Audio language models are designed to understand speech, yet it remains unclear whether they capture how something is said beyond what is said. We present a mechanistic analysis of paralinguistic information in four open source models, Whisper-large-v2, Qwen2-Audio-7B Instruct, Qwen2.5-Omni-7B, and Chroma-4B, using the Expresso dataset with controlled speaking styles. We combine centered kernel alignment, linear probing with leave one speaker out evaluation, open ended tone prediction, and a content prosody leakage metric to trace how style information moves from the audio encoder to the final

Read original source ↗ Open in workspace

recordType

paper

region

Global