SOURCE-LINKED INTELLIGENCE

Adaptive Fisher-Whitened Cross-Covariance for Low-Resource Speech Recognition

arXiv · AI, language, vision and robotics · article · Sep 24, 2026 · UTC

Adapting multilingual speech foundation models to low-resource languages remains difficult, especially for languages that are poorly represented during pre-training. While parameter-efficient fine-tuning (PEFT) reduces the cost of adapting large models, conventional approaches such as LoRA rely on generic low-rank parameterizations and do not explicitly use downstream task information to define the adaptation subspace. To investigate whether task-informed PEFT can better support low-resource ASR, we apply Fisher-Whitened Cross-Covariance Analysis (FCCA) to Whisper and Qwen3-ASR, and introduce

Read original source ↗ Open in workspace

recordType

paper

region

Global