SOURCE-LINKED INTELLIGENCE

Generative vs. Encoder Large Language Models for ASR Evaluation: A Comparative Study

arXiv · AI, language, vision and robotics · article · Aug 26, 2026 · UTC

Automatic Speech Recognition (ASR) is typically evaluated using Word Error Rate (WER), which poorly reflects semantic similarity. While embedding-based metrics correlate better with human judgments, the respective roles of encoder and decoder-based Large Language Models (LLMs) remain underexplored. This paper presents a comparative study of both families for ASR evaluation. We analyze BERTScore and SemDist across different LLMs, layers, and pooling strategies, showing that both metrics can achieve strong correlation with human judgments when properly configured. For decoder models, we investig

Read original source ↗ Open in workspace

recordType

paper

region

Global