SOURCE-LINKED INTELLIGENCE

Inter-dimension Dependence for Multi-Dimensional Evaluation of Open-Ended Text

arXiv · AI, language, vision and robotics · article · Aug 24, 2026 · UTC

LLM-as-a-judge methods are widely used for evaluating the quality of generated open-ended text. Such evaluations are generally multi-dimensional, since the error patterns in texts can be different for different dimensions. Therefore, reliable LLM judges should evaluate each target dimension independently. To quantify the extent to which LLM judges depend on non-target dimensions when evaluating a target dimension, i.e., inter-dimension dependence, we propose CorrGap. To measure this, CorrGap uses the difference in correlations between LLM-predicted scores and ground truth scores across differe

Read original source ↗ Open in workspace

recordType

paper

region

Global