SOURCE-LINKED INTELLIGENCE

Auditing Proxy-Based Validation Across Text Spans

arXiv · AI, language, vision and robotics · article · Sep 22, 2026 · UTC

Evaluation scores are often validated by their agreement with inexpensive proxy labels. When the score and the proxy are computed from the same text span, however, that agreement can arise from surface evidence the two share rather than from the semantic construct the proxy is meant to represent. We make the distinction explicit by declaring the score, its span, the proxy and the target construct as a validation contract, then re-evaluating that proxy rule strictly outside the scored span. In a controlled HotpotQA correctness experiment varying only the shared text boundary, the score agrees w

Read original source ↗ Open in workspace

recordType

paper

region

Global