SOURCE-LINKED INTELLIGENCE

JEV-as-a-Judge: Accept When Confident, Escalate When Unsure

arXiv · AI, language, vision and robotics · article · Sep 22, 2026 · UTC

LLM-as-a-judge enables evaluation across diverse tasks, but inference cost and confidence reliability become critical at scale. We study whether a decision-only judge can provide an economical first pass and identify when stronger evaluation is needed. Comparing jev-as-a-judge with sixteen generative and reward-model judges, with blinded human adjudication, we find it within three percentage points of a state-of-the-art LLM judge, our strongest comparator, on ordinary preference and evidence-grounded factuality at 0.36% of the comparator's fee. Larger gaps arise when judgments require checking

Read original source ↗ Open in workspace

recordType

paper

region

Global