SOURCE-LINKED INTELLIGENCE

Same Scores, Different Decisions: Evaluating JEV and Language Models for Legal Document Understanding

arXiv · AI, language, vision and robotics · article · Sep 23, 2026 · UTC

Contract inference requires multiple judgments about a shared document, but aggregate accuracy can conceal changes in the individual decisions. Repeated agreement is also insufficient: a model may consistently return the wrong answer. In this paper, we compare Jev with nine language models on ContractNLI, evaluating inference cost, response time, average correctness, and correctness across repeated request conditions. Controlled comparisons vary hypothesis visibility, requested outputs, and output order while keeping the contract and target judgment fixed. Jev has the lowest cost and median re

Read original source ↗ Open in workspace

recordType

paper

region

Global