SOURCE-LINKED INTELLIGENCE

Can Jev Judge Radiology Reports? Evaluating a System One Model for Clinical Factuality

arXiv · AI, language, vision and robotics · article · Sep 23, 2026 · UTC

An AI-generated radiology report can resemble a physician's report while omitting an abnormality, adding an unsupported finding, or reversing its presence. Measuring these factual differences is essential for evaluating report generators. We study Jev, a System One decision model, as a simple, low-cost judge of agreement with physician-written reference reports. Our evaluator checks whether each statement is supported by the other report and combines these judgments in both directions to capture unsupported claims and omissions. A single-question configuration reaches Kendall correlations of 0

Read original source ↗ Open in workspace

recordType

paper

region

Global