SOURCE-LINKED INTELLIGENCE

Beyond Blind Compliance: Benchmarking Task Verification in OCR Reasoning

arXiv · AI, language, vision and robotics · article · Aug 31, 2026 · UTC

Multimodal Large Language Models (MLLMs) have achieved strong performance on OCR-centric document understanding and text-rich visual reasoning benchmarks. Yet existing evaluations largely assume that every task is valid and answerable. In real-world OCR scenarios, this assumption often fails: questions may rely on illegible text, occluded evidence, nonexistent visual targets, contradictory premises, or missing variables. We study this reliability gap as OCR-grounded Task Verification: before answering, a model should determine whether the Image Premise (IP), Textual Premise (TP), and Question

Read original source ↗ Open in workspace

recordType

paper

region

Global