SOURCE-LINKED INTELLIGENCE

Read the Room, Read the Image: Understanding Indirect Speech Acts in Multimodal Visual Contexts

arXiv · AI, language, vision and robotics · article · Aug 31, 2026 · UTC

Indirect speech acts (ISAs) require pragmatic reasoning over context, as directive intent can- not be inferred from surface form alone. Prior text-based studies and existing multimodal benchmarks largely overlook this requirement, focusing instead on explicitly encoded context or perceptual recognition, and thus underex- plore context-dependent pragmatic understand- ing, particularly in high-context languages such as Korean. We introduce READI, a multimodal benchmark for evaluating ISA understanding through integrated reasoning over visual con- text and dialogue. READI models graded in- direct

Read original source ↗ Open in workspace

recordType

paper

region

Global