SOURCE-LINKED INTELLIGENCE

OmniEcho: Spatial Audio Understanding for Embodied Agents

arXiv · AI, language, vision and robotics · article · Sep 20, 2026 · UTC

Humans can effortlessly localize the direction of a sound source and integrate it with visual cues for reasoning, yet this remains challenging for embodied agents. In particular, it is still unclear how to effectively evaluate and model spatial audio understanding in embodied settings. To address this gap, we introduce \textbf{OmniEchoBench}, a unified benchmark for spatial audio-visual perception and audio-vision-language navigation. OmniEchoBench comprises six tasks over 197 real-world spatial audio-visual scenes, 2,972 question-answer pairs, and 900 navigation samples with first-order ambis

Read original source ↗ Open in workspace

recordType

paper

region

Global