SOURCE-LINKED INTELLIGENCE

Acoustically Grounded Cost Learning for Open-Vocabulary Audio-Visual Semantic Segmentation

arXiv · AI, language, vision and robotics · article · Aug 29, 2026 · UTC

Open-Vocabulary Audio-Visual Semantic Segmentation (OV-AVSS) aims to perform pixel-level segmentation of sound-emitting objects from an open set of categories. The previous method relies on a class-agnostic foreground definition, which groups semantically diverse objects into a heterogeneous positive set, causing the model to learn unstable sounding patterns and produce unreliable proposals. To address this, we reformulate the objective to be category-specific and propose a novel Acoustically Grounded Cost Learning (AGCL) framework to transform the static, audio-agnostic visual-text priors int

Read original source ↗ Open in workspace

recordType

paper

region

Global