SOURCE-LINKED INTELLIGENCE

Geometric and Semantic Coupling for Interaction Understanding in 3D Scenes

arXiv · AI, language, vision and robotics · article · Sep 21, 2026 · UTC

Interaction understanding in 3D scenes requires a joint description of movable parts, their motion, and the regions through which they can be operated. We present Segment-Snap, which connects these outputs through the physical relationship between parts and handles. Learned predictors identify broad part surfaces and small handles. A geometric decoder uses planar and upright priors to constrain motion, then selects hinge lines using predicted handle locations, without training a motion regressor. Conversely, a joint part-and-handle predictor supplies additional handle candidates, whose motion

Read original source ↗ Open in workspace

recordType

paper

region

Global