SOURCE-LINKED INTELLIGENCE

Grounded Action Model: 3D Grounding as a Foundation for Robotics

arXiv · AI, language, vision and robotics · article · Sep 20, 2026 · UTC

Manipulation policies must know which objects matter and where they are, yet the pretrained backbones that current robot foundation models build on, from language in vision-language-action models (VLAs) to video generation in world-action models (WAMs), do not directly require this metric grounding, leaving it to be learned implicitly from robot demonstrations. We propose Grounded Action Models (GAMs), a new paradigm of robot foundation models built with 3D grounding. GAM can be conditioned using language, points, or box prompts, which are first transformed into a shared object-centric represe

Read original source ↗ Open in workspace

recordType

paper

region

Global