SOURCE-LINKED INTELLIGENCE

RoboTalk: Learning Multi-Robot Communication and Coordination from Multimodal Demonstrations

arXiv · AI, language, vision and robotics · article · Sep 21, 2026 · UTC

Multi-robot collaboration could enable more efficient and scalable solutions to complex robotic tasks, but collaboration under partial observability remains challenging. Natural-language communication offers a promising approach to coordinating robots under partial observability. However, in decentralized manipulation, jointly learning explicit inter-robot communication and skill-level action selection from multimodal demonstrations remains underexplored for small vision-language models (VLMs) intended for on-device deployment. To address this gap, we introduce RoboTalk, a synthetic data-gener

Read original source ↗ Open in workspace

recordType

paper

region

Global