SOURCE-LINKED INTELLIGENCE

Transferring the Intelligence of VLMs to Robotic Control

arXiv · AI, language, vision and robotics · article · Sep 19, 2026 · UTC

Humans can seamlessly adapt to both physical and digital worlds, suggesting that while a digital-to-real gap exists in embodiment, environment and task, human intelligence itself may transfer across this gap. This naturally raises a fundamental question: can the intelligence of vision-language models (VLMs) similarly generalize from the digital world to the physical world for robotic control? We investigate this question through RoboDawn, a human-intuitive interface that exposes robotic control to an agentic VLM through a compact set of discrete translation, rotation, and gripper commands. Usi

Read original source ↗ Open in workspace

recordType

paper

region

Global