SOURCE-LINKED INTELLIGENCE

Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Models

arXiv · AI, language, vision and robotics · article · Aug 27, 2026 · UTC

Scaling robot data is crucial for building generalist Vision-Language-Action (VLA) models, yet robot trajectories are harder to scale than web-scale image-text data because embodied collection is costly and sparsely covers the physical world. This makes representation quality a central bottleneck: under a fixed robot-data budget, continued pre-training must turn limited trajectories into transferable visual-action knowledge rather than merely fit actions. We propose VLAct, a VLA-oriented VLM backbone trained on broad, heterogeneous, multi-embodiment robot data before task-specific fine-tuning.

Read original source ↗ Open in workspace

recordType

paper

region

Global