SOURCE-LINKED INTELLIGENCE

4DStreamCtrl: Interactive Video Generation with Online 4D Control

arXiv · AI, language, vision and robotics · article · Aug 26, 2026 · UTC

Generative video models now synthesize footage nearly indistinguishable from reality. Their promise as interactive tools hinges on fine-grained control of how objects and the camera move over time, yet each existing approach captures only part of this: camera-parameter methods steer the viewpoint but cannot move objects, 2D-trajectory methods act in the image plane and ignore depth and occlusion, and recent 3D methods add geometry but run only offline at a fixed length. In particular, none combines 3D-consistent control of both camera and objects with real-time, streaming generation. Here we s

Read original source ↗ Open in workspace

recordType

paper

region

Global