SOURCE-LINKED INTELLIGENCE

CoaG: Cylinders on a Grid: Coarse 3D Layout Control for Video Generation

arXiv · AI, language, vision and robotics · article · Sep 21, 2026 · UTC

We ask how little geometry a person has to draw to control both where people stand and where the camera moves in a generated video. Our answer is a ground plane and one cylinder per person. A user draws a grid on the ground, places one cylinder where each person should stand, moves the cylinders and the camera over 81 frames, and the model renders a photoreal video in which the people occupy the cylinders' positions, move as the cylinders move, and are seen from the drawn camera. Appearance comes from a text prompt and a background reference image; layout and motion come from the geometry. Bec

Read original source ↗ Open in workspace

recordType

paper

region

Global