SOURCE-LINKED INTELLIGENCE

TimeSteer: Inference-Time Speech Scheduling in Joint Audio-Visual Diffusion Models

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Although pretrained joint audio-visual diffusion models offer rich control over \emph{what} to generate, they provide no explicit control over \emph{when} an utterance should occur. To address this, we study \emph{inference-time speech scheduling}, a novel task that places coupled speech and visual articulation within user-specified begin--end intervals without finetuning the backbone model. We uncover two intrinsic properties of the denoising process that enable this task. First, a timing-sensitive text-to-audio cross-attention head exposes each utterance's model-implied source span along the

Read original source ↗ Open in workspace

recordType

paper

region

Global