SOURCE-LINKED INTELLIGENCE

Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesis

arXiv · AI, language, vision and robotics · article · Sep 3, 2026 · UTC

We present Alignment-Free Text-Audiobox (Text-AB), a unified framework for high-quality voice dubbing and full-duplex dialogue synthesis. Building on a Diffusion Transformer trained with a flow-matching objective, Text-AB departs from the Audiobox system along three dimensions. First, it operates in a latent diffusion framework using DAC-VAE features that encode 48 kHz waveforms into a 25 Hz latent sequence, giving over 10x higher compression than previous EnCodec representations while improving resynthesis quality. Second, Text-AB is alignment-free: it consumes raw text via an off-the-shelf t

Read original source ↗ Open in workspace

recordType

paper

region

Global