SOURCE-LINKED INTELLIGENCE

Keep-or-Drop? Adaptive Tokenizer for Compact Video Representation

arXiv · AI, language, vision and robotics · article · Aug 25, 2026 · UTC

Latent diffusion models have emerged as a dominant framework for high-fidelity image and video synthesis, operating in compact latent spaces with variational autoencoders (VAEs) to enhance computational efficiency without compromising visual quality. However, conventional VAEs are suboptimal for video data as they employ fixed compression ratios that cannot adapt to the varying complexity of spatio-temporal content. We present KATok (Keep-or-Drop? Adaptive Tokenizer for Compact Video Representation), a transformer-based VAE that incorporates an adaptive token selector which is jointly learned

Read original source ↗ Open in workspace

recordType

paper

region

Global