AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Can Discrete Tokens Serve as Semantically Lossless Representations of Visual Signals?

arXiv · AI, language, vision and robotics · article · Oct 27, 2026 · UTC

Discrete visual tokens represent vision in a discrete form analogous to language, offering a native interface for multimodal modeling under a shared next-token prediction objective. However, quantization error is widely assumed to cause unavoidable semantic loss, fundamentally limiting the semantic fidelity of discrete visual tokens and positioning continuous visual representations as an intrinsic upper bound. Using multimodal understanding as a proxy for semantic fidelity, we revisit this assumption and find quantization error unreliable, as discrete representations with substantially larger

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-10-28T16:15:03.731Z. This is not the publication date.