SOURCE-LINKED INTELLIGENCE

Conditional Total Correlation and the Serial Depth of Adaptive Parallel Sampling

arXiv · AI, language, vision and robotics · article · Aug 26, 2026 · UTC

Motivated by parallel decoding in masked diffusion models, we study adaptive parallel sampling of discrete vectors: in each round, a deterministic policy selects unrevealed coordinates on the basis of the values observed so far, and the selected coordinates are sampled independently from their exact conditional marginals. Approximation error is measured by forward Kullback-Leibler divergence, and serial depth is the minimum target-averaged number of rounds meeting a prescribed error budget. Our central result is an exact identity: the divergence of every policy equals the expected conditional

Read original source ↗ Open in workspace

recordType

paper

region

Global