AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Fork-dLLM: Avoiding the Flexibility Trap in Diffusion Language Models

arXiv · AI, language, vision and robotics · article · Sep 30, 2026 · UTC

Masked diffusion language models (dLLMs) have shown strong potential for faster inference through parallel token generation when combined with confidence-based samplers. However, recent work has shown that such methods can defer unmasking high-entropy fork positions at which multiple plausible continuations exist. This results in reduced generation diversity, as shown by worse pass@k scaling, and limits gains obtainable from RL post-training. To avoid this flexibility trap, prior work advocated for autoregressive (AR) sampling. Here, we show that discarding confidence-based sampling is unneces

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-10-01T15:32:10.694Z. This is not the publication date.