SOURCE-LINKED INTELLIGENCE

TuringLLM: Efficiently Scaling Foundation Models Toward Physical AI

arXiv · AI, language, vision and robotics · article · Aug 31, 2026 · UTC

We present Turing-20B-A2B, a 20B-parameter Mixture-of-Experts language model that activates approximately 2B parameters per token, designed for long-context and latency-sensitive physical AI applications. The model adopts Quantile Routing in a dynamic top-k configuration, enabling token-adaptive expert allocation while maintaining balanced expert utilization and a controlled average compute budget. During deployment, we further apply capacity-constrained routing to prompt prefill for more regular and efficient expert execution, while retaining dropless routing during pretraining. Turing-20B-A2

Read original source ↗ Open in workspace

recordType

paper

region

Global