SOURCE-LINKED INTELLIGENCE

Simple Actors and Deep Critics for Scalable Reinforcement Learning

arXiv · AI, language, vision and robotics · article · Aug 27, 2026 · UTC

Recent progress in offline reinforcement learning (RL) has been driven by expressive generative actors such as diffusion and flow-matching policies, which capture multimodal behavior in offline datasets. However, these actors require multiple denoising or integration steps per action and thus incur substantial overhead at every decision in deployment. In this work, we revisit where capacity should be invested in an offline actor--critic method. Since the critic is used only during training and is discarded at deployment while the actor runs at every decision step, allocating capacity to the cr

Read original source ↗ Open in workspace

recordType

paper

region

Global