SOURCE-LINKED INTELLIGENCE

LeanGRPO: Eliminating Redundant Recomputation in Diffusion RL

arXiv · AI, language, vision and robotics · article · Sep 3, 2026 · UTC

Diffusion reinforcement learning (RL) has recently achieved significant success in post-training image and video generative models. However, most diffusion RL methods, including DanceGRPO and FlowGRPO, recompute selected timesteps with gradient tracking after rollout. Under on-policy training with the same backend for rollout and update, this recomputation is mathematically redundant. Intuitively, the rollout and policy update steps can reuse the same feed-forward backbone to avoid redundant computation, but doing so can incur a large memory overhead during rollout. To address the issue, we pr

Read original source ↗ Open in workspace

recordType

paper

region

Global