SOURCE-LINKED INTELLIGENCE

SRPO: Setwise Relative Policy Optimization for Multi-Agent LLMs

arXiv · AI, language, vision and robotics · article · Sep 8, 2026 · UTC

Multi-agent large language models solve complex tasks by coordinating several policies in a shared environment. However, existing reinforcement learning methods usually optimize each response or trajectory separately, even when several outputs jointly cause one state transition. Consequently, the update unit differs from the action executed by the system. To address this problem, we propose SRPO (Setwise Relative Policy Optimization), which treats the active set the minimal set of outputs consumed by one transition, as one multi-agent action. Specifically, SRPO combines member log-ratios into

Read original source ↗ Open in workspace

recordType

paper

region

Global