SOURCE-LINKED INTELLIGENCE

Learn How to Act from Your Own Interactions: On-Policy Self-Distillation for GUI Agents

arXiv · AI, language, vision and robotics · article · Sep 23, 2026 · UTC

Graphical User Interface (GUI) agents enable the fulfillment of complex user instructions through multi-turn interactions with software environments, requiring step-wise reasoning and long-horizon memory to guide actions and retain task-relevant information, respectively. Recent on-policy self-distillation (OPSD) methods have achieved strong performance on GUI grounding, a foundational subtask for GUI agents, owing to dense token-level supervision from privilege-conditioned self-teachers. However, extending existing OPSD methods to multi-turn GUI agents is hindered by self-teachers' limited pr

Read original source ↗ Open in workspace

recordType

paper

region

Global