SOURCE-LINKED INTELLIGENCE

Towards Omni-dimensional GUI Agent Navigation with Masked Trajectory Prediction

arXiv · AI, language, vision and robotics · article · Sep 22, 2026 · UTC

Graphical User Interface (GUI) Agents autonomously interact with software to fulfill user requests, where GUI navigation stands out as the most critical and challenging capability. Mastering this capability demands a complex synergy of step-wise decision-making, state-action alignment, and long-horizon planning. While directly mixing these corresponding navigation tasks seems intuitive to simultaneously acquire these skills, such a direct combination is severely bottlenecked by inconsistent optimization objectives and profound data heterogeneity. To overcome these barriers, we propose the MaP

Read original source ↗ Open in workspace

recordType

paper

region

Global