SOURCE-LINKED INTELLIGENCE

Dense Process Supervision for Search Agents via Fact Utility Estimation

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Reinforcement learning (RL) for search agents typically relies on outcome rewards. However, it often fails to achieve effective credit assignment, due to the unclear value of intermediate steps. It is hard to separate their contributions from the final result. In this paper, we propose a dense process supervision method based on fact utility estimation, which models the reasoning process as the accumulation of discrete evidence facts. We first extract structured facts from raw observations and organize them into an explicit fact store. To support credit assignment, we then cluster semantically

Read original source ↗ Open in workspace

recordType

paper

region

Global