SOURCE-LINKED INTELLIGENCE

Critical-State RL: Diagnosing Trainable States for Multi-Turn Tool Use

arXiv · AI, language, vision and robotics · article · Sep 21, 2026 · UTC

Multi-turn tool-use failures can hinge on a single model call, yet reward variation alone does not reveal which call would benefit from training. When rewards depend on later interactions, their variation can reflect downstream randomness rather than differences between the current actions. We introduce Critical-State RL to identify trainable states in multi-turn interactions. Given task-defined candidate calls and local rewards, the method assesses whether each reward captures the action's effect on task success and whether improvement over a reference policy is possible. It then uses nested

Read original source ↗ Open in workspace

recordType

paper

region

Global