SOURCE-LINKED INTELLIGENCE

PACT: From Credit Assignment to Critic Alignment

arXiv · AI, language, vision and robotics · article · Sep 22, 2026 · UTC

Reinforcement learning has become a central component of large language model (LLM) post-training, yet token-level credit lacks a generally accepted mathematical definition, leaving its relationship to commonly used training signals unclear. We formulate three regularity conditions, namely Completeness, Prefix Consistency, and Neutrality, and prove that they uniquely determine token-level credit. This characterization provides a unified basis for explaining phenomena across existing algorithms and guides the development of an improved actor-critic training procedure. Through this lens, an idea

Read original source ↗ Open in workspace

recordType

paper

region

Global