SOURCE-LINKED INTELLIGENCE

Limiting-Kernel Q($λ$): Bridging Short and Long Horizons

arXiv · AI, language, vision and robotics · article · Sep 23, 2026 · UTC

In value-based reinforcement learning, improving the accuracy of policy evaluation has been shown to improve downstream policy optimization performance. The widely adopted family of approximations relying on $n$-step truncation yields computationally efficient value estimators but is inherently limited to a short evaluation horizon. In contrast, methods that exploit the global structure of the transition dynamics can accelerate policy evaluation, but their memory and computational requirements often limit scalability to large or continuous state spaces. To reconcile these limitations, we intro

Read original source ↗ Open in workspace

recordType

paper

region

Global