SOURCE-LINKED INTELLIGENCE

Correcting Within-Group Self-Selection Bias in Prioritized Replay

arXiv · AI, language, vision and robotics · article · Sep 21, 2026 · UTC

Prioritized experience replay (PER) improves sample efficiency by replaying high-priority transitions, usually according to absolute temporal-difference error. In stochastic environments, PER can distort the distribution of realized outcomes replayed from transitions with the same state-action pair. We call this within-group self-selection. We quantify the resulting changes in within-group outcome frequencies and mean Bellman targets. We decompose PER into between-group allocation and conditional sibling selection, and derive fixed-buffer corrections that preserve current group-level priority

Read original source ↗ Open in workspace

recordType

paper

region

Global