SOURCE-LINKED INTELLIGENCE

Adaptive Doubly Robust Off-Policy Evaluation for Ranking Policies under Diverse User Behavior

arXiv · AI, language, vision and robotics · article · Aug 30, 2026 · UTC

Off-policy evaluation (OPE) of ranking policies is challenging be- cause selecting and ordering multiple items from a candidate set makes the number of possible rankings grow combinatorially with the number of candidates and the ranking length. Consequently, Inverse Propensity Scoring (IPS), whose importance weight is the full-ranking probability ratio under the evaluation and logging policies, can have excessive variance. Independent IPS (IIPS) and Reward Interaction IPS (RIPS) reduce variance by imposing fixed assumptions on how users browse rankings, but may introduce bias when those assump

Read original source ↗ Open in workspace

recordType

paper

region

Global