SOURCE-LINKED INTELLIGENCE

RPCBench: A Benchmark for Proactive Premise Critique in LLM-based Recommendation

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Large language models are increasingly used as interactive recommender assistants. Their evaluation should therefore go beyond plausible item recommendation and test whether they can recognize flawed recommendation requests. Existing recommender benchmarks mainly assess ranking, generation, or preference satisfaction, while existing error-detection benchmarks are usually not grounded in recommendation-specific user and candidate evidence. To address this gap, we introduce RPCBench, a benchmark for evaluating Recommender-Premise Critique: the ability to detect, diagnose, and properly handle fau

Read original source ↗ Open in workspace

recordType

paper

region

Global