SOURCE-LINKED INTELLIGENCE

GenRubric: Self-Evolving Rubric Generation for Scalable LLM Evaluation

arXiv · AI, language, vision and robotics · article · Aug 30, 2026 · UTC

Large language models are increasingly used as scalable evaluators for open-ended tasks. However, many LLM judges derive query-specific criteria during scoring, leaving the evaluation requirements insufficiently specified and their coverage difficult to audit. Query-specific rubrics make these requirements explicit, but expert-written rubrics are costly to construct, while existing automatic methods typically rely on inference-time refinement or external supervision. We introduce GenRubric, a self-evolving framework that improves rubric generation from unlabeled queries without requiring addit

Read original source ↗ Open in workspace

recordType

paper

region

Global