SOURCE-LINKED INTELLIGENCE

When AI Reviews Train AI Reviewers: Scientific-Judgment Collapse and Mitigation

arXiv · AI, language, vision and robotics · article · Sep 17, 2026 · UTC

Large language models (LLMs) increasingly participate in scientific evaluation, both as automated reviewers and as assistants to human reviewers. As model-generated reviews enter public data and future training corpora, AI peer review can become recursive: later reviewers learn from judgments produced by earlier models. We study one step of this feedback loop in a controlled setting. Starting from Llama 3.1 8B, we first fine-tune a reviewer on official ICLR reviews from 2018--2023 and then train four successor models on ICLR 2024 data with systematically varied mixtures of official and model-g

Read original source ↗ Open in workspace

recordType

paper

region

Global