AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Inductive Feedback for Mixed-Policy Distillation

arXiv · AI, language, vision and robotics · article · Sep 28, 2026 · UTC

Verbal feedback can identify errors and prescribe corrections, providing rich supervision for language-model post-training even when reliable programmatic verifiers are unavailable. Such feedback, often generated by a capable model, can be used to condition the teacher in on-policy distillation, which trains the student to match the teacher's predictions on student-generated rollouts. However, this approach can transfer teacher preferences that the feedback did not motivate, while leaving much of the feedback's guidance unused. We find that both problems come from the standard on-policy distil

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-09-29T05:21:26.151Z. This is not the publication date.