SOURCE-LINKED INTELLIGENCE

Robust Failure, Conservative Repair: Textual Knowledge Distillation from Cross-Model Failures

arXiv · AI, language, vision and robotics · article · Sep 21, 2026 · UTC

Failure-based textual knowledge distillation aims to discover gaps in a model's knowledge by examining its task errors. The distilled knowledge can be useful for the reasoning of both this model ("source model") and other models. However, this transfer of knowledge may not be stable. We define a rule atom to be a standalone rule injected into a model's textual input at inference time. A rule atom can encode transferable task knowledge or model-specific reasoning patches that can confuse other models. Also, the injected rule atoms can be misapplied to unrelated cases, causing the model to incor

Read original source ↗ Open in workspace

recordType

paper

region

Global