SOURCE-LINKED INTELLIGENCE

FIRE: Failure-Informed Runtime Engineering for Reliable Language-Model Agents

arXiv · AI, language, vision and robotics · article · Sep 22, 2026 · UTC

Language-model agents often reach a working solution and then fail to consistently deliver it. We study runtime policies: targeted natural-language instructions and action denials applied by the agent harness at states that preceded observed failures, without changing model weights or the user prompt. With this, keeping capability constant, we observe a meaningful unlock in delivered reliability. Across the complete 87-task Terminal-Bench 2.1 suite, with two attempts per task, policies increase repeated success (pass^2) in all three GPT-5.6 tiers: 50.6% to 54.0% for Luna, 55.2% to 60.9% for Te

Read original source ↗ Open in workspace

recordType

paper

region

Global