AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Prefix Executability: Evaluating Tool-Using Agents Beyond Final Success

arXiv · AI, language, vision and robotics · article · Oct 29, 2026 · UTC

Tool-use benchmarks often score agents by final task success, but terminal outcomes can obscure whether the intermediate tool-call trajectory was executable. We propose prefix executability as a trajectory-level evaluation protocol for tool-using agents. The protocol measures whether every prefix of a predicted tool-call sequence remains executable under tool schemas, state preconditions, and data dependencies, and summarizes reliability using Prefix Executability Curves (PEC), First-Error Depth (FED), Trajectory Executability Rate (TER), horizon-normalized AUC-PEC, and Recovery Rate (RR). We

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-10-31T14:12:28.156Z. This is not the publication date.