SOURCE-LINKED INTELLIGENCE

Counterfactual Tool Ranking under Utility, Cost, and Privilege Constraints

arXiv · AI, language, vision and robotics · article · Sep 19, 2026 · UTC

Counterfactual tool evaluation must distinguish authority, historical support, and what a comparison actually estimates. We study these distinctions with eleven executable enterprise-inspired tools, exact-propensity logs, and real local Model Context Protocol transport. An initial 45-run synthetic study is retained, then challenged by 30 realized-return control runs and 15 experiments on 1,930 independently released Berkeley Function Calling Leaderboard (BFCL) tasks. Full-return direct regression reverses an initially favorable doubly robust (DR) evaluation result in the linear setting: mean a

Read original source ↗ Open in workspace

recordType

paper

region

Global