SOURCE-LINKED INTELLIGENCE

Speculative Macro Commit for Faster Tool-Using Agents

arXiv · AI, language, vision and robotics · article · Sep 3, 2026 · UTC

Tool-using LLM agents spend wall-clock time not only on model inference but also in serial action--observation turns, where each tool call, environment transition, and observation can delay subsequent decisions. We introduce \textbf{Speculative Macro Commit} (SMC), a runtime mechanism for a two-tier agent system: a large authoritative actor model produces the official trajectory, while a faster speculative drafter model continuously predicts and executes future action chains on an isolated environment snapshot. SMC mines recurring multi-action skeletons from training traces and stores them in

Read original source ↗ Open in workspace

recordType

paper

region

Global