SOURCE-LINKED INTELLIGENCE

Total Cost of Agency: Exact Attribution of Memory Injection Cost in Multi-Agent LLM Workflows

arXiv · AI, language, vision and robotics · article · Sep 20, 2026 · UTC

Every node in a multi-agent large language model (LLM) workflow retrieves context from memory and injects it into its prompt, where those injected tokens are billed as input tokens at the same per-token price as the system prompt and the user query. Production observability tools report total token cost but do not separate the tokens a node generates from the tokens it is handed, so this component of the bill is invisible to the teams paying it. We introduce the Total Cost of Agency (TCA), a decomposition of multi-agent workflow cost into base prompt, inference, memory injection, miss penalty

Read original source ↗ Open in workspace

recordType

paper

region

Global