SOURCE-LINKED INTELLIGENCE

Learning the Cost of Reliable Inference

arXiv · AI, language, vision and robotics · article · Sep 23, 2026 · UTC

Benchmarking and routing platforms increasingly act as intermediaries connecting large language model providers with end-users. However, providers on these platforms typically use a fixed price per token, preventing users from achieving the most competitive price for their tasks. % workloads. In this work, we design a procurement platform where token prices for each task are driven by provider competition, enabling users to secure competitive pricing for guaranteed quality levels. To this end, the platform sequentially routes queries via a reverse second-price auction that incentivizes model p

Read original source ↗ Open in workspace

recordType

paper

region

Global