SOURCE-LINKED INTELLIGENCE

SWE-Serve: Benchmarking Agentic Engineering For Production Inference Serving

arXiv · AI, language, vision and robotics · article · Sep 22, 2026 · UTC

We introduce SWE-Serve, a benchmark for evaluating agents on production inference engineering tasks. Implementing an inference feature can require coordinating multiple changes across the serving stack, including model support, runtime execution, and public APIs. Existing benchmarks provide limited coverage of production inference engineering: repository-level software engineering benchmarks do not target inference, while general terminal-agent benchmarks include only a few inference tasks. Dedicated inference benchmarks, meanwhile, focus primarily on isolated kernel generation or performance

Read original source ↗ Open in workspace

recordType

paper

region

Global