SOURCE-LINKED INTELLIGENCE

Passes Alone, Fails Together: Benchmarking Semantic Coordination in Parallel LLM-Agent Development

arXiv · AI, language, vision and robotics · article · Sep 21, 2026 · UTC

Parallel coding agents can produce patches that work alone but fail when merged. This happens when one agent changes an interface or rule that another agent still relies on. We study these failures with stale, a benchmark for semantic coordination. Our evaluation runs the same tests on each patch alone and on their combination, counting only failures introduced by combining the patches. We use three tiers: synthetic tasks with controlled interface changes, pairs of merged pull requests, and constructed tasks that use real Django helpers. Among 834 runs on 417 mined Django pairs, only one showe

Read original source ↗ Open in workspace

recordType

paper

region

Global