SOURCE-LINKED INTELLIGENCE

FDE-Bench: Evaluating LLM Agents for Deployment Environment Configuration

arXiv · AI, language, vision and robotics · article · Sep 23, 2026 · UTC

Deployment requires an agent to turn application code into a running system whose services connect, become ready, and remain observable. FDE-Bench evaluates this capability with 136 deployment-configuration tasks spanning Docker images, multi-service Compose stacks, and Kubernetes, in greenfield and diagnose-and-repair modes. Agents submit declarative artifacts that are collected, rebuilt, and redeployed in a pristine environment. Four gated binary check layers measure build, readiness, behavior, and conformance to the deployment specification, using programmatic checks without an LLM judge. A

Read original source ↗ Open in workspace

recordType

paper

region

Global