SOURCE-LINKED INTELLIGENCE

DuMateBench: Evaluating Autonomous Agents in Complex Real-World Workflows

arXiv · AI, language, vision and robotics · article · Aug 27, 2026 · UTC

Autonomous agents are increasingly adopted to complete complex, multi-tool workflows in real-world settings. However, existing benchmarks typically separate tasks by application or capability and evaluate agents in environments that are cleaner and more stable than those encountered in practice. We introduce DuMateBench, a real-session benchmark reconstructed from anonymized and privacy-screened user sessions collected from a large-scale production agent platform. Each task preserves the relevant pre-solution interaction history, persistent configurations, and workspace state, and is then vali

Read original source ↗ Open in workspace

recordType

paper

region

Global