SOURCE-LINKED INTELLIGENCE

DI-Bench: Systematically Generating In-Domain Data Intelligence Benchmarks for Enterprise Agents

arXiv · AI, language, vision and robotics · article · Sep 4, 2026 · UTC

Evaluating enterprise agents on domain-specific benchmarks is critical, yet public benchmarks rarely evaluate whether agents can integrate business knowledge with analytical computation, and constructing such benchmarks manually is costly. We present DI-Bench, a pipeline for generating realistic benchmarks for data intelligence (DI), the practice of extracting insights from large volumes of enterprise data. To emulate realistic DI tasks that require both computation and knowledge retrieval, DI-Bench builds an artifact linkage graph over data tables, dimensions, metrics, and documents to form q

Read original source ↗ Open in workspace

recordType

paper

region

Global