SOURCE-LINKED INTELLIGENCE

Ignorance or Incompetence? Constructing Knowledge-Gated, Verifiable Tasks for LLM Agents

arXiv · AI, language, vision and robotics · article · Aug 31, 2026 · UTC

Professional agent tasks often depend on conventions that are absent from public corpora, yet benchmarks rarely control whether an agent has access to those conventions. We introduce a knowledge-gated task-construction protocol that separates a task instruction from a compact artefact containing private conventions, reference tables, and utility operators. Construction-time provenance, byte-identical task instructions across the provided- and withheld-artefact conditions, leak audits, and executable witnesses make dependence on the artefact explicit and testable. Across fifteen calibration tas

Read original source ↗ Open in workspace

recordType

paper

region

Global